Returns solely the term text as specified by the CharSequence interface.
this method changed the behavior with Lucene 3.1, before it returned a String representation of the whole term with all attributes. this affects especially the Lucene.Net.Analysis.Token subclass.