C# (CSharp) SearchEngine.Analysis ThesaurusTokenizer Examples

Example #1

File: ThesaurusAnalyzer.cs Project: sqzhuyi/cnopenblog

 /// <summary>
 /// Creates a TokenStream which tokenizes all the text in the provided Reader.
 /// </summary>
 /// <returns>A TokenStream build from a ThesaurusTokenizer filtered with ThesaurusSpliter.</returns>
 public override sealed TokenStream TokenStream(String fieldName, TextReader reader)
 {
     TokenStream result = new ThesaurusTokenizer(reader);
     return result;
 }

Example #2

        /// <summary>
        /// Creates a TokenStream which tokenizes all the text in the provided Reader.
        /// </summary>
        /// <returns>A TokenStream build from a ThesaurusTokenizer filtered with ThesaurusSpliter.</returns>
        public override sealed TokenStream TokenStream(String fieldName, TextReader reader)
        {
            TokenStream result = new ThesaurusTokenizer(reader);

            return(result);
        }