C# (CSharp) Alice.Web.Infrastructure PanGuTokenizer示例

示例#1

        public override TokenStream TokenStream(string fieldName, TextReader reader)
        {
            TokenStream result = new PanGuTokenizer(reader);

            result = new LowerCaseFilter(result);
            return(result);
        }

示例#2

文件： PanGuAnalyzer.cs 项目： otakustay/Alice

 public override TokenStream TokenStream(string fieldName, TextReader reader)
 {
     TokenStream result = new PanGuTokenizer(reader);
     result = new LowerCaseFilter(result);
     return result;
 }