상속: NuGet.Indexing.DotTokenizer
TestTokenizer 1 문서
예제 #1
0
        static void TestTokenization(string s)
        {
            TokenStream tokenStream = new TestTokenizer(new StringReader(s));

            ITermAttribute termAttribute = tokenStream.AddAttribute <ITermAttribute>();

            while (tokenStream.IncrementToken())
            {
                Console.WriteLine(termAttribute.Term);
            }
        }
예제 #2
0
파일: Program.cs 프로젝트: NuGet/Entropy 
        static void TestTokenization(string s)
        {
            TokenStream tokenStream = new TestTokenizer(new StringReader(s));

            ITermAttribute termAttribute = tokenStream.AddAttribute<ITermAttribute>();

            while (tokenStream.IncrementToken())
            {
                Console.WriteLine(termAttribute.Term);
            }
        }