C# (CSharp) dfPlainTextTokenizer.tokenize示例

示例#1

 public static List <dfMarkupToken> Tokenize(string source)
 {
     if (singleton == null)
     {
         singleton = new dfPlainTextTokenizer();
     }
     return(singleton.tokenize(source));
 }

示例#2

文件： dfPlainTextTokenizer.cs 项目： Virobeast2/RCLIENT

 public static System.Collections.Generic.List <dfMarkupToken> Tokenize(string source)
 {
     if (singleton == null)
     {
         singleton = new dfPlainTextTokenizer();
     }
     return(singleton.tokenize(source));
 }