C# (CSharp) TokenizeFiles Examples

Example #1

File: TokenizeSampleFilesTest.cs Project: bear256/RTVS

 public void TokenizeSampleRdFile(string fileName)
 => TokenizeFiles.TokenizeFile <RdToken, RdTokenType, RdTokenizer>(_files, fileName, "RD");

Example #2

File: TokenizeSampleFilesTest.cs Project: zachwieja/RTVS

 public void TokenizeSampleMdFile01()
 {
     TokenizeFiles.TokenizeFile <MarkdownToken, MarkdownTokenType, MdTokenizer>(_files, @"Tokenization\01.md", "Markdown");
 }