Exemplos de Stinky.Compiler.Source.Tokenization RootTokenizer.OnToken em C# (CSharp)

Exemplo n.º 1

Arquivo: AlphaNumericTokenizer.cs Projeto: lunchtimemama/Stinky

 public AlphanumericTokenizer(Location location, RootTokenizer rootTokenizer)
     : base(rootTokenizer)
 {
     rootTokenizer.OnToken(
         parser => parser.ParseIdentifier(
             () => stringBuilder.ToString(), new Region(location, stringBuilder.Length)));
 }

Exemplo n.º 2

Arquivo: NumberLiteralTokenizer.cs Projeto: lunchtimemama/Stinky

 public NumberLiteralTokenizer(Location location, RootTokenizer rootTokenizer)
     : base(rootTokenizer)
 {
     rootTokenizer.OnToken(
         parser => parser.ParseNumberLiteral(
             () => double.Parse(stringBuilder.ToString()), new Region(location, stringBuilder.Length)));
 }