Fork me on GitHub


In package com.mitchellbosecke.pebble.tokenParser

public interface interface TokenParser

A TokenParser is responsible for converting a stream of Tokens into a Node. A TokenParser often has to temporarily delegate responsibility to Pebble's main Parser or Pebble's ExpressionParser.


public String getTag()

The "tag" is used to determine when to use a particular instance of a TokenParser. For example, the TokenParser that handles the "block" tag would return "block" with this method.

  • No parameters
public RenderableNode parse(Token token, Parser parser)

The TokenParser is responsible to convert all the necessary tokens into appropriate Nodes. It can access tokens using parser.getTokenStream().

The tag may be self contained like the "extends" tag or it may have a start and end point with content in the middle like the "block" tag. If it contains content in the middle, it can use parser.subparse(stopCondition) to parse the middle content at which point responsibility comes back to the TokenParser to parse the end point.

It is the responsibility of the TokenParser to ensure that when it is complete, the "current" token of the primary Parser's TokenStream is pointing to the NEXT token. USUALLY this means the last statement in this parse method, immediately prior to the return statement, is the following which will consume one token:


Here are two relatively simple examples of how TokenParsers are implemented:

  • self contained: com.mitchellbosecke.pebble.tokenParser.SetTokenParser - middle content: com.mitchellbosecke.pebble.tokenParser.BlockTokenParser
  • Token token

    The token to parse

  • Parser parser

    the parser which should be used to parse the token