Java Code Examples for org.antlr.runtime.CommonToken#setChannel()

The following examples show how to use org.antlr.runtime.CommonToken#setChannel() . You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source File: AbstractSplittingTokenSource.java    From xtext-core with Eclipse Public License 2.0 6 votes vote down vote up 
/**
 * Create a new token from the given prototype. Any argument besides the prototype is optional and
 * will be ignored if its value is <code>null</code>.
 */
protected CommonToken createToken(CommonToken prototype, String text, 
		Integer charPosInLine, Integer channel, Integer start, Integer stop, Integer type) {
	if (prototype == null)
		throw new IllegalArgumentException("Prototype may not be null.");
	CommonToken result = new CommonToken(prototype);
	if (text != null)
		result.setText(text);
	if (charPosInLine != null)
		result.setCharPositionInLine(charPosInLine.intValue());
	if (channel != null)
		result.setChannel(channel.intValue());
	if (start != null)
		result.setStartIndex(start.intValue());
	if (stop != null)
		result.setStopIndex(stop.intValue());
	if (type != null)
		result.setType(type.intValue());
	return result;
}
Example 2
Source File: NodeModelTokenSource.java    From n4js with Eclipse Public License 1.0 5 votes vote down vote up 
/**
 * Skips the given leaf as it's hidden. If it was the last token to be returned, a hidden token may be syntesized if
 * would affect the semicolon insertion.
 */
private Token processHiddenToken(ILeafNode leaf) {
	Token result = nextToken();
	if (result == Token.EOF_TOKEN && Strings.countLineBreaks(leaf.getText()) > 0) {
		next = result;
		CommonToken hidden = new CommonToken(tokenTypeMapper.getInternalTokenType(leaf), leaf.getText());
		hidden.setChannel(Token.HIDDEN_CHANNEL);
		return hidden;
	}
	return result;
}
Example 3
Source File: AbstractIndentationTokenSource.java    From xtext-core with Eclipse Public License 2.0 5 votes vote down vote up 
protected Token createEndToken(int offset) {
	CommonToken result = new CommonToken(getEndTokenType());
	result.setText("");
	result.setChannel(Token.DEFAULT_CHANNEL);
	result.setStartIndex(offset);
	result.setStopIndex(offset-1);
	return result;
}
Example 4
Source File: AbstractIndentationTokenSource.java    From xtext-core with Eclipse Public License 2.0 5 votes vote down vote up 
protected Token createBeginToken(int offset) {
	CommonToken result = new CommonToken(getBeginTokenType());
	result.setText("");
	result.setChannel(Token.DEFAULT_CHANNEL);
	result.setStartIndex(offset);
	result.setStopIndex(offset-1);
	return result;
}