Interface ITokenizeLineResult

interface ITokenizeLineResult {
    ruleStack: StateStack;
    stoppedEarly: boolean;
    tokens: IToken[];
}

Index

Properties

ruleStack stoppedEarly tokens

Properties

`Readonly` ruleStack

ruleStack: StateStack

The prevState to be passed on to the next line tokenization.

`Readonly` stoppedEarly

stoppedEarly: boolean

Did tokenization stop early due to reaching the time limit.

`Readonly` tokens

tokens: IToken[]