TypeScript vs/editor/common/modes IStream Examples

Example #1

File: nullMode.ts Project: aminroosta/vscode

	public tokenize(stream:IStream):ITokenizationResult {
		stream.advanceToEOS();
		return { type:'' };
	}

Example #2

File: textToHtmlTokenizer.test.ts Project: BMGburger/vscode

	public tokenize(stream:IStream):ITokenizationResult {
		return { type: stream.next() === '.' ? '' : 'text' };
	}