Skip to content

Type Editor


Type Editor / @type-editor/changeset / tokenizer/tokenize-block-node

tokenizer/tokenize-block-node

Functions

FunctionDescription

tokenizeBlockNode

Tokenize a block (non-leaf) node by encoding its boundaries and recursively tokenizing its content.