Type Editor

---

Type Editor / @type-editor/changeset / tokenizer/tokenize-block-node / tokenizeBlockNode

Function: tokenizeBlockNode()

function tokenizeBlockNode<T>(
  blockNode,
  encoder,
  rangeStart,
  rangeEnd,
  nodeOffset,
  nodeEndOffset,
  target,
): void;

Defined in: tokenizer/tokenize-block-node.ts:19

Tokenize a block (non-leaf) node by encoding its boundaries and recursively tokenizing its content.

Type Parameters

Type Parameter
T

Parameters

Parameter	Type	Description
blockNode	Node_2	The block node to tokenize.
encoder	TokenEncoder<T>	The encoder to use for converting nodes to tokens.
rangeStart	number	The start position in the document.
rangeEnd	number	The end position in the document.
nodeOffset	number	The offset of this node in the document.
nodeEndOffset	number	The end offset of this node in the document.
target	T[]	The array to append tokens to.

Returns

void