Skip to content

Type Editor


Type Editor / @type-editor/changeset / tokenizer/tokenize-fragment

tokenizer/tokenize-fragment

Functions

FunctionDescription

tokenizeFragment

Convert the given range of a fragment to tokens for diff comparison. Recursively processes the fragment tree, encoding text characters and node boundaries.