tokenizer2
v2.0.1
tokenize any text stream given some basic regex rules to match tokens
Install
npm
install
tokenizer2
Bundle size
Dependencies
Downloads
SVG service
Dependencies
Dependencies
(1)
through2
^2.0.0
Peer Dependencies
(0)
Dev Dependencies
(2)
tap-min
^1.0.0
tape
^4.0.0