Visualizing the BERT normalizer
Your text
Example
Model
Step by step
Before
After
◀
Next step ▶
–
non-ASCII byte
ASCII
stable
unstable: Unicode chain
checked in tables
scan stops
–
Normalizer only, before vs after