GigaToken: ~1000x faster Language model tokenization

by syrusakbary | View on Hacker News