Hacker Neus
GigaToken: ~1000x faster Language model tokenization
(github.com)
205 points
by syrusakbary
3 hours ago |
38 comments