Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Spaces:
toksuite
/
quick-tokenizer-accuracy
like
0
Runtime error
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
main
quick-tokenizer-accuracy
66.3 kB
Ctrl+K
Ctrl+K
2 contributors
History:
20 commits
Gül Sena Altıntaş
Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy
b1c588a
4 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
.gitignore
Safe
10 Bytes
- Save with prefix
9 months ago
README.md
Safe
712 Bytes
Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy
4 months ago
app.py
Safe
45.8 kB
Updated hf paths for toksuite models
4 months ago
requirements.txt
Safe
82 Bytes
- Removed header
9 months ago
serve_on_killarney.sh
Safe
6.89 kB
Now accepts multiline!
9 months ago
supertoken.py
Safe
11.2 kB
Fixed issue with tokenmonster and tekken tokenizers
9 months ago
