Skip to content

Route byte-level llama tokenizers to TokenizersBackend#47017

Open
subin9 wants to merge 1 commit into
huggingface:mainfrom
subin9:fix-llama3-bytelevel-tokenizer-routing
Open

Route byte-level llama tokenizers to TokenizersBackend#47017
subin9 wants to merge 1 commit into
huggingface:mainfrom
subin9:fix-llama3-bytelevel-tokenizer-routing

Route byte-level llama tokenizers to TokenizersBackend

e073da1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Get PR number / Get PR number
succeeded Jul 2, 2026 in 5s