multiscript

Here is 1 public repository matching this topic...

ziegler-ingo / rate-utility-frontiers

Code and resources for the paper "Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content"

compression transformers frontiers tokenization encoders multiscript multilingual-nlp tokenization-free rate-utility

Updated Jul 20, 2026
Python

Improve this page

Add a description, image, and links to the multiscript topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multiscript topic, visit your repo's landing page and select "manage topics."

Learn more