All issues

Search results

Undefined reference

Status: Open.

#39In daulet/tokenizers;

· jankokondic opened on Jul 3, 2025

please help me

Status: Open.

#38In daulet/tokenizers;

· gosundy opened on May 26, 2025

Memory Leak via Cgo in Encode/Decode with Large Inputs (v1.20.2)

Status: Open.

#35In daulet/tokenizers;

· Nav31 opened on Mar 27, 2025

Panic when execute tk.Encode

Status: Open.

#31In daulet/tokenizers;

· qihuang0 opened on Dec 3, 2024

Can padding and/or Truncation be overridden using the library

Status: Open.

#30In daulet/tokenizers;

· rmrbytes opened on Nov 29, 2024

Can tokenizers.fromPretrained cache directory be specified

Status: Open.

#29In daulet/tokenizers;

· rmrbytes opened on Nov 16, 2024

Performance regression

Status: Open.

#14In daulet/tokenizers;

· daulet opened on Nov 19, 2023