This repository was archived by the owner on Jun 11, 2026. It is now read-only.

This repository was archived by the owner on Jun 11, 2026. It is now read-only.

Support for ONNX models & INT8 quantization #94

Open

Bhargavi Karumanchi (bkaruman)

opened

on Jun 11, 2021

Thanks for the excellent toolkit.
Are there plans to support ONNX models? It would be nice to see some speed-up data on quantized(INT8) attention.

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests