Linux HLS Server including uploader, segmenter, chunks dealer and media manager
-
Updated
Sep 9, 2017 - Python
Linux HLS Server including uploader, segmenter, chunks dealer and media manager
Tokenization, sentence segmentation, POS tagging and dependency parsing for biomedical texts (BMC Bioinformatics 2019)
Chinese Tokenizer module for Python
Segmenter and Orthography Standardazier (SOS) for Classical Arabic (CA)
[VISAPP 2026] Graph-Guided Token Merging (G2TM) is a lightweight one-shot module designed to eliminate redundant tokens in the early layers of a ViT-based models, through graph theory. It performs a single token merging step after a shallow attention block, enabling all subsequent layers to operate on a compact token set.
Sequence tagging(Word Segmenter), POS tagging and NER with Tensorflow
Tools for segmenting natural language words into morphs / morphemes.
Source code and reproducibility package for "Reliability-Guided Token Compression for Efficient Transformer-Based Visual Inference", submitted to The Visual Computer.
Add a description, image, and links to the segmenter topic page so that developers can more easily learn about it.
To associate your repository with the segmenter topic, visit your repo's landing page and select "manage topics."