Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

History

7 Commits

Repository files navigation

Text Processing and Tokenization with BKit

This project provides a Python script that processes text data from a CSV file. It applies various text transformations including tokenization, lemmatization, named entity recognition (NER), part-of-speech (POS) tagging, and digit cleaning. The processed data is saved to a new CSV file.

Requirements

pip install pandas bkit[all] 

Usage

python main.py input_csv output_csv

Arguments:

input_csv: Path to the input CSV file containing the text column (text).
output_csv: Path to the output CSV file where the processed data will be saved.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages