sci-ml/

pysentencepiece

Text tokenizer for Neural Network-based text generation

https://github.com/google/sentencepiece