Metadata-Version: 1.1
Name: rftokenizer
Version: 2.0.0
Summary: A character-wise tokenizer for morphologically rich languages
Home-page: https://github.com/amir-zeldes/RFTokenizer
Author: Amir Zeldes
Author-email: amir.zeldes@georgetown.edu
License: Apache License, Version 2.0
Download-URL: https://github.com/amir-zeldes/RFTokenizer/releases/tag/v2.0.0
Description: UNKNOWN
Keywords: NLP,tokenization,segmentation,morphology,morphological,Hebrew,Arabic,Coptic,word,splitting
Platform: UNKNOWN
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
