Metadata-Version: 2.1
Name: maketoken
Version: 0.0.3
Summary: 分词工具, 把文件中的词分割成token
Home-page: https://github.com/yunfengsay/makeToken
Author: flynn
Author-email: fdoctor00@gmail.com
License: UNKNOWN
Description: # makeToken
        分词工具
        useages:
        ```
        maketoken ./xxx.txt ./xxx.tokened.txt
        ```
        
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Description-Content-Type: text/markdown
