Metadata-Version: 2.1
Name: xxnlp
Version: 0.1.2
Summary: 
Author: dennislblog
Author-email: dennisl@udel.edu
Requires-Python: >=3.8,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Dist: cloudpickle (>=2.1.0,<3.0.0)
Requires-Dist: deepspeed (>=0.7.4,<0.8.0)
Requires-Dist: evaluate (>=0.3.0,<0.4.0)
Requires-Dist: fastnlp (>=1.0.1,<2.0.0)
Requires-Dist: fitlog (>=0.9.13,<0.10.0)
Requires-Dist: hydra-core (>=1.2.0,<2.0.0)
Requires-Dist: ipython (>=8.6.0,<9.0.0)
Requires-Dist: jieba (>=0.42.1,<0.43.0)
Requires-Dist: jsonlines (>=3.1.0,<4.0.0)
Requires-Dist: networkx (>=2.8.8,<3.0.0)
Requires-Dist: pyhocon (>=0.3.59,<0.4.0)
Requires-Dist: pytest (>=7.2.0,<8.0.0)
Requires-Dist: python-dotenv (>=0.19.2,<0.20.0)
Requires-Dist: pytorch-lightning (>=1.7.7,<2.0.0)
Requires-Dist: scikit-learn (>=1.1.3,<2.0.0)
Requires-Dist: scipy (>=1.9.3,<2.0.0)
Requires-Dist: sentencepiece (>=0.1.97,<0.2.0)
Requires-Dist: textdistance (>=4.5.0,<5.0.0)
Requires-Dist: torchmetrics (>=0.10.2,<0.11.0)
Requires-Dist: transformers (>=4.25.1,<5.0.0)
Description-Content-Type: text/markdown

# XNLP

首先是document embedding: 怎么把原始的一个段落/推文给转换成一个embedding, 这里有很多的Embedding模型(bert,xlnet,)和sentence-embedding模型

在得到了段落的embedding基础上, 下一步是怎么把信息给整合起来, 这里可以用attn+lstm或者transformer

