Metadata-Version: 2.1
Name: defsent
Version: 0.1.0
Summary: DefSent: Sentence Embeddings using Definition Sentences
Home-page: https://arxiv.org/abs/2105.04339
Author: hppRC
Author-email: hpp.ricecake@gmail.com
Requires-Python: >=3.7,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Requires-Dist: torch
Requires-Dist: transformers
Project-URL: Repository, https://github.com/hppRC/defsent
Description-Content-Type: text/markdown

# DefSent: Sentence Embeddings using Definition Sentences


## Pretrained checkpoints

| checkpoint | STS12 | STS13 | STS14 | STS15 | STS16 | STS-B | SICK-R | Avg. |
|--|--|--|--|--|--|--|--|--|
|defsent-bert-base-uncased-cls|67.61|80.44|70.12|77.5|76.34|75.25|71.71|74.14|
|defsent-bert-base-uncased-mean|68.24|82.62|72.8|78.44|76.79|77.5|71.69|75.44|
|defsent-bert-base-uncased-max|65.32|82.00|73.00|77.38|75.84|76.74|71.67|74.57|
|defsent-bert-large-uncased-cls|67.03|82.41|71.25|80.33|75.43|73.83|73.34|74.8|
|defsent-bert-large-uncased-mean|63.93|82.43|73.29|80.52|77.84|78.41|73.39|75.69|
|defsent-bert-large-uncased-max|60.15|80.70|71.67|77.19|75.71|76.90|72.57|73.55|
|defsent-roberta-base-cls|66.13|80.96|72.59|78.33|78.85|78.51|74.44|75.69|
|defsent-roberta-base-mean|62.38|78.42|70.79|74.60|77.32|77.38|73.07|73.42|
|defsent-roberta-base-max|64.61|78.76|70.24|76.07|79.02|78.34|74.54|74.51|
|defsent-roberta-large-cls|62.47|79.07|69.87|72.62|77.87|79.11|73.95|73.56|
|defsent-roberta-large-mean|57.8|72.98|69.18|72.84|76.50|79.17|74.36|71.83|
|defsent-roberta-large-max|64.11|81.42|72.52|75.37|80.23|79.16|73.76|75.22|

