BAAI’s (english) embedding model version 1.5 for passage retrieval and sentence similarity, using the Center For Curriculum Redesign’s Replicate Embedding Cog template.
As of September 2023, this model is state of the art.
- output dimensions : 1024
- parameters: 326M
- MTEB score average: 64.23
| Dimension | Sequence Length | Average (56) | Retrieval (15) | Clustering (11) | Pair Classification (3) | Reranking (4) | STS (10) | Summarization (1) | Classification (12) |
| 1024 | 512 | 64.23 | 54.29 | 46.08 | 87.12 | 60.03 | 83.11 | 31.61 | 75.97 |
Usage
This endpoint is structured primarily for generating passage/document embeddings. You can give it a large excerpt_files json object of the following form as input:
{
"file1.json": "http://someplace.com/somefile1.json",
//..
"fileN.json": "https://someplace.come/somefileN.json"
}
The contents of each input file should be an array of strings parsing to no more than 512 BERT tokens per string.
This endpoint will asynchronously download the files from the provided URLs and generate embedings for the strings contained in each file. The embeddings will be stored as downloadable files named after the keys of your excerpt_files JSON. Whatever webhook you specify will be provided with URLS from which you may download the generated embeddings for each input file.
Each generated embedding files will contain an array of 1024 dimensional vectors, where each is the embedding of the string at the same index in your input file.
Make sure to test your webhook code with a few small batches before attempting a large indexing run. And make sure your webhook code downloads the files within an hour of being notified of their availability.