mark3labs / embeddings-gte-base

General Text Embeddings (GTE) model.

  • Public
  • 1.1M runs
  • T4
  • GitHub
  • License

Input

*string
Shift + Return to add a new line

Text string to embed

Output

text

A long time ago in a galaxy far, far away....

vectors

[ -0.03071732632815838, -0.024373497813940048, 0.03353334963321686, 0.002168054925277829, 0.06559721380472183, -0.009457750245928764, 0.011472711339592934, 0.028100572526454926, -0.017572680488228798, -0.04897604510188103, -0.02974911965429783, 0.017224477604031563, -0.05097205936908722, 0.0567566379904747, -0.002953317714855075, 0.06358537822961807, 0.030977727845311165, 0.01616182178258896, 0.012071298435330391, -0.0005556714604608715, 0.021825410425662994, 0.00041404605144634843, -0.018757876008749008, 0.03421301767230034, 0.02597930282354355, -0.003731141798198223, 0.012275946326553822, 0.015756972134113312, -0.06576716899871826, -0.005411061458289623, 0.026259439066052437, -0.016671208664774895, -0.030459359288215637, -0.04489941522479057, -0.048175495117902756, -0.021977413445711136, -0.014078228734433651, -0.03589620813727379, -0.0029293883126229048, 0.00452693784609437, -0.03163100779056549, 0.010947152972221375, -0.00947609543800354, 0.007042331621050835, -0.06295519322156906, -0.0001946154225151986, -0.01319849956780672, 0.03507101535797119, -0.029495539143681526, 0.008186026476323605, -0.05392952263355255, 0.0027395219076424837, 0.01921624131500721, -0.03803539648652077, -0.011933332309126854, 0.01921091228723526, -0.03993094712495804, -0.02464507520198822, 0.003642246127128601, -0.03175102546811104, 0.05019378662109375, -0.0062024896033108234, 0.016031930223107338, -0.04464631900191307, -0.025898542255163193, -0.028345681726932526, 0.01728341169655323, 0.020044216886162758, -0.055457424372434616, 0.017943376675248146, -0.02262154221534729, -0.014412430115044117, -0.0018129824893549085, -0.03253751993179321, 0.015021199360489845, -0.06109333783388138, 0.022311672568321228, 0.06102001294493675, 0.05849688872694969, -0.009589006192982197, 0.0007744774920865893, -0.041240010410547256, -0.005644418764859438, 0.045361343771219254, -0.043538205325603485, -0.06450886279344559, 0.012266511097550392, -0.0248065534979105, -0.03636641427874565, 0.09033790975809097, -0.04869699478149414, -0.05273200944066048, 0.023745067417621613, 0.040951941162347794, 0.008136944845318794, -0.04432101175189018, 0.060222361236810684, 0.00001591165164427366, 0.007274646311998367, 0.04468235373497009, -0.030397970229387283, -0.040633488446474075, -0.03367091715335846, -0.007780101150274277, -0.08911990374326706, 0.021564045920968056, 0.03888764604926109, 0.02202647551894188, -0.013537413440644741, 0.003529703477397561, -0.020541531965136528, -0.00412712013348937, -0.006276927422732115, -0.005959681235253811, -0.0559726245701313, 0.05799037590622902, 0.0411699116230011, -0.006847027223557234, 0.008980031125247478, -0.04338046535849571, 0.04826321825385094, 0.05327825993299484, 0.026365438476204872, 0.10919017344713211, 0.012135209515690804, 0.027204368263483047, 0.017326338216662407, 0.02955007180571556, -0.0669524297118187, -0.07623325288295746, 0.048051655292510986, 0.04750660061836243, -0.035275209695100784, -0.0017875561024993658, -0.015470143407583237, -0.01505392324179411, -0.003879355266690254, 0.010960884392261505, -0.011678221635520458, -0.038119252771139145, -0.003122328082099557, -0.001188858412206173, -0.013370056636631489, 0.024641528725624084, 0.013955533504486084, -0.02309665083885193, -0.009816930629312992, -0.0528036504983902, -0.013501816429197788, 0.00032964645652100444, -0.049578242003917694, -0.004176389425992966, 0.005541543010622263, -0.08342834562063217, 0.025820601731538773, 0.020786140114068985, -0.029063232243061066, 0.03458087518811226, -0.02856394089758396, 0.01788334734737873, 0.0476723350584507, -0.024769214913249016, -0.012365770526230335, -0.01505961176007986, 0.014796656556427479, -0.013433476909995079, 0.02087458409368992, -0.030464215204119682, -0.0063930475153028965, 0.025409910827875137, -0.03462944179773331, -0.018225619569420815, 0.05357397720217705, 0.0061065820045769215, -0.010305708274245262, 0.023874256759881973, 0.10391250252723694, -0.0005081530543975532, 0.0021471513900905848, -0.02601032145321369, -0.11357389390468597, 0.04089230298995972, -0.0004017992177978158, 0.040701381862163544, -0.009061823599040508, -0.01673305593430996, 0.06031576916575432, -0.04315052554011345, -0.04048812761902809, -0.00883555319160223, -0.06205332279205322, -0.06340181827545166, 0.025315269827842712, -0.031212814152240753, 0.0699591264128685, -0.023133445531129837, -0.017026089131832123, 0.021827179938554764, -0.00400324072688818, 0.008453324437141418, -0.05835845321416855, 0.02482285536825657, 0.05190793052315712, -0.02714741975069046, -0.04483892023563385, 0.012003987096250057, 0.008279886096715927, 0.005202506203204393, 0.031439222395420074, 0.05473706126213074, 0.022855740040540695, 0.04085538163781166, 0.03339530527591705, -0.028297677636146545, 0.04309281334280968, 0.026033945381641388, 0.0008892734767869115, -0.019497646018862724, 0.00788708496838808, -0.04244615510106087, -0.002667970722541213, 0.006072867661714554, -0.018195196986198425, -0.01690595969557762, 0.014233250170946121, 0.08048997819423676, 0.0747368186712265, -0.08076724410057068, 0.021361159160733223, 0.010897756554186344, 0.0037502767518162727, -0.010181527584791183, -0.02057606913149357, 0.017686299979686737, 0.023525064811110497, -0.03011554852128029, -0.01878289319574833, -0.04211781173944473, 0.049329422414302826, -0.0365024134516716, 0.025126803666353226, 0.04832252115011215, -0.008515354245901108, 0.06350470334291458, 0.011389845050871372, 0.014746367000043392, -0.006821162533015013, -0.024406375363469124, -0.035239364951848984, -0.035650793462991714, -0.003763932501897216, -0.03396720811724663, 0.024740418419241905, 0.0010327687487006187, 0.047384802252054214, -0.07183308154344559, -0.01168549619615078, -0.020383715629577637, 0.08237742632627487, 0.023165583610534668, -0.005238982383161783, 0.006353504490107298, 0.011563744395971298, -0.01961783692240715, -0.048740990459918976, -0.06347180157899857, -0.02986185997724533, -0.0166387427598238, 0.026019200682640076, 0.025540148839354515, 0.039153121411800385, -0.004560708999633789, 0.021494198590517044, 0.014978345483541489, -0.0225543063133955, -0.009255655109882355, 0.019103948026895523, 0.004462731070816517, -0.0022641480900347233, -0.047596365213394165, 0.0320112369954586, 0.07094878703355789, -0.04127020761370659, -0.029662558808922768, -0.006867862772196531, -0.07570690661668777, 0.03078974224627018, -0.011162560433149338, -0.026083234697580338, 0.023145949468016624, 0.01932528242468834, 0.03272199630737305, -0.008909232914447784, 0.029665475711226463, 0.012926695868372917, 0.0013880725018680096, 0.029897836968302727, 0.027862314134836197, -0.00031195353949442506, -0.009943856857717037, -0.011241999454796314, 0.05082276090979576, -0.023503080010414124, 0.017279289662837982, -0.0197259820997715, 0.029798639938235283, -0.020395074039697647, -0.04404774680733681, -0.2045934647321701, 0.004593590274453163, 0.012041577138006687, -0.06095978245139122, 0.013364876620471478, 0.029009873047471046, 0.02841189317405224, -0.04123567044734955, -0.027281153947114944, -0.017753783613443375, -0.006106687244027853, 0.005594945512712002, 0.02575419843196869, 0.03148931264877319, 0.017723022028803825, -0.034242983907461166, 0.013863245025277138, -0.03481116145849228, -0.02982591651380062, 0.023225825279951096, -0.03741782158613205, -0.06902944296598434, -0.017654776573181152, 0.00013914854207541794, -0.0008097983081825078, 0.06175510957837105, -0.012224648147821426, -0.019915105774998665, -0.07473470270633698, -0.01875699684023857, 0.0023726352956146, -0.02455313876271248, 0.028372373431921005, -0.009534451179206371, -0.0012233565794304013, -0.006161087192595005, 0.018277136608958244, -0.02839946746826172, -0.010649972595274448, -0.01679837331175804, 0.0018669486744329333, -0.0528128482401371, -0.019987665116786957, 0.01168893650174141, 0.07046624273061752, 0.0037756271194666624, -0.012673038989305496, -0.001533143687993288, -0.007430687081068754, 0.08706751465797424, 0.011006700806319714, -0.021953072398900986, -0.010646632872521877, -0.020737424492836, -0.010725432075560093, 0.018433207646012306, -0.019427556544542313, 0.060012336820364, -0.02882329747080803, -0.01078065950423479, 0.010674707591533661, -0.02886168099939823, -0.05378396436572075, -0.04668067768216133, -0.015726683661341667, -0.046342723071575165, -0.007459355052560568, -0.03596101328730583, 0.030959663912653923, -0.017099788412451744, -0.03938513249158859, -0.01669282652437687, -0.02660941518843174, -0.06369087845087051, 0.000260062312008813, -0.01471378467977047, -0.04291198402643204, -0.03885132819414139, -0.0011068606982007623, 0.033954184502363205, -0.02498263493180275, -0.03645499423146248, 0.05123826861381531, 0.008033568039536476, -0.013767491094768047, -0.013181137852370739, 0.016547678038477898, -0.03992589935660362, -0.00591080030426383, -0.06149276718497276, 0.0886995866894722, -0.002964610233902931, -0.03364023566246033, -0.006764219142496586, 0.04308711364865303, 0.0067987386137247086, -0.020452747121453285, -0.016110658645629883, 0.030508464202284813, 0.008942268788814545, 0.05310694873332977, -0.05207911878824234, 0.02817063219845295, -0.015945518389344215, 0.0064452714286744595, -0.021829064935445786, -0.04954668879508972, -0.02710185945034027, 0.011737482622265816, -0.03678831830620766, 0.09054262936115265, -0.011520031839609146, 0.04359981790184975, -0.05103173851966858, 0.010230966843664646, -0.02641931176185608, 0.0021981745958328247, 0.08750878274440765, 0.018338773399591446, 0.023275142535567284, -0.052287373691797256, 0.022432953119277954, -0.07100888341665268, 0.004828132223337889, -0.06628764420747757, 0.01759261265397072, -0.02491823397576809, 0.006356559693813324, 0.03030780330300331, 0.009131362661719322, 0.019858552142977715, -0.02342449501156807, 0.015640364959836006, 0.0286792553961277, 0.04515289515256882, -0.013757387176156044, -0.0209574606269598, -0.06566441804170609, 0.009855548851191998, 0.006444534752517939, 0.010410478338599205, -0.006612586788833141, 0.008034955710172653, -0.0033025150187313557, 0.004841345362365246, 0.017924638465046883, 0.013216874562203884, 0.04140245169401169, 0.005884296260774136, 0.016178308054804802, 0.021533280611038208, -0.008929035626351833, 0.022445641458034515, -0.09107587486505508, -0.06515248119831085, -0.049053583294153214, 0.01912626065313816, 0.012475237250328064, 0.003885567421093583, -0.040939051657915115, 0.02471577376127243, -0.053911998867988586, 0.02834503911435604, 0.00009468127245781943, -0.019845349714159966, 0.07910215854644775, 0.01921144127845764, -0.04314975440502167, 0.006763285491615534, 0.019302377477288246, -0.000408437306759879, -0.03616996482014656, -0.038289278745651245, 0.033400122076272964, -0.03436661139130592, 0.04506443440914154, -0.011255286633968353, 0.006834115833044052, 0.057889774441719055, 0.03051452338695526, 0.006349383387714624, 0.023206224665045738, -0.0434437058866024, 0.0019317257683724165, 0.04767651483416557, -0.024580668658018112, 0.0016096042236313224, -0.052273087203502655, -0.03227798640727997, 0.01470887754112482, 0.03933389484882355, 0.03680849447846413, -0.0018653093138709664, -0.001906591816805303, -0.0637497529387474, -0.07022320479154587, 0.000017208307326654904, 0.0217690858989954, 0.043728653341531754, 0.04563485085964203, 0.004334517754614353, 0.0257334616035223, -0.04676756262779236, 0.012805953621864319, 0.05515715852379799, -0.09541316330432892, 0.06817520409822464, 0.04344270005822182, 0.009554803371429443, 0.0540267750620842, -0.03672761842608452, -0.03553570434451103, -0.021249713376164436, 0.015251136384904385, 0.04575205221772194, -0.004489921033382416, 0.013599375262856483, 0.01306186243891716, 0.02884097769856453, -0.021825842559337616, 0.008185440674424171, -0.007146707735955715, -0.04052412137389183, 0.0024991780519485474, -0.02453235536813736, 0.029948631301522255, -0.001155983074568212, -0.03518810123205185, 0.026608610525727272, -0.035620663315057755, 0.018770700320601463, -0.02214149758219719, -0.009497854858636856, 0.03304402157664299, 0.019022690132260323, 0.00910946074873209, -0.023369085043668747, 0.008047654293477535, 0.022228289395570755, 0.07024750113487244, 0.033484283834695816, 0.027716591954231262, -0.005178956780582666, -0.030278367921710014, -0.005654422100633383, 0.021579662337899208, -0.009236977435648441, 0.008124236948788166, -0.021066155284643173, 0.031522881239652634, -0.003361120820045471, -0.010177360847592354, -0.04729331657290459, -0.0055788238532841206, 0.07494273781776428, -0.017353106290102005, -0.03642578050494194, 0.05450192838907242, -0.04137997701764107, -0.004206456243991852, 0.0111097926273942, 0.015677157789468765, -0.039080340415239334, 0.004816724918782711, 0.04922117292881012, 0.008902349509298801, -0.034020837396383286, -0.0034792774822562933, 0.04055524989962578, -0.036305297166109085, -0.01321385893970728, -0.055284690111875534, 0.03520295023918152, 0.00732223829254508, 0.02453339658677578, -0.0028269835747778416, 0.007014009170234203, -0.015492013655602932, 0.008417041040956974, -0.0651920884847641, -0.04750361666083336, 0.04718935862183571, -0.07997686415910721, -0.03057738207280636, 0.05163596570491791, -0.06331221759319305, -0.012727194465696812, 0.004421369172632694, -0.043611813336610794, 0.0029268569778651, 0.014524930156767368, 0.06252854317426682, 0.019240301102399826, 0.03174722567200661, 0.0383475087583065, -0.05888988450169563, 0.04284960776567459, 0.06556965410709381, -0.02119133621454239, 0.024503782391548157, -0.042842041701078415, 0.05547848343849182, 0.03995684161782265, -0.023292919620871544, -0.009279760532081127, -0.031671684235334396, 0.00803401879966259, -0.03854541480541229, -0.009433341212570667, 0.04007452726364136, 0.01624102145433426, -0.05952412635087967, 0.04650241881608963, 0.013572332449257374, -0.047027572989463806, -0.02242290787398815, 0.030233697965741158, -0.03520090505480766, 0.00012065101327607408, 0.013914109207689762, 0.014698079787194729, -0.02249407395720482, 0.06975100189447403, 0.012951638549566269, 0.04150733724236488, 0.07924998551607132, -0.016291707754135132, 0.07991147041320801, 0.008933673612773418, 0.047495484352111816, 0.01912396028637886, -0.010063949972391129, -0.006378419231623411, 0.08488979190587997, -0.050584908574819565, -0.0696243941783905, 0.02816242165863514, 0.03005550615489483, 0.017592309042811394, 0.018084226176142693, 0.019504180178046227, 0.06754380464553833, 0.015620260499417782, 0.06702294945716858, 0.00800420343875885, 0.012275644578039646, 0.021531451493501663, 0.02103615552186966, 0.06465599685907364, -0.009056457318365574, -0.0020991945639252663, 0.032960038632154465, -0.007310445420444012, -0.054675761610269547, 0.056809209287166595, -0.014427496120333672, 0.018086668103933334, 0.007497126702219248, -0.02756536193192005, 0.02142367698252201, -0.024898555129766464, -0.006404009182006121, 0.10324191302061081, 0.028780730441212654, 0.03985438495874405, -0.0017129771877080202, 0.024107346311211586, 0.01740122213959694, 0.006271566264331341, -0.014387077651917934, 0.03440386429429054, 0.0367068313062191, -0.042661216109991074, -0.014878270216286182, 0.010002238675951958, 0.005449723452329636, 0.055631328374147415, -0.022354383021593094, 0.026488833129405975, 0.007692779414355755, 0.009697703644633293, 0.015751080587506294, -0.015592867508530617, -0.0359615832567215, -0.015450679697096348, -0.03374866396188736, -0.001759030157700181, 0.045442063361406326, -0.029125435277819633, -0.06662949174642563, 0.02854432724416256, -0.04864532873034477, -0.004215695895254612, -0.019469596445560455, -0.04202837124466896, -0.03130163997411728, 0.02765517495572567, 0.015194923616945744, 0.012620671652257442, 0.03623536601662636, 0.11264750361442566, 0.04477710276842117, -0.04424332082271576, -0.02352524921298027, -0.012252848595380783, 0.06469706445932388, -0.009053676389157772, 0.018812453374266624, -0.09092964977025986, 0.03052455000579357, 0.019088642671704292, -0.0012666888069361448, -0.06671949476003647, 0.014752276241779327, -0.03744175285100937, -0.06011916324496269, 0.04224511981010437, 0.008441719226539135, 0.014857979491353035, -0.04964973032474518, -0.028788188472390175, 0.01022682711482048, -0.00707845576107502, 0.042321886867284775, -0.05140501260757446, -0.0017162723233923316, 0.024978015571832657, 0.029327169060707092, -0.019625701010227203, 0.013695880770683289, 0.0326518677175045, 0.0014089184114709496, -0.02767510712146759, -0.02523576095700264, -0.01156108733266592, -0.1246517077088356, 0.01692521944642067, -0.03533942252397537, -0.0297856368124485, -0.06949944794178009, 0.003978495020419359, 0.01590747758746147, 0.009262192994356155, -0.007776190992444754, 0.020151345059275627, -0.03150740638375282, -0.022573916241526604, -0.05958309397101402, -0.043380122631788254, 0.05162482336163521, 0.007259704638272524, 0.013153072446584702, -0.005518718622624874, -0.049566373229026794, 0.00914575345814228, 0.0013654596405103803, -0.005049814935773611, 0.023896558210253716, 0.024396684020757675, 0.030541010200977325 ]
Generated in

Run time and cost

This model costs approximately $0.00047 to run on Replicate, or 2127 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 3 seconds.

Readme

Modified to run on Replicate using Huggingface Sentence Transformers

gte-base

General Text Embeddings (GTE) model. Towards General Text Embeddings with Multi-stage Contrastive Learning

The GTE models are trained by Alibaba DAMO Academy. They are mainly based on the BERT framework and currently offer three different sizes of models, including GTE-large, GTE-base, and GTE-small. The GTE models are trained on a large-scale corpus of relevance text pairs, covering a wide range of domains and scenarios. This enables the GTE models to be applied to various downstream tasks of text embeddings, including information retrieval, semantic textual similarity, text reranking, etc.

Metrics

We compared the performance of the GTE models with other popular text embedding models on the MTEB benchmark. For more detailed comparison results, please refer to the MTEB leaderboard.

Model Name Model Size (GB) Dimension Sequence Length Average (56) Clustering (11) Pair Classification (3) Reranking (4) Retrieval (15) STS (10) Summarization (1) Classification (12)
gte-large 0.67 1024 512 63.13 46.84 85.00 59.13 52.22 83.35 31.66 73.33
gte-base 0.22 768 512 62.39 46.2 84.57 58.61 51.14 82.3 31.17 73.01
e5-large-v2 1.34 1024 512 62.25 44.49 86.03 56.61 50.56 82.05 30.19 75.24
e5-base-v2 0.44 768 512 61.5 43.80 85.73 55.91 50.29 81.05 30.28 73.84
gte-small 0.07 384 512 61.36 44.89 83.54 57.7 49.46 82.07 30.42 72.31
text-embedding-ada-002 - 1536 8192 60.99 45.9 84.89 56.32 49.25 80.97 30.8 70.93
e5-small-v2 0.13 384 512 59.93 39.92 84.67 54.32 49.04 80.39 31.16 72.94
sentence-t5-xxl 9.73 768 512 59.51 43.72 85.06 56.42 42.24 82.63 30.08 73.42
all-mpnet-base-v2 0.44 768 514 57.78 43.69 83.04 59.36 43.81 80.28 27.49 65.07
sgpt-bloom-7b1-msmarco 28.27 4096 2048 57.59 38.93 81.9 55.65 48.22 77.74 33.6 66.19
all-MiniLM-L12-v2 0.13 384 512 56.53 41.81 82.41 58.44 42.69 79.8 27.9 63.21
all-MiniLM-L6-v2 0.09 384 512 56.26 42.35 82.37 58.04 41.95 78.9 30.81 63.05
contriever-base-msmarco 0.44 768 512 56.00 41.1 82.54 53.14 41.88 76.51 30.36 66.68
sentence-t5-base 0.22 768 512 55.27 40.21 85.18 53.09 33.63 81.14 31.39 69.81