daanelson / imagebind

A model for text, audio, and image embeddings in one space

  • Public
  • 4M runs
  • T4
  • GitHub
  • License

Input

input
file

file that you want to embed. Needs to be text, vision, or audio.

string
Shift + Return to add a new line

text that you want to embed. Provide a string here instead of a text file to input if you'd like.

string

modality of the input you'd like to embed

Default: "vision"

Output

[ -0.04028015583753586, 0.032599665224552155, 0.0296342670917511, 0.017571788281202316, 0.00795517023652792, 0.04293808341026306, 0.014025846496224403, -0.02359229139983654, 0.033283885568380356, -0.027835514396429062, 0.006876518949866295, 0.0124134486541152, -0.011771892197430134, -0.023389752954244614, -0.01167969685047865, -0.01347434800118208, -0.010429474525153637, -0.05077551305294037, -0.001176220248453319, -0.013752159662544727, -0.03283587470650673, -0.03708244115114212, -0.04361754283308983, 0.03379989042878151, 0.02809605747461319, -0.02005329541862011, 0.0027381943073123693, 0.0038038548082113266, -0.02806323766708374, -0.005984444636851549, -0.031391385942697525, -0.04747753217816353, 0.01952686719596386, 0.008134075440466404, 0.017498262226581573, -0.0036164443008601665, 0.010315966792404652, -0.010467620566487312, -0.018100300803780556, 0.016461042687296867, 0.0399203784763813, -0.001383885508403182, -0.0046182116493582726, 0.04116539657115936, 0.017389090731739998, -0.01176078338176012, -0.05024787783622742, 0.03911944478750229, -0.0008738621836528182, 0.01473975833505392, 0.03561921790242195, 0.02049284428358078, -0.032198380678892136, 0.040552012622356415, -0.013318784534931183, -0.013170539401471615, -0.018883978947997093, -0.025721149519085884, -0.011224588379263878, 0.009453091770410538, 0.017779728397727013, 0.004437698516994715, -0.020311012864112854, -0.03384999930858612, 0.02417631261050701, -0.006664403714239597, -0.0044763460755348206, -0.014096328988671303, -0.018482275307178497, 0.02549733594059944, -0.008820625953376293, -0.02139737270772457, 0.01915522664785385, 0.013621771708130836, 0.004522792529314756, -0.009870706126093864, -0.010452434420585632, -0.013716581277549267, -0.07746613770723343, 0.014745841734111309, -0.019834965467453003, -0.00959629938006401, -0.001149864518083632, -0.002906855894252658, 0.008574643172323704, 0.02197474054992199, -0.002362895058467984, 0.02570456452667713, -0.0012361995177343488, 0.014033591374754906, -0.0037817731499671936, 0.04241098836064339, 0.005802434869110584, 0.059033241122961044, 0.027506422251462936, 0.018205659464001656, 0.0022097048349678516, -0.002379107289016247, 0.030711926519870758, -0.01300267968326807, -0.004164803307503462, -0.024573763832449913, 0.020095612853765488, -0.056040145456790924, 0.020836876705288887, -0.013478175736963749, 0.005800419952720404, 0.056718453764915466, 0.014278390444815159, -0.044388119131326675, 0.011018900200724602, -0.0030788409058004618, -0.010770709253847599, 0.02058562822639942, -0.004275692161172628, 0.013813738711178303, -0.01464232336729765, -0.03765014559030533, -0.049890801310539246, -0.026811687275767326, -0.0130397267639637, -0.01537812128663063, -0.01345921028405428, 0.026058996096253395, 0.05808515101671219, 0.028341101482510567, 0.008782253600656986, 0.07133493572473526, -0.03863663598895073, 0.006010647863149643, -0.005449750926345587, -0.014377295970916748, 0.009833713062107563, 0.026281829923391342, -0.025432275608181953, 0.042960431426763535, -0.04402117431163788, 0.004383898805826902, -0.0006099800230003893, -0.036602187901735306, -0.03932361304759979, 0.0037339399568736553, -0.02712027169764042, -0.017536282539367676, -0.05013032630085945, 0.023727484047412872, -0.01277167722582817, 0.03534435108304024, -0.042864177376031876, 0.03137044608592987, 0.004393592476844788, -0.022827396169304848, -0.009361343458294868, -0.002754600951448083, 0.022280244156718254, 0.004922895692288876, 0.011898200958967209, 0.027343327179551125, 0.04411964491009712, -0.002353318966925144, -0.015991756692528725, 0.005615239031612873, -0.052116554230451584, 0.0032819348853081465, 0.008765415288507938, 0.029293619096279144, -0.0005535516538657248, -0.010851641185581684, -0.007862252183258533, 0.07555017620325089, -0.00041638335096649826, 0.048260536044836044, -0.030635125935077667, 0.027105256915092468, -0.021290816366672516, -0.025472452864050865, 0.03019290417432785, -0.014001743867993355, -0.008886396884918213, -0.006862839218229055, 0.03312528505921364, 0.0007419406319968402, -0.008158261887729168, 0.011160282418131828, -0.038875240832567215, 0.042381301522254944, -0.024865910410881042, -0.009598368778824806, -0.04207133129239082, 0.015625881031155586, 0.02331175096333027, 0.0017026205314323306, 0.03517492860555649, 0.046134110540151596, 0.014983810484409332, -0.018726514652371407, 0.010375936515629292, 0.07376758009195328, -0.04657473415136337, 0.007302071433514357, -0.0036408035084605217, 0.017840251326560974, 0.03043661080300808, -0.06556273251771927, 0.017691820859909058, -0.0031054853461682796, -0.0077308728359639645, 0.011134602129459381, -0.0039596352726221085, 0.010012546554207802, -0.0034938426688313484, -0.02521560527384281, -0.01390094868838787, -0.03945625573396683, -0.005509784910827875, 0.037537455558776855, 0.006217841524630785, -0.008978483267128468, -0.023669084534049034, 0.02921275421977043, -0.08008468896150589, -0.0008728383691050112, -0.037578269839286804, 0.007828276604413986, -0.01631372980773449, 0.024241628125309944, -0.048536449670791626, -0.018314648419618607, -0.011892853304743767, -0.0016181631945073605, 0.012888722121715546, 0.004304761998355389, 0.04646291583776474, 0.032115768641233444, -0.0011479868553578854, -0.056799501180648804, 0.023985596373677254, 0.021369358524680138, -0.0217682383954525, 0.028105834499001503, 0.028267327696084976, -0.02540597692131996, -0.06361310929059982, 0.0143732326105237, -0.018597593531012535, -0.02679520472884178, 0.0031080746557563543, -0.03415149450302124, 0.0011145027820020914, 0.007924934849143028, 0.09018930792808533, 0.016906704753637314, -0.005301286932080984, -0.01934744603931904, -0.002638215199112892, 0.012277873232960701, 0.016359621658921242, -0.009802978485822678, -0.005652700085192919, -0.01313826721161604, 0.00981664564460516, 0.043809328228235245, -0.008893054910004139, -0.01220877654850483, 0.01689104363322258, 0.010084877721965313, -0.037332963198423386, -0.021606741473078728, 0.00935567356646061, -0.016318567097187042, -0.01105528138577938, -0.03343459218740463, -0.0852915570139885, -0.03165862709283829, -0.003869050182402134, 0.00775576289743185, 0.006241999100893736, 0.002607029629871249, 0.03950929269194603, 0.01570923998951912, -0.020242948085069656, -0.0358126237988472, 0.006828037090599537, 0.05330696702003479, -0.0066923401318490505, 0.02724320814013481, -0.033463042229413986, -0.001938166911713779, -0.036534979939460754, 0.0007952195592224598, 0.025586839765310287, -0.01821945048868656, -0.0563499853014946, -0.049202777445316315, -0.014746301807463169, -0.027282871305942535, -0.06580517441034317, 0.07600224018096924, -0.019218992441892624, 0.010548228397965431, 0.012571573257446289, 0.03200003132224083, 0.02563590742647648, -0.004453940317034721, -0.006063330918550491, 0.042248550802469254, 0.0001974492915906012, 0.018883030861616135, -0.0025752754881978035, -0.01574079692363739, -0.012144730426371098, -0.02180618606507778, -0.027814649045467377, -0.027933450415730476, 0.05206790938973427, -0.034112442284822464, 0.02135346084833145, -0.0008702747290953994, -0.013397184200584888, 0.010663223452866077, -0.0316285565495491, -0.033688463270664215, 0.028556467965245247, -0.00589671591296792, 0.018784379586577415, 0.05047730356454849, -0.020677732303738594, 0.003567382460460067, 0.005886996630579233, 0.010832018218934536, -0.008225424215197563, 0.00010527102858759463, -0.06146399304270744, -0.04315020889043808, -0.02038925141096115, 0.011571206152439117, -0.011274541728198528, -0.014458048157393932, 0.027969418093562126, -0.0234534852206707, 0.005708645097911358, -0.04572530463337898, -0.003600992728024721, 0.0030696161556988955, 0.0067334966734051704, -0.0066757467575371265, -0.08889859914779663, -0.010974551551043987, -0.01736014150083065, -0.030325382947921753, 0.018322346732020378, 0.0073370919562876225, -0.03542076423764229, 0.022669922560453415, 0.0047719962894916534, -0.00871373899281025, -0.03546614944934845, -0.03329453244805336, 0.014369402080774307, 0.009142727591097355, -0.011291162110865116, 0.005507196765393019, 0.011487492360174656, -0.04420795664191246, 0.0063325040973722935, -0.009186419658362865, 0.006947862450033426, -0.03553995117545128, -0.030884480103850365, -0.024155614897608757, 0.00964226946234703, 0.007299615070223808, 0.026308028027415276, -0.010259545408189297, -0.020799247547984123, 0.010760641656816006, -0.04253624752163887, 0.02052357792854309, 0.0009508084040135145, 0.039352674037218094, 0.008070687763392925, 0.02870277874171734, -0.047942642122507095, 0.009166975505650043, -0.009920073673129082, 0.060761649161577225, 0.029407856985926628, 0.07799842953681946, 0.021743498742580414, 0.024824591353535652, 0.007490828633308411, 0.05030933767557144, 0.020942209288477898, -0.0058377888053655624, -0.01743093505501747, -0.016947168856859207, 0.03188252076506615, 0.024917131289839745, 0.020537681877613068, -0.01039586216211319, -0.00433198781684041, 0.02582961693406105, 0.024635525420308113, 0.039197277277708054, -0.002667023567482829, -0.010092729702591896, -0.015474689193069935, 0.020212270319461823, 0.06003265827894211, -0.003534304676577449, 0.0051985327154397964, -0.023236313834786415, -0.017380094155669212, 0.0022368719801306725, 0.00366839743219316, 0.009090784005820751, 0.020286714658141136, 0.024954915046691895, 0.01111274678260088, 0.07918114960193634, -0.024600477889180183, -0.016513872891664505, -0.032009538263082504, -0.02193569578230381, -0.022731425240635872, -0.02496955543756485, -0.0006816159002482891, -0.02808298170566559, -0.02043861337006092, -0.0008714690920896828, 0.000753300148062408, -0.002700784942135215, -0.005821253638714552, 0.026967652142047882, 0.029810162261128426, 0.01705479994416237, 0.06076401472091675, 0.008013422600924969, -0.008200803771615028, 0.015435733832418919, 0.041288118809461594, -0.0006734866183251143, 0.01716643013060093, 0.04778227582573891, -0.0012805486330762506, 0.08069916814565659, -0.016039077192544937, 0.02663419581949711, -0.022416239604353905, 0.04563530161976814, 0.031496863812208176, 0.009548110887408257, 0.009180622175335884, -0.02850530855357647, -0.010859809815883636, -0.010906850919127464, -0.03477904200553894, 0.24726460874080658, 0.04124722257256508, -0.006674451287835836, -0.0011741950875148177, 0.007921239361166954, -0.00020369779667817056, 0.0014795104507356882, -0.02159768156707287, -0.05491563305258751, -0.036979347467422485, -0.015575883910059929, 0.0363454595208168, -0.010905233211815357, -0.028840800747275352, 0.00025893430574797094, -0.011882581748068333, 0.007852490991353989, -0.022300906479358673, -0.1063331812620163, 0.03176672011613846, -0.061886370182037354, -0.03355388343334198, -0.01937714032828808, 0.02101246826350689, -0.012142795138061047, -0.0339110866189003, -0.0004924402455799282, -0.01165376603603363, -0.027960654348134995, -0.02573413774371147, 0.03402068838477135, 0.06864172965288162, -0.021307701244950294, -0.015143291093409061, -0.02718944102525711, 0.021155213937163353, -0.012893454171717167, -0.02585623785853386, -0.01797301135957241, 0.014934207312762737, -0.07232432812452316, -0.003859441028907895, 0.019119050353765488, 0.02872234582901001, -0.039101604372262955, 0.004444731865078211, 0.013611562550067902, 0.03040744736790657, -0.007589485961943865, -0.023699643090367317, -0.06659461557865143, 0.03070729970932007, 0.0682791993021965, -0.11571094393730164, 0.03461508825421333, -0.16926270723342896, -0.018496835604310036, 0.010418274439871311, -0.024507880210876465, 0.047485969960689545, 0.008945446461439133, -0.027527188882231712, 0.044077787548303604, -0.018443822860717773, -0.029783306643366814, 0.05823598429560661, 0.014952662400901318, -0.015400979667901993, -0.030455900356173515, 0.02819388173520565, 0.016749178990721703, 0.01928143948316574, 0.021541234105825424, 0.10375713557004929, -0.04260686784982681, -0.037420786917209625, 0.04537099972367287, 0.013501453213393688, 0.005815405864268541, -0.03446847200393677, 0.04786230996251106, -0.018506040796637535, -0.03363223373889923, -0.004875837825238705, 0.03277827426791191, -0.06820926815271378, 0.005539001431316137, -0.0003282589023001492, 0.04805026203393936, -0.007614829111844301, 0.007452249526977539, 0.04211759567260742, -0.025316888466477394, 0.02075776271522045, -0.02262672409415245, 0.0136414198204875, 0.050666868686676025, 0.006617523264139891, -0.018958231434226036, 0.004981302190572023, 0.03327144682407379, -0.005916956812143326, 0.05594640597701073, 0.04183062165975571, -0.0238008014857769, -0.005709517281502485, -0.021573306992650032, -0.02686016820371151, 0.020111631602048874, -0.016455819830298424, -0.04053569957613945, -0.032595276832580566, -0.017678193747997284, 0.004063919652253389, -0.0021971645765006542, 0.03695845976471901, 0.0076291230507195, -0.016689257696270943, -0.03134554252028465, -0.051425572484731674, -0.02695010043680668, -0.03128339350223541, 0.011868375353515148, 0.01635444536805153, 0.010015132836997509, -0.01450564619153738, 0.052147407084703445, -0.002889151917770505, -0.031168218702077866, 0.011230956763029099, -0.014838693663477898, 0.010558136738836765, 0.007738403044641018, 0.0011640886077657342, 0.013410156592726707, 0.019723795354366302, -0.052081938832998276, 0.003481382504105568, 0.01297264639288187, -0.0011590297799557447, -0.028513018041849136, 0.0011990881757810712, 0.010845929384231567, -0.03211264684796333, 0.06449207663536072, 0.04688078910112381, 0.019846748560667038, 0.013773366808891296, 0.029820041730999947, 0.011390953324735165, 0.010641191154718399, 0.012817349284887314, -0.006682990584522486, 0.03903363645076752, -0.022160718217492104, -0.005803188309073448, 0.03681086748838425, -0.029893113300204277, 0.020101280882954597, 0.0057584261521697044, -0.02718276157975197, -0.048540711402893066, -0.018646078184247017, -0.018889643251895905, -0.021172715350985527, -0.010805473662912846, -0.02619696781039238, 0.08417926728725433, -0.05821336805820465, 0.015362439677119255, 0.008481825701892376, -0.0018466650508344173, 0.022586874663829803, -0.027079548686742783, -0.09527482837438583, 0.032058414071798325, -0.017948295921087265, -0.03840869665145874, -0.010133993811905384, -0.10942524671554565, 0.010133636184036732, 0.0076942890882492065, -0.02444763109087944, -0.0035695398692041636, 0.015742694959044456, 0.013333125971257687, 0.00910908542573452, -0.006742329802364111, -0.009125921875238419, 0.10327387601137161, -0.006033248268067837, -0.06675007194280624, 0.04016812518239021, -0.007988443598151207, 0.02501753531396389, 0.01233087107539177, -0.00909652840346098, -0.013925437815487385, -0.06099701300263405, 0.011640248820185661, 0.033223990350961685, 0.020087644457817078, 0.005625173915177584, -0.009095514193177223, 0.024594487622380257, 0.0035786093212664127, -0.014962618239223957, 0.000605280336458236, -0.039205145090818405, 0.017802299931645393, -0.013813242316246033, -0.001997332088649273, 0.0275406613945961, -0.009711074642837048, -0.06787656992673874, 0.00116409407928586, -0.005096023436635733, 0.008912607096135616, -0.013722669333219528, -0.0546099953353405, -0.027985796332359314, -0.013853700831532478, -0.04689158871769905, -0.013178256340324879, 0.045122742652893066, 0.03599748760461807, -0.016453469172120094, 0.06535782665014267, 0.009809563867747784, 0.009817468002438545, 0.013030254282057285, -0.006761586759239435, -0.038925543427467346, 0.017841553315520287, -0.0029140664264559746, 0.0027042878791689873, -0.01902117393910885, -0.029209153726696968, -0.0071721854619681835, 0.007206430193036795, -0.01809275895357132, -0.021395118907094002, 0.008171794936060905, 0.008326188661158085, -0.10586927086114883, -0.02281411550939083, -0.04541945829987526, 0.014180422760546207, 0.0083238510414958, 0.011804698966443539, -0.06241616979241371, -0.027936970815062523, 0.02078869566321373, 0.04207480326294899, -0.024994201958179474, 0.010084039531648159, 0.05784618854522705, -0.00964380893856287, -0.006770869251340628, -0.04223386198282242, -0.03800966590642929, -0.0008142928127199411, 0.0015217376640066504, 0.01926390826702118, -0.03347351402044296, -0.017085794359445572, -0.02325347438454628, 0.007533987984061241, 0.025927044451236725, -0.0122946472838521, -0.007623154670000076, 0.02433442510664463, 0.03554120659828186, -0.08227667212486267, 0.018570050597190857, -0.11192668229341507, 0.01865510828793049, -0.04314422234892845, 0.03753526136279106, -0.00909256562590599, -0.005198902450501919, -0.011022049933671951, 0.04603572189807892, -0.03379626199603081, -0.0010623759590089321, -0.015828926116228104, -0.009978102520108223, -0.005457780323922634, 0.017271973192691803, -0.027620766311883926, 0.051830850541591644, 0.0009872294031083584, 0.00032733750413171947, -0.028617333620786667, 0.02351253479719162, 0.037201207131147385, -0.05072895437479019, -0.013223284855484962, -0.2255648523569107, -0.014231703244149685, 0.0007009340333752334, -0.025871310383081436, -0.02121776156127453, -0.0005400095833465457, 0.014134746976196766, -0.06234511733055115, 0.0017631305381655693, 0.015311270020902157, -0.01524928119033575, 0.02669600024819374, -0.020398177206516266, -0.013648445717990398, 0.03417738154530525, 0.009611755609512329, 0.0028966772370040417, 0.018005628138780594, 0.01090183388441801, -0.042186036705970764, -0.011462412774562836, -0.0011580438585951924, -0.013835062272846699, 0.016002953052520752, 0.018664438277482986, 0.007343446835875511, 0.027049724012613297, -0.025299567729234695, -0.016489606350660324, 0.029573019593954086, 0.007115758955478668, 0.0398050919175148, 0.0010125919943675399, -0.04990936070680618, -0.0012387201422825456, -0.024402368813753128, 0.005211118143051863, -0.00869703944772482, 0.041534002870321274, 0.017431480810046196, -0.0016935915919020772, -0.0025500564370304346, -0.0024982113391160965, -0.02541460655629635, -0.03222332522273064, -0.015103181824088097, 0.016579976305365562, -0.011897423304617405, 0.016492094844579697, -0.02844930626451969, -0.012179666198790073, 0.018353717401623726, -0.056949157267808914, 0.015927832573652267, -0.04012667387723923, -0.04821215197443962, -0.02923818863928318, -0.004245437681674957, -0.014962698332965374, -0.010980147868394852, 0.016624564304947853, 0.05604421719908714, -0.00743319746106863, 0.0371352955698967, -0.020921938121318817, -0.00862730573862791, 0.03252236545085907, 0.020643116906285286, -0.016952015459537506, 0.011518988758325577, -0.006903615780174732, 0.00912841409444809, -0.012609737925231457, -0.011977612040936947, -0.0029011014848947525, 0.02936219610273838, -0.020917516201734543, 0.00400525564327836, -0.012839222326874733, -0.005668838508427143, 0.0224903617054224, -0.014164302498102188, 0.030489234253764153, -0.01449495181441307, 0.002658566227182746, -0.023439770564436913, 0.019461721181869507, -0.06479187309741974, -0.001489358372054994, 0.017105037346482277, -0.03825776278972626, 0.06600945442914963, 0.007147250231355429, -0.018809743225574493, -0.03619024157524109, 0.026661600917577744, 0.017437370494008064, 0.008696895092725754, -0.058579012751579285, 0.037125471979379654, -0.005663199350237846, -0.008243623189628124, 0.040682077407836914, 0.0013482716167345643, 0.02431015484035015, 0.0074097090400755405, -0.035366304218769073, -0.004541077651083469, -0.0067252363078296185, -0.014792078174650669, -0.00657016271725297, -0.03274618834257126, 0.0015046828193590045, 0.022152602672576904, -0.0022306914906948805, -0.004438458941876888, -0.01220602635294199, -0.005432398524135351, 0.026931365951895714, -0.0014362664660438895, -0.008221530355513096, 0.011404064483940601, -0.04867443069815636, 0.002445434918627143, 0.013745362870395184, 0.005055041518062353, 0.003593310248106718, -0.017359353601932526, 0.01698862761259079, 0.0047210450284183025, -0.03135013207793236, 0.0216557327657938, -0.002356887562200427, 0.02452544867992401, -0.026364019140601158, -0.05398441478610039, -0.007715487852692604, 0.01862022466957569, 0.05207565426826477, -0.028445202857255936, 0.03054211288690567, 0.004190686158835888, 0.00867073331028223, 0.011306132189929485, -0.0067701260559260845, -0.012186366133391857, -0.0030510141514241695, -0.033418282866477966, 0.0472915843129158, 0.018695848062634468, -0.010894975624978542, -0.007885185070335865, -0.006394877564162016, 0.01409074105322361, 0.013479542918503284, 0.022688349708914757, 0.047382913529872894, 0.019027352333068848, -0.017017921432852745, 0.004772494547069073, -0.02414463460445404, -0.04163032025098801, 0.012499246746301651, 0.012640392407774925, 0.008615818805992603, -0.027770286425948143, 0.009882749058306217, 0.03745035082101822, 0.05289562791585922, 0.01799182966351509, 0.00345617881976068, -0.028712771832942963, -0.013474535197019577, -0.0066917878575623035, 0.0033249284606426954, 0.051417842507362366, 0.011955964379012585, -0.023464687168598175, 0.022575078532099724, 0.03248758241534233, 0.017754144966602325, 0.012708185240626335, -0.015556412748992443, 0.01617472432553768, 0.028023360297083855, -0.0014409018913283944, 0.025586917996406555, 0.012393591925501823, 0.03954237699508667, 0.034910425543785095, 0.007574799936264753, -0.0005651030805893242, 0.021884333342313766, -0.023671001195907593, 0.012534527108073235, 0.006740310695022345, 0.037778813391923904, -0.07436459511518478, -0.0024427284952253103, -0.0049353353679180145, -0.016864053905010223, -0.012282752431929111, -0.05179271101951599, -0.0033758499193936586, -0.020770510658621788, -0.11123020201921463, -0.012269330210983753, 0.004613712430000305, 0.017469968646764755, -0.046776384115219116, 0.004397785756736994, 0.014558028429746628, -0.02412313036620617, -0.03855866566300392, 0.01134476251900196, 0.025587406009435654, 0.01145275216549635, 0.005349844694137573, -0.0056937686167657375, 0.017809078097343445, 0.03562097251415253, 0.003135800827294588, 0.06773526966571808, 0.004231243394315243, -0.024761030450463295, 0.040662024170160294, -0.020838497206568718, 0.007569104433059692, -0.0002464893914293498, -0.00399715406820178, -0.018503684550523758, -0.021949060261249542, 0.014086853712797165, -0.01931312121450901, -0.016366329044103622, 0.005042468197643757, 0.011377147398889065, 0.017270950600504875, 0.0018680873326957226, 0.03305673971772194, 0.0034409440122544765, -0.009939197450876236, -0.009704502299427986, 0.02127099595963955, -0.031904976814985275, 0.03726677596569061, -0.0663398802280426, -0.032072365283966064, -0.009030401706695557, -0.0037604605313390493, 0.03843487426638603, -0.014926159754395485, 0.009430116042494774, 0.0018297957722097635, 0.00029809740954078734, 0.005235306918621063, -0.0231934767216444, -0.06331316381692886, -0.04215859994292259, -0.009284126572310925, -0.02966875396668911, 0.03321655094623566, 0.012876471504569054, 0.018270066007971764, 0.027808796614408493, -0.035789210349321365, -0.0189120564609766, -0.024173999205231667, -0.013976272195577621 ]
Generated in

This example was created by a different version, daanelson/imagebind:5f043aa8.

Run time and cost

This model costs approximately $0.00022 to run on Replicate, or 4545 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 1 seconds.

Readme

Note: This model is licensed under a non-commercial license, and so should only be used for research and experimentation purposes.

Model description

ImageBind is a model from MetaAI that learns a joint embedding across six different modalities - images, text, audio, depth, thermal, and IMU data. It enables novel emergent applications ‘out-of-the-box’ including cross-modal retrieval, composing modalities with arithmetic, cross-modal detection and generation.

This implementation has image, text, and audio modalities.

Citation

@inproceedings{girdhar2023imagebind,
  title={ImageBind: One Embedding Space To Bind Them All},
  author={Girdhar, Rohit and El-Nouby, Alaaeldin and Liu, Zhuang
and Singh, Mannat and Alwala, Kalyan Vasudev and Joulin, Armand and Misra, Ishan},
  booktitle={CVPR},
  year={2023}
}