jweek / mask_maker

Uses DINO to detect regions and further refines them with SAM. Returns masking data as RLE encoded JSON.

  • Public
  • 259 runs
  • T4

Input

image
*file

Input image file path or URL

string
Shift + Return to add a new line

Comma-separated names of the objects to be detected

number
(minimum: 0, maximum: 1)

Confidence level for object detection

Default: 0.2

string
Shift + Return to add a new line

Single-line DSL defining composite masks (overrides default one-per-term). Infix operators (left-to-right): `&` → AND, `|` or `+` → OR, `A - B` → A AND NOT(B), `-term` → NOT(term), `XOR`. Example: 'rider: man + horse; dog: dog'

Default: ""

string
Shift + Return to add a new line

RLE encoding format for masks. 'coco_rle' (default) or 'custom_rle'

Default: "coco_rle"

Output

{ "meta": { "threshold": 0.2, "dino_model": "GroundingDINO", "request_id": "8ca1fe24-d2ea-4998-8277-50048652993f", "term_count": 3, "image_width": 533, "mask_prompt": "dog, horse, man", "image_height": 799, "request_date": "2024-11-20 09:41:30", "mask_encoding": "Custom RLE", "detection_count": 6, "processing_time": "3.1700 seconds", "mask_maker_version": "1.2.0", "sam_processing_time": "1.1862 seconds", "dino_processing_time": "1.9811 seconds" }, "terms": [ { "term": "dog", "mask_rle": { "size": [ 799, 533 ], "counts": "FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFCFB0102010161FD01A1F901C1F701E0030031EF0200020061EC02B1E902D1E702E1E60301E40311E20341E003603600A00200719503703401719203803201B18F03903001E18E03902F02118B03A02E02318A03A02D02418903B02C02618803B02B02818603B02C02818603A02C02A18503400200302C02C18303500200302B02D18303600100202C02E18203902C02F18103801700700F03018003901301400503018103801201700303118003900F01B00203018103800E04E18103900B05118103800A05318003900802300103018003A00602400103117F03A00502500203117E03B00302600203117E03A00302800103217D02A00500A00402800103217D02900A00300502A00103317C02901002C00103317C02900F02D00103417B02900D02F00103417A02900C06617A02900B06817802A00A03400203317802A00A03500103317702B00903600203317602B00903700103317502C00803800102300200E17402D00805C00300C17502D00705D00500A17402D00805D00800517502E00803A00102218202E00703B00102318002F00703B00102317F03000606017E03100605F17F03000606017E03100606017D03200606017D03200606017C03300603C00102317B03400703B00102217B03500803A00102217B03500903900102217A03600903900102217903700A03800102217703800C03700102317503900D03600102317403A00D03600102417203B00E03500102516F03C01003400102616C03E01005B16904101003300102816504401003300102816404501003100202A16104601102F00302C15E04801102A00702D15B04B01102A00602F15704E01002B00503015505001002A00503115305201002A00503215005301002B00503214E05501002B00403414B05700F02C00403514805900F02C00303714505A00F02D00303814205C00F02D00303913E05F00E02E00203B13A06200E02D00303C13606500E02D00303D13206800D02E00303E12D06C00C02F00303F12A06E00B03000204112607100B03000204112407300A03000304212107500903100304411D07700803200304511A07900703300304611907900603400304711807900503500204911707900403600204B11507900303700204C11407900303600304D11307900203700204F11207800203800204F11207700203900205011107600203A00205111007500203B00205210F07400203C00205310E07200203E00205505A00C0A607100104000205605201C09D07000104100205704A02D09306E00204200205804403509006D00204300205903E03C08E06D00104400205A03B03F08D06C00104600105C03704108D06B00104700105D03204408E06A00104800105E02F04508F06800204900105F02B04808F06600204B00106102704809106500204C00106202404909206400104E00106302104909406200105000106501D02E0B106000105200106601B0280B805D0030BB0180250BD05B0030BE0160230C005A0020580010680140210C305900105A00106901201F0C605700105C00106A01001E0C805600105D00106C00D01D0CA05400205E00106D00A01D0CC05200206100106D00801C0CE05100206200106E00601B0D005000206300107000301A0D204F00106500107000201A0D304D00206600108A0D504C0010690010870D704B00106A0010860D804900206B0010840DA04800206C0010830DB04700206D0010820DC04600206E0010810DD04500107000207F0DE04400107200107E0DF04200207300107D0E004100207400107C0E104100107500207A0E20B800107B0E10B800207A0E103D00107A00207A0E103C00107C00107B0E003B00107D00207B0DF03A00107F00107C0DE0390010FD0DE0380010FF0DD0370011010DC0350021030DB0340021040DB0340011060DA0320011090D903100110A0D903000110C0D802E00210E0D702C00310F0D702B0030950030790D602A00309500407A0D50290030950060790D900700200B00600900409500707A0F300600509200C0790EA00200400900409300D0790D800100601800409400D0790D600500201A00309500E0790D600300401700409700E0790DE00C00300500409800E07A0EE00300309A00E0790F409A00F0790F209A01007A0F009B0110790EF09C0120790ED09E01107A0EC09E0120790EB09F0130790EA09E01407A0D400101309E0160790D400201109F0170790D300201109F0180780D30020080010070A10180780DB0020070A101A0760E30A101E0740E208400301A02506D0E108500501702906B0DF08500601802A0690DE08600701802A0680DE08500801802C0660DD08600801802E0640DD0860080160010010300630DB0860090160010010310620DB08600A0150010010330600DA08600B01503605F0DA08600B01503705E0D908600C01503805E0D808500D01503805E0D708500E01503905D0D708400F01503905D0D608301101503905D0D608201201503905E0D408201301503905E0D408101401503905E0D308101501503905E0D308101601403905F0D208001701403905F0D108001801403905F0D107F01A01203A05F0D008001A01203A05F0CF08001B01203A05F0CF07F01D01103A05F0CE08001D01103A05F0CD08101D01103B05E0CD07C00200301D01103B05E0CC08201E01003B05E0CB08301E01003B05E0CB08301E01003B05E0CB08401D01003B05E0CA08601D00F03B05E0CA07000601001D00F03C05C0CB06E00801001D00F03C05C0CA06C00B01001D01003B05C0CA06A00E00F01D01003C05B0CA06900F00F01D01003C05B0C906901000F01D01003D05A0C906801100600200701D01003D05A0C906701100600200801D01003D0590C906400200101200700100801C01103D0590C906301601001C01103D0590C906401501001C01203D0580C806501501001B01303D0570C906501501001B01403C0570C906501501001B01403C0570C906501600F01B01403C0560CA06601500F01B01503B0560C906701500F01A01603B0560C906701401001A01603B0560C906701400900200501801903B0540CA06701400800300501501C03B0540CA06701500700200601301E03B0540CA06701500500400701102003B0530C906801600400300801002103B0520CA06801601000F02103B0520CA06901501400A02303B0510CA0690150150090250390500CB06901500A00100A00902803602F00301E0CB06901500800400900802D03302D00401E0CC06801500400900800802E03202C00601D0CC06801500400800900802F03102A00801D0CC06801600300700A00803003002900901C0CD06801600200800B00703003102800901C0CD06801600300600B00801200201C03102700B01B0CD06801500400600B00900E00601B03102600C01B0CD06801500500100F00900600E01C03002500D01B0CE06801400500300B00D00201101B03002500E01A0CE06801500300600502501A03102300F01A0CE06804901903102300F0190CF06804A01803102300F0190CF06804C0160310220110180CF06804D0150310220110180CF06804E0140310220110180CF06804F0120330210120170CF0680500110330210120170CF06805100F0340210120170CF06805600203C0200130170CF0680940200130160D006809501F0130160D006809501F0130160D006809501F0140150D006809501F0140150D006809601E0140150D006809601E0140150D006809601E0140150D006809701D0150140CF06909701D0150140CF02000304609701D0150140CF02000504409701D0150140CF02000B03E09801C0150130D002000F03909901C0150130D001F01103809A01C0140130D001F01303609A01C0140130D001E01603409B01B0140130D001D01803309C01A0150120D001D01903209C01A0150120D001C01C03009D0190150120CF01D01D02F09E0180150120CF01C01F02F09D0180150120CF01C02002E09E0170160110CF01B02202D09F0160160110CF01B02302C0A00160150110CF01B02302C0A00160150110CF01A02402C0A10150150110CF01A02402C0A20140150100D001902502C0A30140140100D001902602B0A40130140100D001902602B0A501201500F0D001802702B0A601101500F0D001802702B0A701101400F0D001702802B0A701101400F0D001702802A0A901001400F0D001602902A0AA01001300F0D001602902A0AB00F01400E0D001502B0290AC00F01300E0D001502B0290AC00F01300E0D001502C0280AD00F01200E0D001402E0270AD00F01200E0D001402E0270AE00E01200E0D00130300260AE00F01100E0D001303100500101F0AF00E01200E0CF01303801D0B000F01100E0CF01203A01C0B000F01100E0CF01203A01C0B100F01000E0CF01203A01C0B100F01000E0CF01103B01B0B201000F00E0CF01103C01A0B300F00F00E0CF01003D01A0B301000E00F0CE00F03E0190B401100D00F0CD01003E0190B501100C00F0CD01003E0190B501100C00F0CD01003E0190B601100B00F0CD00F03F0180B701100B0100CD00E03F0180B701200A0100CD00D0400170B90120090100CD00D0400170B90120090100CB" }, "single_flg": false }, { "term": "horse", "mask_rle": { "size": [ 799, 533 ], "counts": "FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF3FB00221100420F00620D00820A00A20900C20700E20500F2040112010141FE0161FD0181FC0191FB0191E900700B01A1E301100401C1E10341DE0361DC0391D803D1D503F1D50401D30421D102D0010161CF02F0010161CD0310010171CA04D1C704F1C40511C203900101A1C00390050181BD03A00401A1BC03A00401B1BB03A00501C1B903C00301D1B805E1B605F1B50601B30621B20641B00651AF0661AE0671AE0681AC0691AB06A1AA06B1A806D1A706F1A606F1A40711A40711A30731A10751A007619E07719D07919C07919B07B19907C19907D19706200201B19506300201B19406500101B19308319108419008618E08718D08818C08A18A08B18908C18808D18808E18607400201918507500201918407600301718407700301618407900201718207A00301A17D07B00401917C07C00401917B07700100500501817A07700300500501617A07800300500501717707A00300500501817507B00400500401917307D00200600401A17205E00101E00200600301C17005E00202500401C16F05F00202400501C16F05F00202300601D16F05C00402100801D17005B00502000701E17005B00602000502017105A00602000402017305800701F00302117500300105100901E00302119C02D00D01B0020231AC01B01003E1AD00C00100C01203D1BC00901403C1BD00701803A19F00100A01901A00600103116901900200400A00100B00300801A02103116805B02203016705C02203016605D02203016505E02203016405F0210310CE01108505F0200330CA0180800600200330C70220780610200330C50280730620200320C502B0700620220310C302D0700620220310C103006E0620240300C003206C0630240310BD03406B06402502F0BD03606906502702D0BC03706806602902B0BB03806806502B02A0BA03A06606602C0290B903B06506702C0280B903C06406702E0270B703F06106902E0270B604006006902F0260B604205F0690300240B604405E0690300230B604505E0690300220B604805C0690300210B604C05806903201F0B604F05606903301D0B605405106A0370190B505A04D06803A0160B505C04C06803D0120B505F04A06804200C0B506504506704400A0B50680430670460060B606A04206710106A04306710106A04306610106A04406610106A04406510106A04406610106A04406510106A04506510106A04506510006B04506410106B04506410006B04606410006B0460640FF06C04606310006C04606310006C04606210006D04606210006D04606210006D04506210006E04506210006E04506210006D04606110106D04606110006E04606010106D04706010106D04606110106E04506010206F04406010207004206110107104106210107203F06210207203E06310207303D06310207303D06310207403B06410207403A06410307503806510307603606610307603606610207803406710207903206810207A03006910107C02E06A10107D02D06A10007F02B06B10007F02A06C0FF08002906E0FE08002806F0FE08002806F0FD0810270700FD0810270700FD0810260720FB0820260720FB0820260720FA0830260720FA0830270710F90840270720F80840270720F80840280710F70850290700F70850290700F60860290700F608502A0700F508602A0700F508602B06F0F508602C06E0F508702B06E0F408802C06D0F408802D06C0F308902F06A0F308902F06A0F20150020740320650F30150020740320650F30150020750310650F20150030750310650F20150030750310650F10160030750310640F20160040740310640F10170040740310630F20170040740310630F20170040270050480300640F10180050260060470300630F20180050260070460300630F201800602400804602F0630F301700702400904502F0620F301800702300B04402F0620F301800802100D0430300610F201900802100D0430300600F301900901F00E0430300600F301800A01F00E04303005F0F301900B01E00F04203005E0F401900C01D00F04203005D0F501800D01D00F04203005D0F501800D01C01004203105B0F501800E01C00F04303105A0F601800E01C00F02300401C0310590F701800E01B0100220080190320570F801700F01B01002100B0180320540F901800F01A01002200C01C02D0530FA01800F01A01002100F01F0290520FA01800F01901002101201F0270520FA01701101801002001401F0280500FA0170110170100210160200250500FA01701101701002101A01E02404F0F901801001800F02101C02102004F0F901701101800E02102002100400301704E0F901701101800D02102702301604F0F701701201700E02002B02001704E0F701601401600D02002F01D01804D0F701501501600C02003701601904C0F701501501600B02103A00D00100401B04B0F601601501500A02206904A0F601601401600902306904A0F501601501600802206C04A0F401601601500702206D04A0F401501701400702206F0490F30160170140060220700490F30160170140060210710490F30150180140050210730480F20160180140040200750490F101501901300501F0760490F101501901300501F0770480F001501A01300501E0780480F001401A01400501E0780480F001401A01400501D0790480F001401A01300601C07A0480EF01401B01300701A07B0490EE01401B01300701A07B0490EE01401B01300701907C0490EE01401B01300801707D0240010240EE01401B01300801707D0240030220EE01401A01400801607E0240040210EE01401A01400901507E0240040210EE01401A0140090140800220060200EE01301B01400901408002200701F0EF01201B01400901408002200801E0EF01201B01400901408002100901E0F001001B01500A01208102100901F0F000F01C01400A01208102100A01E0F300C01C01400A01208102100A01E0F900501D01400B01108102000C01D11B01400B01108102000D01C11B01400C01008201F00D01D11B01300C01008201F00E01C11B01300C01008201F00E01C11B01300D00F08201E01001C11A01300D00F08201E01101B11A01300D00F08301D01101B11A01300E00E08301D01201A11B01200E00F08201D01301A11A01100F00F08201C01501911A01101000E08201C01701711A01101000E08201C01801711901101000E08201C01901611901101000E08201C01901611901001100E08201C01901711801001200E08201A01A01711801001200E08201A01B01611801001200E08201A01D01411900F01300D08201A01E01311900E01400D08201A01E01411800E01400E08101901F01411900D01400E08201801F01411900D01500D08201801F01411900D01500E08101801F01411900D01500E08101801F01411900D01500E08101802001411800D01500F08001802001411900C01500F08001802001411900C01500F08001802001411900C01501007F01802001411900C01600F07F01802101311900C01601007E01802101311900C01601007E01802101311A00B01601007E01802101311A00B01601107D01802101311A00B01601107E01702101311A00B01701007E01702101311A00B01701007E01702101311A00B01701107D01702101311A00B01701107D01702101311A00B01701207C01702101311A00B01701207C01702101211B00B01701207C01702101211C00A01701207C01702101211C00B01601207C01702101111D00B01601207C01702101111D00B01701107C01602201111D00B01701107D01502201111D00B01601207D01502201011E00B01601207D01502201011E00B01601107E01502101111E00B01601207D01402201111E00C01501207E01302201111E00C01501207E01302201111E00C01501207E01202301111E00C01501207E01202301111E00C01501207E01202301011F00D01401307D01102301111F00D01401307D01102301111F00D01401307D01002401111F00D01401307C01102301212000C01301407C01102301212900301301507B01102301213F01507B01102301214001407B01002301314001407B01002301314101207C01002301214201107D01002201314300E07F01002201314300D07F01002301314400D07E01002201414800907E01002201414800907E01002101514800907E01002101514800907E01002001614800807E01002001714A00507F01002001714C0020800100200171CE01001F0181CE01001F0181CE01001F0181CD01101F0181CD01101F0181CD01101F0181CD01101F0171CD01201F0171CD01201E0181CD01301D0181CD01301D0181CD01301D0181CC01401D0181CC01401D0181CC01501C0181CC01501C0181CC01501D0171CC01501D0171CC01501D0181CB01501D0181CB01501E0171CB01501E0171CB01501E0181CA01601D0181CA01601D0181CA01701C0181CA01701C0181CA01801B0181CA01901A0181CA01A01A0171CA01B0190171CA01B01A0161CA01C0190161CA01D0190151CB01D0190151CA01E0180151CB01E0180141CB01E0180141CC01D0190131CD01C0190131CE01B01A0121CF01A01B0101D001A01E0091D401A0230021D701A1FC0191FD01820001520101420201320301220301220301220501020900B20E006FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF05D" }, "single_flg": false }, { "term": "man", "mask_rle": { "size": [ 799, 533 ], "counts": "FFFFFFFFFFFFFFFFFFFFFFFFFFFB1200620D00C20800F2050122010161FE0181FC01A1FA01C1F801E1F601F1F50211F40211F40221F20231F20241F10241F10241F10251EF0261EF0261EF0271ED0281ED0291EC0291EC02A1EB02B1EA02C1E902E1E602F1E602E1E702B1EA02A1EB02A1EB02A1EB02A1EB02A1EC0291EC0291EC0281ED0281ED0281ED0271EE0271EE0271EE0261EF0261EF0261EF0261EE0261EF0261EE0261EE0261EE0271ED0271ED0271ED0241EF0251EF0271ED0281EC0291EB02A1EA02C1E802D1E802D1E702F1E50301E50301E40311E30321E30321E20341E00361DF0371DD0391DC0391DB03B1DA03B1DA03C1D803D1D803D1D803D1D703F1D603F1D603F1D60401D50401D40411D40421D30421D30421D30421D30421D30421D30421D40421D30421D30421D40411D40411D40411D503F1D603F1D603F1D603F1D603F1D603F1D603E1D703E1D703E1D703E1D703E1D703E1D703E1D703D1D703E1D703E1D703E1D703F1D50401D40421D30431D10451D00451D00461CE0471CE0481CD0491CB04B1CA04B1CA04C1C804E1C704F1C60511C30541C10551BF0581BD05C1B905E1B60611B40621B30631B10661AF0671AD0691AC0691AB06B1AA06A1AB0661AE04C0070101B204A00E0051B80490110011BA0481CD0471CD0481CD0481CD0471CE0471CE0471CE0461CE0471CE0471CE0471CD0471CE0471CE0471CC0491CA04B1C804D1C804C1C904C1C904B1CA04B1CB0491CC0491CD01D0040261CE01B0070251CF01800A0241CF01600D0231D00130110221D00110130211D300C0150211D60060190201F701E1F801D1F901C1FB01A1FC0191FC0191FD0181FD0181FD0181FC0181FD0181FC0191FC0181FC0191FB0191FC0191FC0181FC0181FD0181FD0171FE0171FD0181FD0181FD0181FD0181FC0191FC0181FD0181FD0181FC0191FC0191FC0191FB0191FC0191FC0191FC0191FC0191FC0191FC0191FC0191FB01A1FB0191FC0191FC0191FC0191FC0191FC0191FB01A1FB01A1FB01A1FB01B1FA01B1FA01B1FA01A1FB01A1FB01A1FB01A1FA01B1FA01B1FA01B1FA01C1F901C1F901C1F901C1F901C1F901B1FA01B1FA01B1FA01B1FA01B1FA01B1FA01B1FA01B1FA01B1FA01B1FA01B1FA01B1FB01A1FB01A1FC0191FC0191FC0191FC0191FC01A1FB01A1FB01A1FB01A1FB01B1FB01B1FA01B1F901D1F801D1F801E1F701F1F60201F50291EC0251F00251F00251F00271EE0281ED0281ED0281EE0271F10231F801C1FC01420200E20C008FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF8EA" }, "single_flg": false } ], "detections": [ { "label": "horse", "pixel": [ 64, 120, 477, 541 ], "ratio": [ 0.1200750469043152, 0.15018773466833543, 0.8949343339587242, 0.6770963704630788 ], "confidence": 0.5205022692680359, "main_score": 0.568342962942068 }, { "label": "man", "pixel": [ 184, 72, 305, 364 ], "ratio": [ 0.3452157598499062, 0.09011264080100125, 0.5722326454033771, 0.4555694618272841 ], "confidence": 0.434657484292984, "main_score": 0.40414731635598644 }, { "label": "dog", "pixel": [ 2, 465, 395, 795 ], "ratio": [ 0.00375234521575985, 0.5819774718397998, 0.7410881801125704, 0.9949937421777222 ], "confidence": 0.32266682386398315, "main_score": 0.40265017446801216 }, { "label": "dog", "pixel": [ 1, 489, 208, 796 ], "ratio": [ 0.001876172607879925, 0.6120150187734669, 0.3902439024390244, 0.9962453066332916 ], "confidence": 0.26765650510787964, "main_score": 0.31778072563656146 }, { "label": "dog", "pixel": [ 173, 474, 395, 797 ], "ratio": [ 0.324577861163227, 0.5932415519399249, 0.7410881801125704, 0.9974968710888611 ], "confidence": 0.23859180510044098, "main_score": 0.3205309892276873 }, { "label": "dog", "pixel": [ 0, 464, 148, 661 ], "ratio": [ 0, 0.5807259073842302, 0.2776735459662289, 0.8272841051314143 ], "confidence": 0.2079329639673233, "main_score": 0.27198054848773007 } ] }
Generated in

This output was created using a different version of the model, jweek/mask_maker:c51e9857.

Run time and cost

This model runs on Nvidia T4 GPU hardware. We don't yet have enough runs of this model to provide performance information.

Readme

This model doesn't have a readme.