myaiteam2 / website-crawler

Crawl a website and get all the URLs

  • Public
  • 201 runs



Run time and cost

This model runs on CPU hardware. Predictions typically complete within 48 seconds. The predict time for this model varies significantly based on the inputs.


Works on like 75% of the websites online. Perfect to get all the URLs and then scrape data.