myaiteam2 / website-crawler

Crawl a website and get all the URLs (Updated 1 year, 1 month ago)

  • Public
  • 362 runs
Run with an API
Playground API Examples README Versions

Works on like 75% of the websites online. Perfect to get all the URLs and then scrape data.