Design a Web Crawler

What are the possible features

  • Visit the website and load all the content of the website

  • Webpage might have dynamic content, loaded via javascript, hence loading might take some time

Last updated

Was this helpful?