Learn webcrawler system design, software architecture

Design a distributed web crawler that will crawl all the pages on the internet.
Question asked in most of the top company interviews like GOOGLE, FACEBOOK, and AMAZON
Let's learn how to build google sipderbot or google distributed web crawler.
#crawlersystemdesign

#systemdesigntips #systemdesign #computerscience #learnsystemdesign #interviewpreperation #amazoninterview #googleinterview #uberinterview #micrsoftinterview
#crawler #webcrawler