Hopper interview question

How would you design the Google webcrawler?