SAP interview question

Design a web crawler