LibLab interview question

system design a web crawler service