Web Crawler forms the back-bone of applications that facilitate Web information retrieval. Generic crawlers and search engines are like public libraries: they try to cater to everyone, and do not specialize in specific ...