I imagine that Jack Sparrow would say something like that when he would know about web scraping and crawling. All the data about ships and cargos would definitely be useful for him and his Black Pearl crew. But how would scraping benefit me? Ordinary developer who isn’t planning to steal a gold treasure?
Tons of websites without public API When you are a web developer for a while and requesting restful APIs is your bread and butter you often come across some service and think to yourself “It would be really nice if I can just request these data through an API …”.