web scraping tools
Web scraping tools, services, and plugins: a comprehensive list
Ruby project called Upton – haven’t tried it yet but it’s from the Tumblr blog Onethingwell whose picks tend to be OK.
10 Web Scraping Tools to Extract Online Data – added April 2016. Includes use case examples.
To Scrape or Not to Scrape: Technical and Ethical Challenges of Collecting Data off the Web – April 4, 2016