Ask HN: What are best tools for web scraping? | Hacker News


34 bookmarks. First posted by resettarget 3 days ago.



upofadown
scraping  scrapy 
2 days ago by rrc
https://github.com/ericchiang/pup
Scrapy also has the ability to pause and restart crawls [1], run the crawlers distributed [2] etc. It is my goto option.
[0]…
from instapaper
3 days ago by rogerhsueh
Scrapy also has the ability to pause and restart crawls [1], run the crawlers distributed [2] etc. It is my goto option.
scraper  crawler  parser  collection  links 
3 days ago by michaelfox
Discussion about web scrapers: sounds like either (1) scrapy or (2) headless chrome + puppeteer
scraping  scrapy 
3 days ago by bennylope