Ask HN: What are best tools for web scraping? | Hacker News


40 bookmarks. First posted by resettarget 9 weeks ago.


Good discussion on tools to use for web scraping:
from twitter_favs
8 weeks ago by rukku

upofadown
scraping  scrapy 
8 weeks ago by rrc
https://github.com/ericchiang/pup
Scrapy also has the ability to pause and restart crawls [1], run the crawlers distributed [2] etc. It is my goto option.
[0]…
from instapaper
9 weeks ago by rogerhsueh
Scrapy also has the ability to pause and restart crawls [1], run the crawlers distributed [2] etc. It is my goto option.
scraper  crawler  parser  collection  links 
9 weeks ago by michaelfox
Discussion about web scrapers: sounds like either (1) scrapy or (2) headless chrome + puppeteer
scraping  scrapy 
9 weeks ago by bennylope