Building a Scalable Web Scraping Infrastructure

How to design and build a scalable web scraping solution, incorporate best practices and avoid common mistakes.

(This talk was given during Web Data Extraction Summit in 2019)