How to execute JavaScript with Scrapy?

Learn how to scrape dynamic websites using Scrapy and Selenium, Splash and ScrapingBee middlewares for headless browsers

Image by Pierre de Wulf [source]

Most modern websites use a client-side JavaScript framework such as React, Vue or Angular. Scraping data from a dynamic website without server-side rendering often requires executing JavaScript code.