In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framework.

Since their inception, websites are used to share information. Whether it is a Wikipedia article, YouTube channel, Instagram account, or a Twitter handle. They all are packed with interesting data ...

Scraping Amazon products is not about one request. You need to implement structure, pagination, and avoid blocking. This tutorial shows you how to scrape Amazon product details using the Scrapy ...

The global AI trend started by ChatGPT has been going on for almost half a year now. Google Trend of ChatGPT I haven’t used ChatGPT and other Generative AI tools much before. But I have some friends ...

Python tools like Scrapy and Selenium help scrape large or interactive websites easily New AI tools like Firecrawl simplify complex scraping tasks with smart automation. Static websites are best ...

web_scraper/ ├── scraper_app.py # 🎯 Aplicación interactiva principal ├── run.sh # Script de inicio rápido ├── scrapy.cfg # Archivo de configuración de Scrapy ├── README.md # Documentación principal ...

Web scraping is a powerful technique that involves extracting data from websites. This data can be used for a variety of purposes, such as data analysis, market research, or feeding into machine ...