How I Scraped Marks and Spencer's Full Catalog 🛍️🛒

Inspired by Ritesh, I've been getting into the content game. In my most recent video, I walk through the process of scraping Marks & Spencer’s product data from scratch using Cursor and AI to speed up development.

Starting with Chrome Developer Tools, I identify the right API requests for scraping product details like t-shirts and joggers, then use Postman to test and refine the requests. I go over handling headers, formatting JSON responses for readability, and filtering only the relevant product data (like prices and descriptions). I also demonstrate how to scale the scraper to handle multiple product categories by parsing category IDs from the site’s JSON structure, while adding delays to avoid rate limits.

AI plays a key role in cleaning up the code and automating repetitive tasks, making the process much faster.

If you’re looking to streamline your web scraping projects, this video is packed with practical tips

Check it out here: https://youtu.be/sUChBYuIZg4

2 comments

Wifi Life

skool.com/wifi-life

A community of developers & entrepreneurs that provides exclusive material to develop coding based side hustles, land high paying tech jobs, and more.

Leaderboard (30-day)