Day 2: Ecommerce Competitor Website Scraper Tool

Hi everybody! I created an ecommerce competitor website scraper tool. Basically, what it does is scrape a list of competitor URLs I provide, pulling data across these areas:

Offers and pricing

Site structure
Product Page CRO Signals
Messaging
Brand & Visual Identity

I started in plan mode, and while iterating I realised the CRO part would be much easier to follow with image evidence. So Claude created a new folder with evidence for each competitor. On top of that, Claude built an interactive/visual HTML file covering the key aspects, along with the full visual identity (colors, typography, logos,...).

Two learnings from this challenge:

Plan mode is really important before executing any task. For example, before activating plan mode I asked for the Firecrawl cheatsheet .md file, Claude not just created the cheatsheet but also created a claude.md file in the same action without me asking for that.
As Nate says in the video, test with just one competitor first and iterate until it's polished. I started with 4 urls to compare outputs and it was tedious (it took a lot of time).

Really enjoying this 7-day challenge!!

#AISChallenge

20 comments

Day 2: Ecommerce Competitor Website Scraper Tool