Yo Claude Code to make Scrapers is Epic
Idk if anyone makes scrapers here, but some of my clients have wanted to automate finding leads...
So there I was,
trying to get all the luxury realtors off of onereal.com
but no apify actor
I was lost....
Nope. I turned to my pal claude code (CC).
I said,
here's a link I want to scrape (url that had a list of profiles (and their links)
here's an example of a link that it points to (link example of a profile)
here's example data from that page I want to scrape
CC went to work, ran into a problem with js, tried a headless browser, didn't work, tried playwright, it did some iterative magic and boom. 218 luxury realtors are on a list.
I used ghostty, which has been helpful to run multiple CCs together.
It's useful to find very specific datasets that aren't in apify.
And I'm working on a commission basis for this particular client, so it's potentially high value if it works.
Hope that gives you guys some ideas if you're stuck when scraping ✌️
It also didn't cost me anything except for my access to CC.
And my normal dev routine is often lovable -> Claude code, so I've been using it for everything.
1
0 comments
Yo Claude Code to make Scrapers is Epic
powered by
skool.com/lovable-ai-3884
This is the official global community for all things Lovable AI! Whether you’re a beginner or an advanced user, this group is the place to ask
Suggested communities
Powered by