Yo Claude Code to make Scrapers is Epic
Idk if anyone makes scrapers here, but some of my clients have wanted to automate finding leads... So there I was, trying to get all the luxury realtors off of onereal.com but no apify actor I was lost.... Nope. I turned to my pal claude code (CC). I said, here's a link I want to scrape (url that had a list of profiles (and their links) here's an example of a link that it points to (link example of a profile) here's example data from that page I want to scrape CC went to work, ran into a problem with js, tried a headless browser, didn't work, tried playwright, it did some iterative magic and boom. 218 luxury realtors are on a list. I used ghostty, which has been helpful to run multiple CCs together. It's useful to find very specific datasets that aren't in apify. And I'm working on a commission basis for this particular client, so it's potentially high value if it works. Hope that gives you guys some ideas if you're stuck when scraping ✌️ It also didn't cost me anything except for my access to CC. And my normal dev routine is often lovable -> Claude code, so I've been using it for everything.