←back to thread

Ask HN: What are you working on (August 2024)?

634 points david927 | 1 comments | 24 Aug 24 22:00 UTC | HN request time: 0.272s | source

What are you working on? Any new ideas that you're thinking about?
Show context
generalizations ◴[24 Aug 24 22:51 UTC] No.41342468[source]▶
Building more Amazon scraper websites. Working on a framework to minimize the effort of creating them, and currently testing to see if I can automate most of the process with Anthropic’s Sonnet.

The most recent site is https://computerdisplayprices.com

When I’m done, I’m probably going to make a blog post or two just talking through the automation I figured out so far. LLMs are amazing force multipliers.

replies(2): >>41342586 #>>41343598 #
frankacter ◴[24 Aug 24 23:06 UTC] No.41342586[source]▶
what toolset do you use for scraping? puppeteer?
replies(1): >>41342672 #
1. generalizations ◴[24 Aug 24 23:15 UTC] No.41342672[source]▶
Nope, just selenium and pyautogui. The priority is to fly under the radar, rather than efficiency; for that I needed lower-level control. There's a bunch of other stuff I did to improve the anonymity, but to download I just open selenium at the url, wait for it to load, then use pyautogui to type 'ctrl-s' and type in the save directory.