←back to thread

ArchiveBox is evolving: the future of self-hosted internet archives

(docs.sweeting.me)
663 points nikisweeting | 9 comments | 16 Oct 24 16:18 UTC | HN request time: 1.029s | source | bottom

We've been pushing really hard over the last 6mo to develop this release. I'd love to hear feedback from people who've worked on big plugin systems in the past, or anyone who's tried our betas!
1. wongarsu ◴[16 Oct 24 17:16 UTC] No.41861453[source]▶
Does this mean it's now possible to write plugins that dismiss cookie popups, solve captchas, scroll web pages etc.?
replies(2): >>41861527 #>>41866780 #
2. nikisweeting ◴[16 Oct 24 17:25 UTC] No.41861527[source]▶
I have a private plugin with puppeteer support for stuff like this, currently charging clients money to use it to fund the open source development. The clients are people who are already legally allowed to evade CAPTCHAS (e.g. governments, NGOs doing research, lawyers collecting evidence, etc.)

Unfortunatley I cant open source the CAPTCHA solving stuff myself, because it opens me up to liability, but if someone wants to contribute a plugin to the ecosystem I cant stop them ;).

replies(2): >>41862402 #>>41879349 #
3. 0x1ch ◴[16 Oct 24 18:48 UTC] No.41862402[source]▶
Legally allowed to evade CAPTCHAs? LOL.

What world do we live in where evading a captcha is an illegal offense?

replies(1): >>41862567 #
4. nikisweeting ◴[16 Oct 24 19:00 UTC] No.41862567{3}[source]▶
It doesn't matter whether or not it's actually legal, what matters is that the big platforms will sue you for trying, so you need a big bankroll to stand your ground.

At the very least they can bar you from accessing their sites as you're violating ToS that you accept upon signup.

5. xiconfjs ◴[17 Oct 24 05:51 UTC] No.41866780[source]▶
You mean ArchiveBox still doesn’t deal with cookie popups? If so, it’s quasi not useful for EU based web sites.
replies(1): >>41867149 #
6. nikisweeting ◴[17 Oct 24 07:08 UTC] No.41867149[source]▶
It does, you just have to set up a chrome profile that has an extension to hide cookie popups, or use a profile where you've already accepted/closed them and have a session.

You can archive with any chrome profile with arbitrary extensions enabled, so you can use uBlock, I still Don't care about cookies, Ghostery, etc.

replies(1): >>41867896 #
7. ajvs ◴[17 Oct 24 09:36 UTC] No.41867896{3}[source]▶
How do you set this up? I found this relevant issue[1] but it doesn't explain how to get it working.

[1] https://github.com/ArchiveBox/ArchiveBox/issues/211

replies(1): >>41902879 #
8. pbronez ◴[18 Oct 24 13:37 UTC] No.41879349[source]▶
That’s a pretty savvy open-core strategy: paywall features that create risk of legal liability so they are only used when there’s a paying customer/operator to assume that risk.
9. nikisweeting ◴[21 Oct 24 11:09 UTC] No.41902879{4}[source]▶
https://github.com/ArchiveBox/ArchiveBox/wiki/Chromium-Insta...

https://github.com/ArchiveBox/ArchiveBox/wiki/Configuration/...

https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...