Most active commenters
  • percyding99(7)

Show HN: A free AI risk assessment tool for LLM applications

(www.gettavo.com)
36 points percyding99 | 13 comments | 15 May 25 12:50 UTC | HN request time: 1.203s | source | bottom

We’ve built an AI risk assessment tool designed specifically for GenAI/LLM applications. It's still early, but we’d love your feedback. Here’s what it does:

1. it performs comprehensive AI risk assessments by analyzing your codebase against different AI regulation/framework or even internal policies. It identifies potential issues and suggests fixes directly through one click PRs.

2. the first framework the platform supports is OWASP Top 10 for LLM Applications 2025, upcoming framework will be ISO 42001 as well as custom policy documents.

3. we're a small, early stage team, so the free tier offers 5 assessments per user. If you need more, just reach out, happy to help.

4. sign in via github is required. We request read access to scan code and write access to open PRs for fix suggestions.

5. we are looking for design partners to collaborate with us. If you are looking to build compliance-by-design AI products, we'd love to chat.

product url: https://www.gettavo.com/app

we'd really appreciate feedback on:

- what you like

- what you don't like

- what do you want to see for the next major feature

- bugs

- any other feedback

feel free to comment here or reach out directly: email: percyding@gettavo.com, linkedin: https://www.linkedin.com/in/percy-ding-a43861193/

1. Urahandystar ◴[16 May 25 09:01 UTC] No.44003226[source]▶
I get the feeling you're about to make a whole lot of money. I'd move away from enterprise and try to aim for hobby coders with a micro transactions.
replies(2): >>44003527 #>>44003559 #
2. percyding99 ◴[16 May 25 09:57 UTC] No.44003527[source]▶
-> I'd move away from enterprise and try to aim for hobby coders with a micro transactions.

Thanks! That's actually an interesting point. We've been trying to reach out to enterprise and get some early users + feedback from them, we will start reaching out to hobby coders or even vibe coder to try out the product as well

replies(1): >>44003706 #
3. throwaway_5753 ◴[16 May 25 10:02 UTC] No.44003559[source]▶
This seems like the wrong direction if you want to make a whole lot of money. Do hobby coders pay for anything?
replies(1): >>44003639 #
4. percyding99 ◴[16 May 25 10:19 UTC] No.44003639{3}[source]▶
what do you think about solo dev/founder or indie hackers?
5. Ciunkos ◴[16 May 25 10:30 UTC] No.44003706{3}[source]▶
I believe this was just a joke. I bet only heavily regulated enterprises would be interested in a product like yours, to checkmark their compliance sheet. Regular coders and smaller businesses won’t care.
replies(1): >>44004097 #
6. Cynddl ◴[16 May 25 10:36 UTC] No.44003738[source]▶
I see on the landing page a screenshot with "Test for GDPR PII compliance", suggesting that this tool is probably not ready for any serious usage.

Anyone in the regulation landscape would know that GDPR is a EU data protection law, and PII a US concept which doesn't apply in the GDPR. The GDPR uses the concept of ‘personal data’, not ‘personally identifiable information’. This is not just a wording issue. Redacting, masking, removing information which appears to be ‘personally identifiable’ only constitutes pseudonymisation in the GDPR which does not offer any meaningful privacy protection.

replies(1): >>44003951 #
7. percyding99 ◴[16 May 25 11:14 UTC] No.44003951[source]▶
Thanks for the feedback! We agree that this tool is definitely not ready for serious usage at this stage, it would require heavy tuning and testing before wide adoption

also thanks for flagging the GDPR issue!

8. alickz ◴[16 May 25 11:17 UTC] No.44003981[source]▶
Cool idea

Though the "Privacy" link on your homepage doesn't work

Do you use scanned repositories for training or other purposes?

replies(1): >>44004124 #
9. percyding99 ◴[16 May 25 11:32 UTC] No.44004097{4}[source]▶
Thanks for the feedback! We've had a few inbounds from early stage startups that try to sell to regulated industry so our assumption here is small startups might need our tool if they are targeting highly regulated industries(we could be completely wrong tho)

Joke or not, it actually made me consider reaching out to vibe coders, but yeah we are still validating the need

10. percyding99 ◴[16 May 25 11:35 UTC] No.44004124[source]▶
Good catch on the "Privary" link, thanks!

-->Do you use scanned repositories for training or other purposes?

No we do not use the scanned repo for training or other purposes

11. hiatus ◴[16 May 25 15:25 UTC] No.44006613[source]▶
Have you been through any sort of audit like SOC 2 or ISO 27001? Can't see any enterprises even engaging in a conversation without something like that.

As a person who works in security in a large enterprise, I'd expect some kind of audit, pentest results, and more available in some type of trust center. And that's before we even send a security questionnaire that digs into your processes and controls.

replies(1): >>44010443 #
12. percyding99 ◴[16 May 25 22:43 UTC] No.44010443[source]▶
No we have not yet been through any of these audit at this point, but totally agree that we should get them done asap before selling to enterprises. Thanks for the feedback!