(geek.sg)

221 points whitefables | 1 comments | 16 Oct 24 05:26 UTC | HN request time: 0.198s | source

Show context

taosx ◴[16 Oct 24 07:41 UTC] No.41856567[source]▶

For the people who self-host LLMs at home: what use cases do you have?

Personally, I have some notes and bookmarks that I'd like to scrape, then have an LLM summarize, generate hierarchical tags, and store in a database. For the notes part at least, I wouldn't want to give them to another provider; even for the bookmarks, I wouldn't be comfortable passing my reading profile to anyone.

replies(11): >>41856653 #>>41856701 #>>41856881 #>>41856970 #>>41856992 #>>41857395 #>>41858199 #>>41858353 #>>41861443 #>>41864562 #>>41890288 #

1. Rick76 ◴[16 Oct 24 12:35 UTC] No.41858353[source]▶

>>41856567 #

I essentially use it like everyone else. I use it to search through my personal documents because I can control the token size and file embedding

↑

I Self-Hosted Llama 3.2 with Coolify on My Home Server