←back to thread

Show HN: Documind – Open-source AI tool to turn documents into structured data

(github.com)
168 points Tammilore | 4 comments | 18 Nov 24 10:51 UTC | HN request time: 0.848s | source

Documind is an open-source tool that turns documents into structured data using AI.

What it does:

- Extracts specific data from PDFs based on your custom schema - Returns clean, structured JSON that's ready to use - Works with just a PDF link + your schema definition

Just run npm install documind to get started.

Show context
infecto ◴[18 Nov 24 17:22 UTC] No.42174595[source]▶
Multimodal LLM are not the way to do this for a business workflow yet.

In my experience your much better of starting with a Azure Doc Intelligence or AWS Textract to first get the structure of the document (PDF). These tools are incredibly robust and do a great job with most of the common cases you can throw at it. From there you can use an LLM to interrogate and structure the data to your hearts delight.

replies(2): >>42176035 #>>42176122 #
1. IndieCoder ◴[18 Nov 24 19:34 UTC] No.42176035[source]▶
Plus one, using the exact setup to make it scale. If Azure Doc Intelligence gets too expensive, VLMs also work great
replies(1): >>42177063 #
2. vinothgopi ◴[18 Nov 24 21:08 UTC] No.42177063[source]▶
What is a VLM?
replies(1): >>42177860 #
3. saharhash ◴[18 Nov 24 22:37 UTC] No.42177860[source]▶
Vision Language Model like Qwen VL https://github.com/QwenLM/Qwen2-VL or CoPali https://huggingface.co/blog/manu/colpali
replies(1): >>42195886 #
4. sidmo ◴[20 Nov 24 16:59 UTC] No.42195886{3}[source]▶
VLMs are cool - they generate embeddings of the images themselves (as a collection of patches) and you can see query matching displayed as a heatmap over the document. Picks up text that OCR misses. Here's an open-source API demo I built if you want to try it out: https://github.com/DataFog/vlm-api