←back to thread

11 points papapin777 | 3 comments | | HN request time: 0.784s | source
Show context
Khromchenko13 ◴[] No.44523449[source]
How good is it in terms of scalability? Im looking for something that wont crap out when we get to 100s or 1000s of tests
replies(1): >>44523504 #
1. papapin777 ◴[] No.44523504[source]
Hmm, I didn’t test this many tests. But you can run all tests in parallel — two at a time — and we should be good. The limitation isn’t the framework; it’s your budget and the tier you have on OpenAI. If you have Tier 2, which allows more requests to the OpenAI API, you could potentially run 1,000 tests in a single run.
replies(1): >>44525546 #
2. Khromchenko13 ◴[] No.44525546[source]
What other LLMs do you support?
replies(1): >>44525908 #
3. papapin777 ◴[] No.44525908[source]
Only Open AI right now. Maybe i will add Ollama or Gemini in future