There are some feature that will be amazing to be added to langchain4j. Many Enterprise software are developed with java and attention to langchain4j is rising.
Is anyone out there tried to add support for batch processing etc.? These are special features that do not look similar with standard openai API (Which is usually used for langchain4j and groq).
Hi!
Lanchain4j looks like a cool project!
Yes, we do have non-standard APIs for custom features; we try to make all the overlapping features as compatible with OpenAI and Anthropic as much as we can, but due to differences in feature sets we sometimes have to diverge.
For custom, non-OpenAI API compatible features, I’d actually suggest using our API calls instead instead of an SDK, as these will always have first-class support and compatibility.
Hi
Using direct API calls works, but for Java it’s not a good design pattern. And for some serious projects you need to follow a robust design pattern.
I think it’s good if you design a Java SDK as well.
Ah interesting; most of us don’t have a lot of experience in Java.
It looks like langchain4j is adding a lot of providers; we’ll look at working w/ them to implement a proper Groq integration at some point