Skip to main content

Feature Requests

Submit, discuss, and vote on feature requests for Groq API

  • 8 Topics
  • 9 Replies
8 Topics
yawnxyz
yawnxyzCommunity Manager
published in Feature Requests
Feature Request Guidelines

How to Submit a Feature RequestClick New Post Select Category → Feature Requests Write your post (template at the bottom if you need it!) Tips for Great Feature RequestsSearch first - Someone might have already asked for this! If you find the feature request you want in a previous post, please upvote it. We will be especially tracking feature requests that get a high amount of upvotes to help us with prioritization.  One feature per post - Keeps the conversation focused so it’s easier to track and upvote. Be specific - For example, instead of "make it faster", try "reduce wait time for audio transcriptions". Explain the why - Tell us what you're trying to do! Understanding your workflow helps us build better features. Add context - What product are you using? How often do you hit this issue? Good Titles Help EveryoneMake your title clear so others can find it:✅ "Add support for PDF uploads in chat" ✅ "Increase character limit for TTS requests" ❌ "Please fix this" ❌ "Suggestion" What Ha

500
yawnxyz
A
acraftNew Member
asked in Feature Requests
Chunked Audio Upload for Speech-to-Text Processing

Hello, I have a feature request:Chunked Audio Upload for Speech-to-Text ProcessingCurrent Limitation:The API currently requires the full audio file to be uploaded before processing, leading to increased latency.Proposed Feature:Add an API endpoint to support chunked audio uploads during recording, allowing processing to begin as audio is being sent.Benefit: Reduces upload latency, improving user experience. This feature would significantly improve real-time processing capabilities and user satisfaction. Please provide feedback on this feature request.Thanks! 

111
yawnxyz
C
carygnoelNew Member
asked in Feature Requests
Hi dev community! The Groq team is looking for your input on console.groq.com

Hi Groq devs,My name is Cary and I work on the Groq developer experience team, mostly working on console.groq.com.  I’m always looking to connect with our developers and hear about what you’re building with Groq and how you use the API and Console.  Please reach out with any feedback you might have. What ideas do you have for how we can improve Console.  What is missing for you?  What frustrations do you have?  How can we better enable you to build fast and easy? Thank you!-Cary

272
C
V
VishwaSriramNew Member
posted in Feature Requests
Can i get the models to be hosted inside of india regeion?

We are building agents in the bfsi space and would like to know if there are plans of groq launching on indian endpoints?

412
ozenhati
S
sean_carmodyNew Participant
asked in Feature Requests
Chaining Models Support

Support for chaining multiple model requests into a single API call would be fantastic. Groq’s inference speed means the primary latency bottleneck is network I/O when making sequential model calls. Enabling request chaining would reduce network calls, making things faster and more efficient for workflows that need several model inferences in a row!

1144
S
yawnxyz
yawnxyzCommunity Manager
posted in Feature Requests
Model Request: Parakeet v2 0.6b Model

(Posted by peacock on the Groq Discord: https://discord.com/channels/1207099205563457597/1370606104966594680) Parakeet v2 0.6b can transcribe 1hr of audio in just 1 second https://huggingface.co/spaces/nvidia/parakeet-tdt-0.6b-v2https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2Only English SupportedIs this on roadmap? 

310
yawnxyz
yawnxyz
yawnxyzCommunity Manager
posted in Feature Requests
Add speech-to-speech model support

(Posted by Aly on the Groq Discord: https://discord.com/channels/1207099205563457597/1376241264101425273)Hi Groq Team,I'd like to request the addition of support for speech-to-speech (or voice-to-voice) models like ultravox on the Groq inference engine.Thanks!

240
yawnxyz
yawnxyz
yawnxyzCommunity Manager
posted in Feature Requests
Add support for logprobs in model API response

(Posted by Verdi on the Groq Discord: https://discord.com/channels/1207099205563457597/1377607663004811294) Looking to use Groq for writing our eval set. We are intending to use a design which is LLM-as-judge in our CD/CI pipeline. However, one of the issues as highlighted in this research (https://arxiv.org/pdf/2303.16634) is when asked a model will bias its "score" answer to be almost-always 3 and a better technique to get more high-quality test is to use the probability distribution instead. This is available when using OpenAI's API directly, but not for models on Groq. I would prefer to use Groq if possible since it's much faster!

190
yawnxyz
Terms & ConditionsCookie settings