We don't currently offer spending limits or budgets, but we're working on this feature and hope to ship it to you soon. Monitor usage through your dashboard to track consumption and costs or use third-party open-source tooling like LiteLLM to set spending caps for Groq API as shown at https://docs.litellm.ai/docs/proxy/users. In the meantime, you can also reach out to Groq support who can help set up per day token limits by model.
Be the first to reply!
Reply
Login to the community
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.