Hello Sir,
I am writing to confirm whether there is a free tier of 500,000 tokens per day for the Llama 3 8B model. My billing shows included charges despite documentation indicating a free tier.
is there a free tier? then what are its limits?
Yes, we have a free tier; rate limits are listed here: https://console.groq.com/docs/rate-limits
If you’re still on the dev tier, we show how much your requests would have cost if you upgraded to the dev tier, but if you’re on the free tier and haven’t given us payment information, then you shouldn’t be charged.
If you’ve upgraded to dev tier however, then you’ll be charged per the prices here: https://groq.com/pricing/
Jan
Just to confirm — as long as I’m on the Free Plan, I won’t be charged anything at all, right? The usage meter only shows what I would pay if I were on a paid Developer tier, but it doesn’t actually bill me? And I can use the API up to the Free Plan limits without owing anything, and Groq will simply stop my requests once I hit those limits — correct?
Yeah exactly, the Free Tier just shows you’d normally pay if you did upgrade to Developer tier, and yep as long as you’re on Free tier you don’t owe us a thing, and yep you’ll hit the 429 error on the API if you go over.
Have fun experimenting!!
1 Like