Whisper taking incredibly long (over 60s), retrying takes less than 10s

Forum
5

Up until July 4th yes, thereafter we have reduced the timeout to 20s, which may be a bit aggressive but it has only slightly increased the occurrence of errors.

The audios are all transformed by the following command:

/opt/ffmpeg-layer/bin/ffmpeg -ss ${start} -to ${end} -i /tmp/input \
    -vn \
    -map_metadata -1 \
    -ac 1 \
    -c:a libopus \
    -b:a 240k \
    -application voip \
    -compression_level 0 \
    -threads 0 \
    -y \
    /tmp/output.ogg

We divide up each audio in chunks of 20 minutes (+15s of leeway) and then upload each of them separately to Groq. As you can see the format is always the same, opus @ 240kHz bitrate giving a consistent . The final bit that is less than 20 minutes has not had any problems. I will try lowering the length to about 15 minutes and the quality to 128kbps and see if that helps.

If it may help in investigating, the audios we get are usually recorded with a phone and from far away from the speaker