Hi Team,
I'm trying to decide on a backend for an OpenAI API run app however, now they've lifted the token limit, the expectation is to see 5000 words (and potentially even more when they bring in the 32k token limit instead of the 8k that is available in GPT4 currently) results sent to and from the API. This will be more than 10k characters for sure. I am not an enterprise customer, just a startup, however have you considered whether there could be an option for $x/month to uncap the 10kb API response limit for regular accounts? I'm fine to pay but not going to pay hundreds of dollars per month for an unmonetised concept yet.
Unfortunately, if this is not available, I expect this may lock you out of many people looking to use this API in interesting ways. Unless I am misunderstanding what the 10kb limit refers to?
Cheers,
Robin