Microsoft planning to 2x character limit for Bing Chat and BCE, reveals challenges

Microsoft plans to expand Bing Chat’s character limit in both its consumer and Enterprise versions. Doubling the character limit from 4,000 to 8,000 characters could offer users more conversation flexibility.

Mikhail Parakhin, the Vice President of Search at Microsoft, tweeted about the limits, and some of the technical challenges involved in making such a change.

It is the same in both Consumer Bing Chat and BCE. We will expand it, but not quickly: all the algorithms are quadratic in context size, so, increasing to 8K would be 4x more expensive.

— Mikhail Parakhin (@MParakhin) September 12, 2023

Expanding the character limit could benefit users who require longer and more detailed messages in their chats, especially in enterprise settings where communication is often more extensive and complex.

Earlier this week, Microsoft announced new admin controls in Bing Chat Enterprise.

This update might be well-received by Bing Chat users who have found the previous character limit restrictive for their conversations. It will be interesting to see how this change affects the overall user experience and the adoption of Bing Chat in various contexts.

via MSPowerUser