IMO it is usually a mistake to integrate AI as a separate chat function in the UI. AI(s) be integrated into existing chat and collaboration features via @ tagging. E.g. in something like Figma or Google Docs, you should be able to add comments, tag @ai, and ask it for feedback or to make changes just as you would if you were collaborating with a human. Putting the AI inside its own private chat button often makes it feel like a Clippy-esque gimmick.
Solid insight - I actually tried implementing an AI chat into my app. It's just an internal app for my own productivity purposes with my eCommerce business, but I felt I had a credible use case for having it there. At the end of the day, the work required to get it to a spot where it was useful and not janky was just too much (even with the AI tooling provided by Vercel's AI SDK). And, even though I got it working, I never found a reason to use it that I didn't feel like could just be achieved more smoothly with some buttons and text inputs.