Yep. We had to do a surprising amount of work to solve this in our product: https://www.kitewing.ai/blog/stateless-agents-stateful-produ...

Very weird that the foundational LLM companies' own chat pages don't do this.