I saw in another thread that people were working around this by asking for a summary of sections and then combining the summaries and asking for a joint summary.

Kind of like map reducing the articles.

O believe this is how GPT-Index attempts to bypass prompt length limitations.

This is an issue. I haven't experimented to see if there are workarounds, so the service currently checks the length of the article text and if it's very long, it will send a portion, otherwise we'll exceed the token limit. There's a note on the front page about it: "Limitations: The OpenAI API does not allow submission of large texts, so summarization may only be based on a portion of the whole article."

Not promoting this. But, sounds like a great area for monetization.

Anyone can use without conversational memory, or with limited conversational memory.

Then, charge for larger conversational memory.

ChatGPT doesn't seem to have a much longer memory

It's 2x the length of GPT3. 8192 tokens vs 4096.