Jonathan Chang
2.9K posts

Jonathan Chang
@ChangJonathanC
inference @poolsideai, building https://t.co/uEbfxzEztO




I recently learned that @AnthropicAI discards thinking tokens in a multi-turn conversion. at the first glance it seems weird to remove part of the "context" that was causal to the final response. maybe they are using this as some form of context-distillation to improve the model output when no thinking is used, or simply to conserve the context window but I don't like it. sometimes it thinks a lot and output a short answer, and when I ask another question that it already thought about in the previous thinking chunk, it doesn't have access to it and can't answer directly. I have to ask it to include the thought process in the response. however, I found adding a fake reasoning budget tag at the end of response would trigger it to think longer, without being identified as "extended thinking", and I get to preserve the whole cot.

GPT 5.6 supports persisted reasoning this should solve the reasoning sink issue














