You don't need long context for long context