Future of AI is in latent space thinking and memory
There is so much AI research emerging in thinking in latent space and implementations of better memory. My prediction is that those will be the next two scalable breakthroughs in algorithmic improvement.
Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
https://arxiv.org/abs/2502.05171
Titans: Learning to Memorize at Test Time
https://youtu.be/UMkCmOTX5Ow