It’s 6 a.m. in Cambridge UK, and I’ve been lying awake since 3 a.m., the reason is just because Meta released a new product called Muse, it’s a long-running personal AI assistant inside a confidential VM with long-term memory and the ability to improve the foundational model over time. This is quite similar to the AI system I want and am building now, which makes me excited but also really anxious.

Feel the energy of life, no AI.

[Slides]

The CNCF Technical Advisory Groups (TAGs) play a vital role in shaping the future of cloud native. Explore the TAG Workloads Foundation with us! This session will present the mission, scope, early initiatives, and subprojects of TAG Workloads Foundation, focused on defining and advancing practices and standards for cloud native workload execution environments and lifecycle management. Attendees will learn how this TAG supports the CNCF’s technical vision, why workload execution is critical to adopters, and how community members can get involved to help solve real-world challenges across container platforms, schedulers, orchestration systems, and more. Join us to help shape the next phase of cloud native maturity—from fundamental runtime environments to future-forward workload patterns.

Hiking Catbells in Lake District, UK. Raining the whole day …

Dynamo is a high-throughput, low-latency inference framework in a distributed setup. Recently, I’m working on optimizing the Dynamo system, copiloted by our own product, the Hive, an evoluationary AI agent. Router is one of the key components in dynamo, especially like the KV-aware router, which seems like a good starting point to work on after talking with the Dynamo team.

Review the Goals of 2025

Looking back 2025, I set three goals (all about the work) at the beginning of the year, it turns out that the results are not that satisfying:

It was my birthday last week, too busy with work to write anything. But I think it’s a good time to imagine what I want to achieve in the next few years, or say, my long-term vision for 2025. Especially when AI is changing the world so fast, it’s important to have a clear vision of where I want to go.

9 bold conjectures about what AI will be like in 5 years and how it will change our lives:

After months of hard work, we’re coming out of stealth today! Welcome to join us to build AI agents democratizing algorithms -> Hiverge.ai.

Working on system optimization these days, joined a lot of meetings and talked a lot with the potential customers, also questioned a lot by them. Most of them, or even all of them, show great interest in the optimization solution, who can reject the idea of optimization?