Random Thoughts
- Human review seems to be the bottleneck for AI-generated code, it’s time to rethink the traditional PR workflow. No or less human in the loop.
- Kubernetes is a good platform for long-running workloads like microservices and batch processing. But not ideal for short-lived ones like agents as computers today, which require strong isolation, fast snapshots/restore, and rapid scaling up/down. Time to build a new platform for agents with micro-VMs. But GPU support is still a challenge.
- Personal agents are the next product phenomenon. But it should be deployed locally.
- Local AI will be the key enabler for personal agents, ensuring privacy, low latency, and offline capabilities. Also the big thing for AI infrastructure going forward.
- Every company should hire someone working on AI for workflow automation just like the way they hire for DevOps or SecOps.
- With AI, everyone is a researcher today, since coding is no longer the main bottleneck.
- AI4Everything (AI4E) is the moat for almost every technical company - the differentiator is how deeply they embrace it.