Programming languages & software engineering
Building programming languages, tools, and software engineering techniques that make software more reliable, secure, and productive.
Agent-Pex: Automated Evaluation and Testing of AI Agents
Automated evaluation and testing of AI agents AI agents are rapidly transforming software, with projections of over a billion agents in operation by 2028. These agents, embedded in products like VS Code and M365 Copilot,…
Tool-space Interference: An emerging problem for LLM agents
Tool-space interference occurs when adding an otherwise reasonable agent or tool to a team or agent reduces end-to-end task performance. We study the phenomenon in an analysis of 1470 MCP servers and make practical suggestions…
GitHub Agentic Workflows
Write natural language workflows (AI-powered automation that can make decisions) that understand context, make decisions, and take meaningful actions across your repositories. Write agentic workflows in natural language markdown, and run them safely in GitHub…