Skip to content
RiverCore
Microsoft's Agentic Observability Bet: The Real Buy-vs-Build Question
agentic observabilityFoundry tracingAzure MonitorMicrosoft Foundry agent telemetry costsagentic observability build vs buy

Microsoft's Agentic Observability Bet: The Real Buy-vs-Build Question

6 Jul 20267 min readMarina Koval

The question every platform lead running an agent roadmap should be putting to their CFO this quarter is not whether to adopt Foundry tracing, it is who owns the telemetry storage line item in 2027. Only fifteen percent of enterprises claim mature pipelines for large-scale agents, and Gartner expects half of GenAI deployments to include observability by 2028. That gap is the entire commercial opportunity Microsoft just moved to capture, and it reshapes the build-vs-buy math for anyone shipping agents into regulated workflows.

The Numbers

Start with the market frame. The observability segment today sits between $2.9 and $4.1 billion, as AI CERTs reported in its recap of Microsoft Build 2026. That range is the base Microsoft, Datadog, Grafana Labs, and a dozen smaller vendors are fighting over, and it was defined largely by microservice-era instrumentation. Agents change the shape of that data. Prompts, tool calls, sub-agent hops, and non-deterministic outputs generate telemetry volumes that were never in the original capacity models.

The second number matters more for planning. Gartner's forecast that half of GenAI deployments will carry observability by 2028 means the addressable market roughly doubles inside 24 months of procurement cycles. For a VP Eng planning 2027 headcount, that means either your platform team owns this competency or a vendor does, and the vendor decision needs to be locked before the storage costs compound.

Then there is the pilot problem. Surveys cited in the piece show almost half of agent projects stay stranded in pilot purgatory without proper observability. Only fifteen percent of enterprises have mature pipelines. That eighty-five percent gap is not a talent shortage, it is a tooling and governance gap. The blocker list is consistent: observability, governance, and data quality. These are the same three items that killed enterprise Kubernetes adoption in 2018 until managed control planes arrived.

The pattern is familiar. A new runtime primitive (containers then, agents now) hits the ecosystem faster than the operational tooling. Vendors race to fill the gap. The incumbent cloud provider bundles a reference stack. Buyers who waited get a cleaner path; buyers who built early write off custom telemetry pipelines. If your board is being told that agent projects will convert to production revenue in the next four quarters, and your current pilot-to-production conversion rate is closer to fifty percent, the numbers don't reconcile without an observability investment that most 2026 budgets did not scope.

What's Actually New

Microsoft Build 2026 pushed two things to general availability that matter: Foundry tracing and multi-turn evaluations. GA status is the signal, not the feature. GA means Microsoft's account teams will now sell it against enterprise SLAs, and it means procurement can approve it without a preview-tier exception. That changes the buying motion.

The more interesting piece is the OpenTelemetry bridge. Any agent framework can now stream spans into Azure Monitor. On paper, this is a standards play. In practice, it is a distribution play. Microsoft is betting that if it makes ingestion frictionless from LangGraph, CrewAI, semantic-kernel, and whatever framework wins the next six months, the analysis layer becomes sticky. The OpenTelemetry spec has always been about avoiding lock-in at the collection layer, but the storage and query layer is where margin lives. That is the layer Microsoft just made the default.

Agent 365 is the quieter announcement with the bigger enterprise implication. Tenant governance plus observability hooks inside Office workflows means the compliance surface for agents now maps to the same tenant model that GC and IT already understand for Microsoft 365. For any GC evaluating agent deployments in a regulated vertical (financial services, health, iGaming licensing regimes), that reduces one full workstream of policy translation.

The Foundry ROI dashboard linking cost curves to quality metrics is the executive-facing move. It exists because CFOs kept asking why the LLM bill grew ninety percent quarter over quarter with no attributable revenue. Whether the dashboard actually answers that question or just visualizes the pain is going to depend on how honest the quality metrics are. Rubric evaluators are only as good as the rubric, and I have not seen a vendor yet ship a rubric that makes their own product look bad.

What is genuinely new: the reference stack is now complete enough that a mid-sized platform team can adopt it without writing custom collectors. What is not new: the underlying problem of instrumenting non-deterministic systems remains unsolved at the theoretical level. Microsoft has shipped a good practical answer, not a fundamental one.

What's Priced In for Engineering Teams

Most senior engineers already expect three things from this announcement. First, that OpenTelemetry becomes the collection standard for agents. That was directionally obvious eighteen months ago and the bridges just confirm it. Second, that the hyperscalers would extend their monitoring products rather than let a pure-play win the category. Azure Monitor gaining agent spans is the Microsoft version of what AWS and Google will announce within two quarters. Third, that GA-tier features would arrive at Build. The event exists to convert preview commitments into procurement line items.

What is not priced in, and where I'd argue teams are underprepared: the storage economics. Telemetry volume for agents can exceed traditional microservice telemetry by an order of magnitude once you capture every prompt, response, tool call, and sub-agent hop within a single trace. The article correctly flags that telemetry volume raises storage costs that strain cloud management budgets. Most 2026 platform budgets were built on a microservice-era telemetry baseline. If your sampling strategy is not designed around agent traces specifically, the surprise will hit around month four of production traffic, which for teams shipping in Q3 means the invoice lands right when annual planning starts.

The Head of Platform at any Series-B or later company running agents in production should be asking their FinOps counterpart this week: what is the projected telemetry storage growth if agent traffic scales five-x, and does the current Azure or observability vendor contract have a renegotiation window before that hits? If the answer is no, that is the priority conversation, not the framework debate.

Contrarian View

The consensus read is that Microsoft has established the reference architecture for governed agents and everyone else needs to conform. I'd push back on that in one specific way. Schema fragmentation is called out in the piece as a real problem, forcing duplicate instrumentation across agentic ops teams. Microsoft's answer is effectively "use ours." That works if you are already a Foundry customer. It does not work as cleanly if you are running a multi-cloud agent stack, which most fintech and crypto infrastructure teams are, because their trading, compliance, and customer-facing agents often live in different regulatory zones with different cloud footprints.

The contrarian bet: within eighteen months, an open-source agent observability schema layered on OpenTelemetry becomes the actual standard, and Foundry tracing becomes one implementation among several. The hiring market will follow. Engineers who know the open schema will be more portable than engineers who know only the Microsoft stack. For CTOs staffing platform teams now, that is a hiring criterion worth writing into job descriptions before it becomes obvious to everyone.

Key Takeaways

  • Foundry tracing and multi-turn evaluations at GA make Microsoft a defensible default for agent observability, but the OpenTelemetry bridge is the real distribution move. Evaluate the stack on ingestion neutrality, not feature parity.
  • The fifteen percent maturity rate for large-scale agent pipelines is the buying signal. Vendors will price aggressively for the next four quarters to lock in reference customers. Negotiate now.
  • Telemetry storage costs for agent traces will surprise budgets built on microservice baselines. Model five-x traffic scenarios before renewing any observability contract in 2026.
  • Agent 365 tenant governance shortens the compliance workstream for regulated verticals already on Microsoft 365. For GCs, this is the underrated announcement of the cycle.
  • Teams evaluating agent observability should now be asking themselves whether they are buying a reference stack or an operating standard. Those are different commitments with different exit costs.

Frequently Asked Questions

Q: What did Microsoft actually ship at Build 2026 for agent observability?

Foundry tracing and multi-turn evaluations reached general availability, OpenTelemetry bridges were added so any agent framework can stream spans into Azure Monitor, Agent 365 gained tenant governance with observability hooks, and a Foundry ROI dashboard now links cost curves to quality metrics for executives.

Q: Why do so many enterprise agent projects fail to reach production?

Only fifteen percent of enterprises report mature pipelines for large-scale agents, and roughly half of projects stall in pilot phase. The consistent blockers are observability gaps, governance, and data quality, compounded by non-deterministic agent behavior that breaks traditional monitoring baselines.

Q: Should platform teams standardize on Foundry tracing or stay framework-neutral?

It depends on cloud footprint. Teams already committed to Azure and Microsoft 365 get faster time to value from Foundry. Multi-cloud teams should prioritize OpenTelemetry-native schemas and treat any single-vendor stack as one implementation to preserve portability and hiring flexibility.

MK
Marina Koval
RiverCore Analyst · Dublin, Ireland
SHARE
// RELATED ARTICLES
HomeSolutionsWorkAboutContact
News06
Dublin, Ireland · EUGMT+1
LinkedIn
🇬🇧EN▾