Perly Consulting │ Beck Eco

The State of Play

A living index of AI adoption across industries — where established practice meets the bleeding edge
UPDATED DAILY

The AI landscape doesn't move in one direction — it lurches. Some techniques leap from experiment to table stakes in a single quarter; others stall against regulatory walls, technical ceilings, or organisational inertia that no amount of hype can dislodge. Knowing which is which is the hard part. The State of Play cuts through the noise with a rigorously maintained index of AI techniques across every major business domain — classified by maturity, evidenced by real-world adoption, and updated daily so you always know where you stand relative to the field. Stop guessing. Start knowing.

The Daily Dispatch

A daily newsletter distilling the past two weeks of movement in a domain or two — delivered to your inbox while the index updates in the background.

AI Maturity by Domain

Each dot marks the weighted maturity of practices within a domain — hover for a brief summary, click for more detail

DOMAIN
BLEEDING EDGEESTABLISHED

Architecture documentation & specification writing

LEADING EDGE

TRAJECTORY

Advancing

AI that generates architecture diagrams, system design documents, and technical specifications from codebases and requirements. Includes C4 diagram generation and design doc drafting; distinct from code documentation which targets inline and API-level references.

OVERVIEW

AI-assisted architecture documentation has achieved production maturity at the commercial layer—Mintlify now processes 45% of its documentation traffic from AI agents and Claude Code alone generated 199 million requests in a single month—but a hard ceiling on architectural reasoning keeps the practice fundamentally constrained. Tools can generate simple diagrams and design-doc drafts at scale; Google's deployment demonstrates autonomous agents can identify critical system-level issues when architecture documentation is committed to CI/CD pipelines. Yet peer-reviewed benchmarks show near-zero accuracy on complex diagrams beyond 30-40 components, and models lack pragmatic architectural reasoning. This creates a persistent split: simple artifacts (service diagrams, ADRs, draft specifications) benefit from automation, while complex systems architecting and documentation maintenance demand human judgment. Documentation drift—the gap between live code and documented architecture—has accelerated from weekly to daily misalignment in AI-accelerated teams, exposing the inadequacy of tool-based synchronization. The compensating discipline is specification engineering: structured, machine-readable specifications that constrain AI outputs and serve as the binding interface between human architectural intent and agent execution.

CURRENT LANDSCAPE

Commercial tooling matured sharply in April 2026. Mintlify announced a $500M Series B valuation, revealing that 45% of its documentation traffic now comes from AI agents—significantly exceeding human browser access at 46%. Claude Code alone generated 199 million documentation requests in one month. The platform serves 100+ million monthly users across 20,000+ customers including Microsoft, Anthropic, Coinbase, and PayPal, with $10M ARR at end of 2025 (10x growth YoY). Eraser continues ecosystem expansion with official AI agent integrations (Claude Code, Cursor, Windsurf) and community MCP servers. Architecture-specific case studies are emerging: Google deployed autonomous AI agents to generate ARCHITECTURE.md files across a microservices mesh, with AI-powered CI/CD quality gates identifying critical system-level issues (distributed tracing blackouts, storage leaks) undetected for months—demonstrating that architecture documentation can serve as an automated reasoning layer for infrastructure assurance. Legacy systems like Drupal 7-based platforms show C4 methodology deployment reducing risk and improving team estimation accuracy.

However, the capability boundary remains sharp and creates a persistent adoption ceiling. Documentation drift has accelerated from weekly misalignment to daily architectural divergence in AI-accelerated teams, exposing a structural problem: AI and version control lack temporal architecture tracking (branch-aware diagrams, Git-integrated change history). ThoughtWorks analyst assessment identifies spec-driven development frameworks (OpenSpec, GitHub Spec Kit, BMAD) as critical guardrails for agent reliability—positioning specifications as the control interface rather than relying on AI for autonomous architectural reasoning. Research (ICLR 2026, Text2Arch) validates fine-tuned models on diagram generation tasks, yet benchmarks on large diagrams and generative image models remain at 42-55% accuracy versus 82% human performance. The practical result is specification engineering as the dominant pattern: practitioners write machine-readable specifications that constrain agent outputs, treating architecture documentation as binding interface rather than autonomous artifact.

TIER HISTORY

ResearchJan-2023 → Jul-2024
Bleeding EdgeJul-2024 → May-2026
Leading EdgeMay-2026 → present

EVIDENCE (84)

— Comprehensive SDD practitioner guide covering 4-phase workflow and EARS notation; reports 3-10x higher first-pass success rates from GitHub and AWS adoption data.

— Ecosystem survey documenting SDD tooling maturity: AWS Kiro (GA Nov 2025) uses EARS notation; GitHub Spec Kit 93k+ stars; OpenSpec and BMAD frameworks mature with enterprise adoption.

— Survey of 1,131+ practitioners shows 76% use AI regularly in documentation workflows (up 16 points YoY); validates adoption crossing mainstream threshold in documentation tooling.

— Critical analysis documenting SDD's structural limitations: vague requirements still produce vague systems; essential counter-signal preventing premature tier advancement.

— Professional development firm documents SDD as standard practice with five-phase workflow; demonstrates real-world deployment of specification-first methodology across production projects.

— Analysis documenting systemic AI adoption failure: 60% of pilots generate no value; exposes adoption ceiling limiting specification-driven architecture work at scale.

— Peer-reviewed analysis (arXiv May 2026) establishing formal Specification Governance Model grounded in Transaction Cost Economics; addresses productivity-reliability paradox in AI-assisted development.

— Peer-reviewed empirical study comparing five ADR templates; provides evidence-based guidance for architecture documentation standardization across adoption.

HISTORY

  • 2023-H1: Research into automated architecture documentation validation gained visibility through ICSA 2023 publication on inconsistency detection. C4 model adoption visible in practitioner tutorials and vendor tooling. Diagram-as-code approaches (PlantUML) emerging for version control integration.
  • 2023-H2: SARIF architecture recovery research published (arXiv, 36.1% accuracy improvement). Practitioner tutorials demonstrate hands-on C4/Structurizr DSL adoption for versioned documentation. Practitioner discourse highlights documentation's role in mitigating technical debt from AI-generated code, renewing focus on spec-driven development practices.
  • 2024-Q1: Commercial AI diagram tools enter product-GA phase (e.g., AI Diagram Maker). Conversational diagram generation reduces production time from 30+ minutes to 20 seconds, beginning to address the manual labor bottleneck in diagram creation. Practitioner adoption of diagrams-as-code remains steady, supported by open-source tooling.
  • 2024-Q2: Research continues on automated architectural knowledge extraction and organization using generative AI, with ICSA 2024 poster demonstrating techniques for mining architecture information from dispersed sources (code, logs, documentation). The practical challenge remains addressing the organizational problem—many teams still lack systematic architecture documentation despite emerging tooling.
  • 2024-Q3: DORA 2024 survey confirms majority developer adoption of AI for documentation tasks; Mintlify achieves 3,000 customer traction and $18.5M Series A. Critical gap emerges: Zhejiang University benchmarking shows AI achieves only 55-65% accuracy on diagrams vs. 82% human performance. Accessibility experts document stability and compliance failures in AI-generated technical artifacts. Quality assurance becomes the blocking factor as review overhead offsets creation time savings.
  • 2024-Q4: Commercial adoption accelerates: Mintlify quintuples customer base with Fortune 500 deployments (Anthropic, Cursor, Perplexity). AWS releases Amazon Q Developer for diagram generation. DORA 2024 final report quantifies productivity-stability trade-off: 25% AI adoption → 7.5% documentation quality gain but 1.5% throughput loss and 7.2% stability decrease. EU AI Act spurs academic work on automatable compliance documentation. Empirical testing reveals persistent hallucinations in AI diagram generation; model collapse risk emerges as long-term threat to AI training data quality.
  • 2025-Q1: Commercial consolidation continues: Mintlify scales to 15+ named enterprise customers serving 2M+ monthly developers. Eraser AI demonstrates production ROI (10x diagram speedup, documentation scaling). However, industry-wide AI failure rates spike to 42% of businesses scrapping initiatives due to specification and governance gaps. Tooling advances: CI/CD-native diagram automation (Eraser, Amazon Q) reduces documentation drift. Practitioners adopting AI for Architecture Decision Records document productivity gains alongside persistent limitations (hallucinations, context loss). Quality assurance and human-in-the-loop governance remain critical blocking factors for scaled deployment.
  • 2025-Q2: Limited new evidence emerges, with architectural tooling gains focused on incremental improvements. Eraser.io tutorial documentation highlights DiagramGPT feature maturity for natural-language-to-diagram generation and diagram-as-code approach with CI/CD synchronization, confirming continued emphasis on reducing manual drift. Commercial API documentation platforms (Mintlify, Scalar, Bump) dominate market discourse; architecture documentation remains secondary narrative. Industry evidence scarce—suggests either consolidation phase or temporary pause in narrative generation within this specialized segment.
  • 2025-Q3: Peer-reviewed research (ASEM 2024) evaluates ChatGPT's diagram generation capabilities, finding competent outputs for simple diagram types but significant limitations on complex systems architecting scenarios. Vendor analysis (IcePanel) reveals persistent architectural reasoning gaps: LLMs design like junior programmers, fixating on popular technologies over pragmatic choices. Diagram software market shows continued growth momentum ($843M in 2024 to projected $1.8B by 2031). Limited public evidence reflects ongoing consolidation in the commercial tooling space; research focus remains on capability assessment rather than large-scale production deployments.
  • 2025-Q4: Spec-driven development emerges as key methodology, with ThoughtWorks and multiple practitioners analyzing AI agents' role in transforming specifications into implementation. Commercial tooling advances: AI-powered ArchiMate modeling reduces documentation cycles from weeks to hours. Market discourse shifts toward documentation-as-machine-readable-infrastructure; Mintlify positions documentation as 50% AI-optimized. Critical counterpoint surfaces: scaling challenges in spec-driven development reveal fundamental limitations—natural language ambiguity, AI's lack of contextual reasoning, and architectural judgment gaps remain persistent obstacles. Ethics research highlights hallucinations, bias, and IP concerns as adoption blockers. Stack Overflow survey data shows 84% developer adoption of AI tools but only 46% favorable sentiment, citing accuracy concerns. Deployment momentum continues but governance and quality assurance requirements intensify.
  • 2026-Jan: AI-powered architecture documentation tooling reaches production maturity with ecosystem expansion. Eraser launches official AI agent integrations (Claude Code, Cursor, Windsurf) for IDE-native diagram generation; community extends tooling via open-source MCP servers. Mintlify scales to 20M monthly users serving enterprise customers (Microsoft, Anthropic, Coinbase) demanding machine-readable documentation as AI agent input. Product development accelerates: Mintlify adds repo-based auto-generation and multi-modal assistant input. However, negative signals intensify: peer-reviewed research finds GenAI image models achieve only 42% accuracy on architectural visuals (vs. 82% human baseline); practitioner research surfaces risks of homogenization, authorship loss, and contract/regulatory constraints limiting real-world adoption. Vendor momentum remains strong but governance challenges and quality assurance requirements deepen.
  • 2026-Feb: Enterprise documentation tooling consolidates around specification discipline as coordinating practice. Mintlify advances with enterprise security features (SSO, RBAC) signaling mature B2B adoption; independent benchmarking reveals AI models fail on complex diagrams at scale (near-zero accuracy beyond 30+ components), reinforcing need for human-in-the-loop governance. Practitioner consensus crystallizes: specification engineering—the discipline of writing agent-executable blueprints—emerges as the critical bottleneck and compensating control for reliable AI-assisted architecture work. Comparative analysis surfaces trade-offs: AI-native platforms gain speed but lose collaborative depth and approval workflows.
  • 2026-Mar: Practical deployment evidence surfaces as critical practice maturation marker. Helicone (16k+ organizations, 14.2 trillion tokens processed) documents that documentation quality ('the knowledge layer') is the limiting factor for AI system performance—not model capability. First unified benchmarking platform (ArchBench) launches for measuring LLM capabilities on architecture tasks (ICSA 2026), establishing research infrastructure for the practice. Commercial maturation accelerates: Ardoq GA releases AI Chat for architecture data querying and AI Visual Importer for diagram-to-structured-data conversion, with Tenneco case study eliminating 1.25 FTE through AI-assisted workflows. Apache SkyWalking documents how AI economics reshape architecture decision-making: runnable PoCs become cheap enough that architects can pursue optimal designs instead of early compromises. However, critical signals persist: specification synchronization challenges documented by practitioners; hallucinations and knowledge-cutoff remain blocking factors for specification generation; organizational prerequisites limit SDD applicability outside founder-led contexts. Market assessment shows 80%+ of enterprise architecture artifacts currently unstructured but AI-driven consolidation tools achieving 94.4% accuracy on document parsing, with ROI evidence (15% IT cost reduction) in regulated industries.
  • 2026-Apr: Spec-driven development consolidates with measurable deployment evidence and research validation. Talk Think Do publishes Q1 2026 AI Velocity Report showing 84% AI-authored code with OpenSpec achieving 40-50% faster delivery and 55% cost advantage in competitive tender. Peer-reviewed research (OmniDiagram, ACL 2026) establishes SOTA benchmarks for AI diagram code generation with 196k-instance dataset and RL-based visual feedback validation, validating technical feasibility of specification-driven diagramming. Independent third-party evaluation documents 70% reduction in C4 diagram creation time in enterprise production deployment. Palo Alto Networks engineer evaluates three SDD frameworks (BMAD, Spec-Kit, OpenSpec), finding OpenSpec highest-scoring (4.0/5) for specification quality and AI tool compatibility. Pulumi and Forte Group demonstrate CI/CD-integrated diagram automation and strategic positioning of Spec Layer as durable constraint interface for AI execution. Late-month signals reinforce commercial and production maturity: Mintlify announced $500M Series B valuation with 45% of documentation traffic now from AI agents (Claude Code alone generated 199M requests in one month), confirming machine-readable documentation has crossed the threshold where AI agent consumption exceeds human browsing; Google deployed autonomous agents generating standardized ARCHITECTURE.md across a microservices mesh, with AI-powered CI quality gates catching critical issues (distributed tracing blackout, storage leak) undetected for months; ICLR 2026 Text2Arch research validated fine-tuned models matching GPT-4o on scientific architecture diagram generation; practitioners documented that AI coding accelerates documentation drift from weekly to daily misalignment, intensifying demand for automated synchronization. Emerging pattern: specification engineering transitions from theoretical discipline to operational practice across consulting, enterprise, and tooling sectors, with commercial scale (Mintlify 20,000+ customers) and production CI/CD deployments (Google) validating the shift from AI-as-autonomous-architect to AI-as-implementation-executor-constrained-by-specs.
  • 2026-May: Specification-driven development mainstream adoption confirmed with ecosystem maturity, adoption data, and critical boundary signals. State of Docs Report 2026 (1,131+ practitioners) documents 76% of technical writers now use AI regularly for documentation—up 16 YoY—with 70% factoring AI into information architecture decisions; four case studies (PostHog, Teleport, Retool, Stripe) show production deployments reducing documentation labor. Ecosystem tooling maturation: AWS Kiro GA (Nov 2025, EARS notation adoption), GitHub Spec Kit at 93k+ stars, OpenSpec and BMAD frameworks with enterprise production use. Research (arXiv May 2026, Farrag) establishes Formal Specification Governance Model grounded in Transaction Cost Economics, documenting the productivity-reliability paradox: 20-56% productivity gains in controlled studies vs. 19% slowdown for experienced developers in RCT plus 98% more PRs and 91% longer review cycles. SolGuruz case study documents SDD as standard practice in professional development workflows—specification-first five-phase process (Specify → Plan → Data Models → Service Interactions → Implement) operationalized on production projects. Critical boundary signals persist: analytical piece (Scala Teams, May 2026) argues SDD relocates rather than solves requirements problem (vague specs produce vague systems); systemic adoption analysis documents 60% of AI pilots generate no value, exposing ceiling on SDD applicability outside high-maturity contexts. Peer-reviewed research on ADR template selection (arxiv May 2026) provides empirical guidance on standardization across adoption. Practical signal: documentation cost justification emerging—teams spend 3.2 hours/week relitigating past architectural choices due to missing ADRs, quantifying ROI for structured architecture documentation governance. Synthesis: specification engineering established as mainstream coordinating discipline for AI-assisted architecture work, with evidence split between commercial scaling (documentation AI adoption mainstream, SDD tooling mature) and persistent capability ceilings (adoption still limited to specification-ready organizations, cost of specification governance remains high, requirements problem unsolved).