Perly Consulting │ Beck Eco

The State of Play

A living index of AI adoption across industries — where established practice meets the bleeding edge
UPDATED DAILY

The AI landscape doesn't move in one direction — it lurches. Some techniques leap from experiment to table stakes in a single quarter; others stall against regulatory walls, technical ceilings, or organisational inertia that no amount of hype can dislodge. Knowing which is which is the hard part. The State of Play cuts through the noise with a rigorously maintained index of AI techniques across every major business domain — classified by maturity, evidenced by real-world adoption, and updated daily so you always know where you stand relative to the field. Stop guessing. Start knowing.

The Daily Dispatch

A daily newsletter distilling the past two weeks of movement in a domain or two — delivered to your inbox while the index updates in the background.

AI Maturity by Domain

Each dot marks the weighted maturity of practices within a domain — hover for a brief summary, click for more detail

DOMAIN
BLEEDING EDGEESTABLISHED

Data pipeline, dashboard & report generation

LEADING EDGE

TRAJECTORY

Stalled

AI that generates data pipeline configurations and creates dashboards and reports from data sources. Includes automated ETL generation and chart/report creation from natural language; distinct from narrative generation which produces written explanations rather than visual outputs or pipeline code.

OVERVIEW

AI-assisted dashboard and pipeline generation has reached maturity on technical capability but remains constrained by organisational readiness. The tools demonstrably work: Meta processes 4 petabytes daily with AI-driven autoscaling, Walmart realised $5.6M annual savings through self-service analytics, and major enterprises (Capital One 16k+ users, Daiso 200 users across 40 dashboards) run production dashboards via natural-language queries and semantic layers. Yet this technical success masks a persistent adoption plateau. A peer-reviewed NBER survey of 6,000 executives found 80% of AI-adopting firms report zero measurable productivity impact, and Gartner 2026 data shows only 1 in 5 AI investments show measurable ROI despite 44% of organisations having implemented semantic layers. The barrier is not tooling but readiness: high-performing organisations allocate 60% of AI spend to data foundations (quality, governance, integration) rather than dashboarding tools. Logitech's experience exemplifies the paradox—a fully instrumented AI analytics program for 6,000 employees revealed usage metrics uncorrelated with business impact, forcing a shift to deletion-based measurement. Dashboard generation has reached feature parity; pipeline automation gains traction at scale (Trek Bikes 80% ETL acceleration, Nissan 50% timeline reduction). The defining tension remains whether organisations can sustain governance and data quality discipline required for production AI pipelines. This is a leading-edge practice where technical capability has measurably outrun organisational adoption readiness.

CURRENT LANDSCAPE

Dashboard and pipeline generation platforms have reached technical production parity in Q2 2026. AWS rolled out Amazon QuickSight Generate Analysis feature (May GA) generating multi-sheet production-ready dashboards from natural language in minutes; Databricks shipped AI/BI production GA with Genie spaces (natural language interface) and scheduled insights (automated recurring reports), complemented by Lakeflow Pipelines Editor with agentic code generation for ETL; GoodData announced production-ready dbt integration for automatic semantic layer generation from dbt models, signalling ecosystem consolidation around dbt as the transformation standard. Real-world deployments demonstrate measurable production gains: AWS's internal TARA analytics system (production-wide) achieved 48% query accuracy improvement and 90% latency reduction (2–3 minutes to 10 seconds) using semantic layers with conversational AI; Matillion's agentic pipeline generation (Maia) reduced ETL development from 40–50 hours to minutes for complex multi-source pipelines, with named deployments at consulting firm LTM; healthcare and financial services deployments showed 2.8x–10x productivity gains from LLM-assisted ETL and compliance automation.

Yet structural adoption barriers persist and widen. Gartner Data & Analytics Summit 2026 (248 data management leaders) found that organisations will abandon 60% of AI projects through 2026 due to insufficient data readiness—85% of failures cite data quality and only 12% of organizations possess data of sufficient quality for AI. Fivetran's 2026 benchmark (500 senior data leaders) revealed 97% report pipeline failures delay AI initiatives, 53% of data team time spent on maintenance, average 328 pipelines per enterprise, 73% reporting unmet ROI. Broader adoption assessment: only 7% of enterprises (Cloudera/HBR survey of 1,574 IT leaders) report completely AI-ready data, with 60% of initiatives abandoned due to foundational infrastructure gaps. A critical governance gap emerged: semantic layers validate schema and freshness but miss distributional shifts (e.g., upstream defaults silently invalidating filter logic), exposing data quality vulnerabilities in production. The practice remains technically leading-edge but operationally constrained by data readiness, integration complexity, and governance discipline required for production scale adoption.

Pipeline automation shows accelerating deployment with real-world examples: Walmart ($5.6M annual savings, 90% faster analysis), Trek Bikes (80% ETL acceleration), Nissan (50% timeline reduction), Meta (4 petabytes/day with AI autoscaling), and GroupBWT's production ETL serving 30+ cities from 7 heterogeneous sources with source isolation and 50% developer productivity gain. Yet critical blockers persist. Data fragmentation -- not tooling -- remains dominant: a Fortune 500 retailer faced 47 data silos requiring 23 manual exports before deploying AI. Industry-wide, 88% of AI agents fail to reach production, 60% of AI projects abandoned due to data quality issues, and 42% of US enterprises abandon before reaching production. Fivetran benchmark reveals operational overhead: 53% of data team time spent on maintenance, average 328 pipelines per enterprise, 73% report unmet ROI. Logitech's analytics infrastructure revealed that usage metrics (prompts, tokens, MAU) are uncorrelated with business value, requiring measurement discipline most organisations lack. High-performing firms allocate 60% of AI spend to data foundations (quality, governance, integration) rather than dashboarding tools—a maturity threshold most organisations have not reached. The vendor ecosystem ships continuously; the constraint is whether enterprise data estates possess sufficient governance, integration maturity, and measurement discipline to operationalise what vendors build.

TIER HISTORY

ResearchJun-2023 → Jul-2023
Bleeding EdgeJul-2023 → Jan-2024
Leading EdgeJan-2024 → present

EVIDENCE (93)

Amazon QuickSight Generate Analysis GAProduct Launches

— AWS announces GA of Generate Analysis feature: multi-sheet production-ready dashboards from natural language in minutes rather than hours, available across all AWS regions for Enterprise/Pro users.

— Major BI platform announces production-ready dbt integration: automatic logical data model and metrics generation from dbt models with Apache Arrow caching—ecosystem signal of semantic layer maturity.

— Databricks AI/BI production GA: Genie spaces (natural language interface), scheduled insights (recurring automated reports), unified pipeline and BI generation via Lakeflow Pipelines Editor.

— AWS internal case study: TARA technical analytics system deployed production-wide; 48% query accuracy improvement, near-zero failures, 90% latency reduction (2-3 min → 10 sec) using semantic layer + conversational AI.

— Production case study from consulting firm LTM: Matillion Maia AI reduces ETL pipeline development from 40-50 hours (10 tables) to minutes via metadata-driven framework and agentic generation.

— Cloudera/HBR survey of 1,574 IT leaders: only 7% report completely AI-ready data; 60% of AI projects abandoned due to foundational infrastructure gaps—quantifies readiness barrier beyond tool capability.

— Gartner Data & Analytics Summit 2026: 60% of AI projects will be abandoned through 2026 due to data quality; 85% of failures cite data infrastructure; only 12% have sufficient quality—critical negative signal.

— Pharma deployment: regulated RAG system (21 CFR Part 11, GDPR) built in 90 days with compliance agents; regulatory response 10 days → <2 hours; demonstrates AI-ready pipeline maturity for governed environments.

HISTORY

  • 2023-H1: Dashboard platforms achieved scale (8,000-petabyte deployments with measurable productivity gains). Semantic layers emerged as standardization mechanism (20k+ adoption). Automated ETL showed concrete ROI (4h to 40m) but LLM-assisted pipeline generation introduced accuracy risks requiring governance.
  • 2023-H2: Dashboard platforms continued maturation (QuickSight +80 features, Gartner Challenger status). Semantic layers validated as LLM infrastructure (83% accuracy with dbt). Vendor fragmentation and lock-in emerged as key adoption barriers, with ecosystem split between governance-first and self-service approaches.
  • 2024-Q1: Amazon Q in QuickSight achieved production-scale adoption at major enterprises (Capital One 16k+ users, GoDaddy subscription analytics, NFL/SRO Motorsports deployments). Microsoft ecosystem (Power BI, Fabric) integrated semantic layers. Critical gap identified: data quality issues causing $406M average annual losses despite high adoption confidence; 50% of organizations reporting LLM data hallucinations.
  • 2024-Q2: Semantic layer ecosystem consolidated with cross-platform integrations (dbt + Tableau, Cube + multi-vendor). AWS QuickSight Amazon Q GA announced. New category emergence: AI dashboard generators (Prototypr.ai). Practical LLM integration frameworks matured (semantic layer + LLM for hallucination reduction). Market skepticism grew regarding AI ROI and productivity claims; fundamental LLM limitations remained unaddressed despite widespread investment.
  • 2024-Q3: Dashboard adoption expanded significantly with enterprise-scale deployments (Amazon Logistics 30k+ users, Docebo 5x adoption increase via embedded dashboards). Semantic layers confirmed as matured infrastructure category (Cube named Leader in GigaOm Sonar for second consecutive year, September 2024). Pipeline automation vendors innovated with AI-assisted ETL (Matillion GA with generative AI), but category remained constrained by hallucination and governance risks. Market bifurcation crystallized: dashboard automation production-ready at scale for governed organizations; pipeline automation still blocked by accuracy challenges.
  • 2024-Q4: Dashboard competition intensified with Databricks entering generative BI market (November 2024) alongside AWS, Microsoft. Semantic layers transitioned to production with InterWorks/dbt white paper documenting real-world use cases (data portalization, monetization). Enterprise gen AI production adoption accelerated (75% of large orgs with use cases in production). Pipeline automation research validated AI's role in data quality (98% inconsistency reduction). Data quality and governance remained critical blockers despite vendor innovation and production adoption momentum.
  • 2025-Q1: AWS accelerated Amazon Q roadmap (scenario analysis GA with claimed 10x productivity gains, named customers Availity and BMW). Semantic layer ecosystem expanded with Cube integrating Power BI and Excel via DAX/MDX. Community adoption patterns emerged (dbt Semantic Layer + BI tool integrations). Critical blockers crystallized: data entropy and lack of determinism identified as core failure modes of AI-generated pipelines, shifting barrier from vendor capability to organizational adoption patterns.
  • 2025-Q2: Dashboard automation solidified with AWS launching Amazon Q embedded in QuickSight (April GA) and Looker releasing semantic layer features reducing GenAI errors 66% (May). dbt Labs shipped Power BI integration (beta) and dbt Copilot (GA). Critical adoption barriers emerged: 42% of companies abandoning GenAI pilots despite vendor innovation, only 25% of AI initiatives delivering ROI, and dbt Labs documented semantic layer implementation pitfalls (governance, performance, consistency). Vendor capability-maturity gap widened as technical solutions outpaced organizational readiness for production deployment.
  • 2025-Q3: Continued ecosystem maturation with new entrants (Onvo AI product GA for AI dashboard generation) and deepened semantic layer integrations (Sigma + dbt, Cube + AI). Critical findings crystallized: adoption barriers remained stubbornly structural—persistent low BI tool adoption (20-25% of employees despite decade of maturity) despite new AI capabilities; pipeline failures dominated by data fragmentation challenges (Fortune 500 case: 47 data silos requiring 23 manual exports) rather than tool limitations. Dashboard automation achieved production parity across vendors; pipeline automation remains blocked by organizational data complexity, not vendor features.
  • 2025-Q4: Semantic layer ecosystem stabilized with open-source MetricFlow release (dbt Labs, Apache 2.0) emphasizing metric governance and vendor interoperability; achieved 83% accuracy on natural language queries addressing core hallucination concerns. Critical adoption barriers persisted: 95% of AI pilots failed, $3.1T annual data quality costs documented; AI deployment delays averaged 6+ months; 57% of organizations reconsidering vendor-native semantic layer platforms due to lock-in; Zillow's $500M AI loss exemplified real project failures. Dashboard automation reached production maturity across vendors with consistent feature parity; semantic layer governance addressed technical hallucination risks but organizational adoption barriers (data quality, integration complexity, ROI realization) remained dominant constraints limiting broader category expansion.
  • 2026-Jan: Dashboard adoption continued with Daiso's multi-region QuickSight production rollout (200 users, 40 dashboards, 16M yen annual savings). Semantic layer market consolidation accelerated with 9+ vendors competing on ontology-driven infrastructure and AI readiness. Expert warnings persisted: Lloyd Tabb (Looker founder) cited fundamental semantic layer misunderstandings and AI-without-governance failures; industry analysis showed 88% of AI agents fail to reach production due to data fragmentation and integration complexity. Despite continued vendor innovation, organizational adoption barriers (data quality, integration, legacy infrastructure) remained the dominant constraint limiting dashboard and pipeline automation expansion.
  • 2026-Feb: Ecosystem integration accelerated with Omni + dbt Semantic Layer partnership enabling metric reuse, and Amazon Q in QuickSight product updates emphasizing natural language dashboarding. Critical ROI evidence emerged: peer-reviewed NBER study of 6,000+ executives showed 80% of AI-adopting firms report zero measurable productivity impact, with only 89% claiming labor productivity gains—quantifying widespread ROI realization gap across deployments. Enterprise adoption priorities shifted toward governance, integration, and proven outcomes; fewer than 30% of AI POCs reach production (Viva IT/Gartner). Semantic layer tool limitations documented: mainstream approaches like dbt Semantic Layer lack inference, multi-DB scope, and complex integrations (ontology comparison). Dashboard automation capability continued advancing via vendors, but organizational readiness and ROI realization remained the dominant adoption barriers constraining broader market expansion.
  • 2026-Mar: Production deployments documented concrete ROI at enterprise scale: Meta processes 4PB/day via AI-driven autoscaling, Walmart sustains $5.6M annual savings, and Trek Bikes achieved 80% ETL acceleration. Gartner 2026 data confirms 44% of organisations have implemented semantic layers with 92% adoption imminent, yet only 1 in 5 AI investments show measurable ROI. High-performing organisations allocate 60% of AI spend to data foundations rather than dashboarding tooling — reinforcing that governance and integration discipline, not vendor features, remain the binding adoption constraint.
  • 2026-Apr: Ecosystem maturity solidified with Databricks AI/BI production GA (Genie spaces + Unity Catalog semantic layer), Amazon Q in QuickSight achieving FedRAMP/HIPAA certification for enterprise deployment, and Thoughtworks positioning semantic layer at Trial tier — with cloud-native embedding (Snowflake Semantic Views, Databricks Metric Views) and open standardization (OSI v1.0) signalling vendor interoperability maturation. Real-world production deployments confirmed: a regional bank consolidated 7 legacy systems onto Databricks Lakehouse (44% faster insights, +31% fraud detection, -38% infrastructure costs); a pharma firm built regulated RAG pipelines in 90 days reducing regulatory response from 10 days to under 2 hours; Matillion LLM-assisted ETL (Maia + Bedrock) reduced healthcare survey processing from 4,000 hours/year to approximately 1 hour. Critical governance gap documented: semantic layers validate schema and freshness but miss distributional shifts, exposing silent production failures. Adoption barriers quantified: Fivetran benchmark reveals 97% report pipeline failures delay AI initiatives, 53% data team time on maintenance, 73% unmet ROI; industry data shows 60% AI project abandonment due to data quality, 42% of US enterprises abandon before production. Technical infrastructure matured; organizational adoption barriers remained binding constraint on category expansion.
  • 2026-May: Multiple GA releases confirmed production parity across the major cloud and BI platforms: Amazon QuickSight Generate Analysis reached GA generating multi-sheet dashboards from natural language across all AWS regions; Databricks AI/BI shipped Genie spaces, scheduled insights, and Lakeflow Pipelines Editor with agentic ETL generation; GoodData announced production-ready dbt integration with automatic semantic layer and metrics generation. AWS internal TARA deployment demonstrated 48% query accuracy improvement and 90% latency reduction using semantic layer with conversational AI. Matillion Maia reduced ETL pipeline development from 40–50 hours to minutes in named consulting deployments. Critical adoption barrier reinforced: Gartner Data & Analytics Summit 2026 confirmed 60% of AI projects abandoned due to data readiness gaps, with only 7% of enterprises reporting fully AI-ready data infrastructure. The practice remained technically leading-edge with accelerating vendor feature completeness, while organisational data readiness continued to constrain realised production adoption at scale.