The AI landscape doesn't move in one direction — it lurches. Some techniques leap from experiment to table stakes in a single quarter; others stall against regulatory walls, technical ceilings, or organisational inertia that no amount of hype can dislodge. Knowing which is which is the hard part. The State of Play cuts through the noise with a rigorously maintained index of AI techniques across every major business domain — classified by maturity, evidenced by real-world adoption, and updated daily so you always know where you stand relative to the field. Stop guessing. Start knowing.
A daily newsletter distilling the past two weeks of movement in a domain or two — delivered to your inbox while the index updates in the background.
Each dot marks the weighted maturity of practices within a domain — hover for a brief summary, click for more detail
AI that summarises long email threads, extracts key decisions and open questions, and highlights action items. Includes thread digest generation and decision extraction; distinct from email triage which prioritises rather than summarises.
Email thread summarisation is now a standard feature across every major productivity platform -- Google (3B users), Microsoft (enterprise), Apple, and specialists like Superhuman (50K+ users). Real deployments demonstrate measurable productivity gains: Microsoft's trial of 6,000+ workers showed 18% reduction in email reading time; enterprise teams report 15–20 hours/week saved within 60 days; shared-inbox automation reaches 70% coverage. Yet no enterprise treats unreviewed output as authoritative. Foundational hallucination mechanisms persist: models collapse knowledge-belief boundaries in multi-speaker contexts, miss action items until preprocessing intervenes (4.2/week baseline), and fabricate at 75% rates in multi-document summaries. Security vulnerabilities (white-text injection, exfiltration) and governance gaps (DLP bypass) require organizational guardrails. Research shows hallucination detection at 50% accuracy and automated evaluation metrics misaligned with ground truth. That gap between "deployed-at-scale convenience" and "operational truth" defines this leading-edge practice: teams extract real value with explicit human oversight, data preprocessing, and governance controls, while broader adoption remains constrained by systematic reliability and security limitations that prevent blind trust.
The vendor landscape has consolidated around platform defaults at unprecedented scale. Google Workspace Intelligence (GA April 2026) delivers AI Overviews in Gmail to 3 billion users with 13 million paying business customers, synthesizing thread content to answer natural language questions ("What was decided?" "When is the next meeting?"); rollout is automatic for Business and Enterprise plans. Microsoft 365 Copilot for Sales (GA April 2026) integrates email and conversation summarization across Outlook on all platforms (web, Windows, Mac, iOS, Android) with voice-driven mobile summaries. Both charge $7-18 per user monthly. Superhuman occupies the specialist tier claiming 4+ hours per week saved, with 50,000+ paying users and a $825M valuation. Google has added administrative dashboards for tracking adoption -- enterprises are now managing rollout as standard feature, not experimenting.
Productivity gains are measurable but carry operational costs. A real-world shared-inbox deployment achieved 70% triage automation with multi-agent architecture; Google Workspace adoption data shows 200% AI add-on install growth (2023–2025). Microsoft's trial documented half an hour saved weekly; enterprise-scale deployments report 15–20 hours/week time savings within 60 days for dedicated teams. However, constraints are systemic. Stanford's 2026 AI Index documents knowledge-belief distinction failures where models collapse the boundary between fact and confident false assertion—in email contexts where participants assert false claims, summarizers hallucinate with higher confidence. A fintech support team found its summariser missed 4.2 urgent action items weekly until data preprocessing pushed recall to 98%. Microsoft Copilot bypassed DLP policies and sensitivity labels, summarizing confidential emails that governance controls were supposed to block. Gemini's email summarization was vulnerable to white-text prompt injection attacks allowing phishing hijack on 3B users. NAACL 2025 research found hallucination detection at 50% accuracy, and 75% of multi-document summaries contain fabrication. Research on evaluation metrics (April 2026) shows automated scores misaligned with ground truth—organizations cannot confidently validate summary quality without human review. The market at $1.2B growing 21.5% CAGR signals category-level adoption, but enterprises deploying at scale require explicit human oversight, data preprocessing, and governance guardrails. Regulatory bodies (FINRA) now mandate hallucination-catching procedures for financial services deployments—the practice is standard but not trusted for unreviewed operational use.
— Stanford HAI authoritative analysis documenting structural hallucination failures (knowledge-belief distinction collapse) relevant to email summarization in multi-speaker contexts.
— Direct evidence of email thread summarization deployment in Google Workspace. Reports security vulnerability in Gemini email summaries where hidden prompt injections in white/invisible text are executed during summary generation. Demonstrates practice is live and in production at scale.
— Official Microsoft documentation for Copilot for Sales in Outlook explicitly describing email and conversation summarization capabilities as core product features, demonstrating GA-level maturity of email thread summarization in production.
— Detailed analysis of actual Workspace AI adoption patterns; reports 200% growth in AI add-on installs (2023–2025), identifies Gmail as highest-adoption surface, describes third-party tool preference for customization among high-volume roles.
— Official Google Cloud Next announcement covering Workspace Intelligence and AI Overviews in Gmail for email thread synthesis; cites 3B users, 13M paying customers, and 110M monthly Meet users for Take Notes.
— Real-world deployment case study showing 70% automation of email triage with specific architectural approach, outcomes, and platform reuse model across multiple mailboxes.
— Peer-reviewed research introducing GIRB (Group Isotonic Regression Binning) calibration method for improving reliability of evaluation metrics; addresses misalignment between proxy scores and ground-truth quality scores across summarization tasks.
— Explicitly addresses email thread summarization and key message extraction: 'Outlook: Copilot summarizes long email threads and drafts professional responses. It can also prioritize your inbox by surfacing key messages.'
2023-H1: Microsoft launched email summarisation in Viva Sales GA; Superhuman released beta summarisation features. Research showed conversation-dynamics summarisation improves downstream prediction tasks. Adoption obstacles centred on data quality, privacy, and accuracy validation needs.
2023-H2: Microsoft expanded Sales Copilot email summarization across Azure regions (GA August 2023). Google released Gemini in Gmail with native email thread summarization (December 2023). Research quantified hallucination rates: ChatGPT 0.62 per summary, GPT-4 0.84, Claude 2 1.55. Law firm experiment with GPT-4-powered case summarization failed; technology not yet reliable for nuanced summarization. Sales adoption of AI reached 95%, though email summarization remained secondary to core selling tasks.
2024-Q1: Microsoft expanded Copilot email summarization into Dynamics 365 Service (case-related emails, GA April 2024) and continued Outlook rollout across markets. Google One AI Premium plan (February 2024) added Gemini-powered email summarization. New vendor Shorton AI launched as free Gmail add-on. Practitioner feedback highlighted persistent tone loss and limited prompt-engineering effectiveness, despite broad platform availability.
2024-Q2: Google Gemini in Gmail side panel reached GA (June 2024) with native "Summarize an email thread" feature; Pipedrive integrated AI email summarization into CRM. ACL 2024 research identified "Circumstantial Inference" hallucinations as systematic failure mode in LLM dialogue summarization. Researchers proposed hybrid approaches to reduce hallucinations, but solutions remained incomplete. Real-world deployments (Microsoft 365, Pipedrive, Google Workspace) progressed, yet practitioners continued to treat AI summaries as secondary aids rather than primary information sources due to unresolved reliability concerns.
2024-Q3: Gmail Gemini email summarization rolled out to mobile apps (July 2024) extending platform coverage. Microsoft Copilot for Service email summarization documentation (September 2024) publicly acknowledged limitations and emphasized human review requirements. New research identified additional failure modes: ACL 2024 published fine-grained hallucination evaluation metrics (ACUEval) showing correction strategies improve faithfulness by 10%+, and preprint research revealed hallucinations concentrate at end of long summaries. Apple Intelligence email summarization entered beta with mixed user feedback citing widespread inaccuracies and usability concerns, despite vendor polish. The market remained split: major platforms continued rapid feature rollout while simultaneously documenting limitations, and practitioners maintained skepticism about reliability.
2024-Q4: Vendor momentum continued through year-end: Google expanded Gemini email summarization via Workspace Labs (early-access testing, December 2024), Superhuman announced Auto Summarize expansion with positive user testimonials on productivity gains (October 2024), and Microsoft maintained Copilot email summarization support across regions. Research progress on hallucinations accelerated: new Entity Hallucination Index (EHI) preprint demonstrated quantifiable improvements in reducing hallucination rates without degrading fluency. However, real-world deployment challenges persisted: Apple Intelligence email summarization experienced widespread failures (November 2024) with inconsistent performance and error messages ('Unable to summarize'), highlighting the gap between vendor claims and production-ready reliability. The practice remained at "leading-edge" maturity: platforms treated email summarization as a standard feature, but users continued to require human review due to unresolved hallucination and consistency issues.
2025-Q1: Empirical validation emerged alongside new adoption barriers. Microsoft's randomized controlled trial of 6,000+ workers across 56 firms (Dillon et al., 2025) provided quantitative evidence of real-world impact: Copilot users reduced time reading email by 18%, saving over half an hour weekly, with email summarization cited as a key mechanism. This large-scale deployment study demonstrated that email summarization could drive measurable productivity gains when integrated into enterprise workflows. Simultaneously, limitations surfaced: Apple Intelligence email summarization continued to generate false summaries (BBC documented cases of hallucinated news content, January 2025), and Google's AI email features prompted privacy analysis warning of user profiling risks for 1.8B Gmail users. Email marketers identified downstream effects: AI summaries in Apple Mail, Gmail, and Yahoo were forcing design changes (front-loaded content, stronger subject lines) and potentially reducing open rates and click-through rates. Superhuman's continued growth (50,000+ paying users, $825M valuation) demonstrated the viability of specialized email summarization tools beyond major platforms. The practice at window-end remained "leading-edge"—email summarization was standard in enterprise email, measurably beneficial for power users, yet still constrained by accuracy concerns and privacy considerations affecting broader adoption.
2025-Q2: Research intensified focus on hallucination quantification and mitigation. NAACL 2025 peer-reviewed research (April-May 2025) documented systematic failures: up to 75% of multi-document summary content is hallucinated, with concentration at end of summaries; state-of-the-art hallucination detection models achieve only 50% accuracy on FaithBench benchmark. Vendor documentation became more transparent: Microsoft updated Copilot for Sales email summarization FAQs acknowledging limitations ("algorithm may occasionally overlook important details"). Vendor expansion continued: Microsoft maintained cross-platform Outlook Copilot email summarization (web, Windows, Mac, iOS, Android), Google expanded Gemini in Gmail access via Workspace Labs, Superhuman continued market growth. The practice bifurcated: enterprises deployed email summarization as standard feature with managed expectations (human review required), while the research community documented persistent faithfulness hallucinations as foundational limitation. Email summarization remained leading-edge—ubiquitous in platforms, measurably productive for users, yet constrained by systematic hallucination rates that demanded human oversight.
2025-Q3: Hallucination research and real-world deployment risks dominated the landscape. Harvard Kennedy School published a framework analyzing hallucinations as a new form of misinformation (August 2025), while OpenAI released research (September 2025) demonstrating that hallucinations are fundamental to model training and occur even with "perfect data." Vendor expansion accelerated: Google rolled out Gemini instant summarization for Drive folders and files at scale (September 2025), signaling multi-document summarization maturity. The competitive specialized tool market solidified with side-by-side analysis of Superhuman and Shortwave clients, both offering email summarization with claimed time savings (4 hours/week vs. 45% faster inbox zero). However, security risks surfaced: a critical prompt-injection vulnerability in Gmail Gemini summarization (July 2025) demonstrated that malicious actors could embed hidden commands generating fake phishing summaries, exposing 2 billion Gmail users. Practitioner analysis (Evolution AI) synthesized research confirming that hallucinations persist as a "severe and persistent limitation" across applications including email summarization, with 17-33% hallucination rates in specialized legal tools. The practice remained at leading-edge maturity, with broadening vendor adoption and measurable productivity gains, yet increasingly constrained by documented security vulnerabilities and persistent, fundamentally-rooted hallucination rates that required human oversight and organizational trust thresholds.
2025-Q4: Deployment maturity and operational limitations became the defining tension. Superhuman published detailed case study (October 2025) demonstrating 3+ hours/week productivity gains and 2x inbox speed improvements in production deployment, validating real-world ROI. Market research (October 2025) valued email thread summarization market at $1.2B with 21.5% CAGR projection to $6.7B by 2033—strongest adoption signal to date. Vendor ecosystem remained robust: Google Workspace Labs continued Gemini email summarization expansion, Microsoft maintained cross-platform Copilot support across Outlook, and competitive specialists Superhuman and Shortwave gained customer traction with summarization differentiation. However, operational constraints intensified: FINRA's December 2025 regulatory report identified summarization as top gen AI use in financial services but mandated hallucination-catching procedures, indicating firms were deploying at scale despite reliability concerns. Practitioner analysis (Alibaba, December 2025) documented persistent action-item extraction failures—systems collapsed detailed deliverables into vague phrases, undermining precision in high-stakes contexts. Security risks remained unresolved: red team analysis identified prompt-injection vulnerabilities in email summarization agents enabling credential theft and fake phishing summary generation. By year-end, email thread summarization had matured from "emerging capability" to "deployed standard feature," yet remained fundamentally constrained by hallucination rates, precision gaps, and security vulnerabilities that required organizational trust thresholds and human-in-the-loop review. The practice remained at leading-edge maturity: measurably beneficial for power users, standard in enterprise platforms, but with unresolved reliability and security limitations preventing transition to mainstream adoption without guardrails.
2026-Jan: Vendor momentum accelerated with new capabilities despite ongoing reliability constraints. Microsoft released Copilot in Outlook with interactive voice experience for summarizing unread emails (GA rollout iOS January, Android February 2026). Google deployed Gemini AI Overviews in Gmail targeting 3 billion users, enabling automatic email thread summarization answering "What was decided?" with inline citations. Superhuman reached GA for Auto Summarize feature with productivity claims of 4+ hours/week saved. However, security and reliability concerns persisted: Superhuman's summarization feature exposed a critical zero-click prompt injection vulnerability enabling email exfiltration of 40+ messages; a real-world case study (Veridia Labs support operations) documented systematic action-item extraction failures in production until data hygiene preprocessing was applied, achieving 98% recall after intervention. Hallucination research analysis showed mixed progress: controlled summarization benchmarks improved to 0.7–1.5% hallucination rates by end 2025, but complex reasoning tasks remained high at 33-51%, with RAG mitigation offering 40-71% improvements. By month-end, email thread summarization remained at leading-edge maturity: standard vendor feature across major platforms with quantified productivity benefits, yet constrained by persistent security vulnerabilities, action-item extraction precision gaps, and hallucination rates requiring organizational human oversight and controlled deployment.
2026-Feb: Vendor platform maturity and governance failures defined the landscape. Google released administrative reporting for Gemini feature adoption tracking in Workspace (February 2026), enabling enterprise governance and usage monitoring. Superhuman continued market expansion with tutorial content citing industry research showing 336% ROI from AI email assistants. Deployment landscape broadened: comparative analysis showed Gmail Gemini and Outlook Copilot becoming default email summarization features in enterprise platforms ($7–$18 per user monthly). However, critical governance issues surfaced: Microsoft Copilot breached DLP policies and sensitivity labels, summarizing confidential emails for weeks despite data protection controls (February 2026), exposing fundamental reliability gaps in vendor-implemented guardrails. Operational precision limitations persisted: analyses documented systematic action-item extraction failures in production deployments, with fintech case study showing 4.2 missed urgent items weekly until data-hygiene preprocessing intervened, achieving 98% recall. By month-end, email thread summarization remained at leading-edge maturity: widespread platform adoption with proven productivity benefits, yet increasingly constrained by documented governance failures, security incidents, and unresolved action-item extraction precision gaps that reinforced organizational reliance on human review and data preprocessing.
2026-Mar: Regulatory adoption confirmation and critical failure visibility advanced tier-classification signals. FINRA's March 2026 Oversight Report identified email summarization as the top GenAI use case among regulated member firms, confirming widespread production deployment in high-stakes environments and category-level adoption. Empirical deployment validation emerged: Alibaba's 12-tool testing (March 2026) with named professionals showed measurable ROI (healthcare team achieved 22-min to 12.9-min daily triage time reduction), and SupportLogic case study documented named enterprises (Coveo, Certinia, Informatica) achieving 31–53% MTTR improvements in production support workflows. TechCrunch evaluated Gemini email summarization as standout productivity feature with measurable user value. However, critical failure patterns intensified: practitioner analysis documented a £2.1M FCA fine (March 2026) where summarizer's context collapse (omitted "pending confirmation" qualifier) eliminated evidence of deliberate escalation pause, revealing that current tools are inadequate for regulated workflows without substantial reconfiguration. Security research (Permiso, March 2026) documented cross-prompt injection vulnerability in Copilot allowing malicious summaries to spoof security alerts. These March signals reinforced the defining tension: email summarization is now standard deployed feature across major platforms with measurable enterprise ROI for compliant teams, yet requires explicit human review, data preprocessing, and governance guardrails—making it firmly leading-edge rather than mainstream, with adoption constrained by systematic context-loss failures, security vulnerabilities, and regulatory compliance demands that prevent blind trust.
2026-Apr: Vendor ecosystem maturity and critical platform reliability gaps dominated the window. Google Cloud partner Cloud Ace published 128 named customer case studies (April 2026) demonstrating broad Gemini Workspace adoption with specific email thread summarization benefits: Mark Cuban's Cost Plus Drugs achieved 5 hours/week per employee, Sami Saúde realized 13% productivity increase, Geotab hit 89% adoption (2,300 employees, 40 queries/person/day), and Docusign pilot showed 80% positive impact with 67% gaining 1–4 hours weekly—strongest tier-1 evidence of category-level production deployment and ROI validation. Specialized tools matured: REM Labs Morning Brief demonstrated production email thread analysis extracting action items, deadlines, status updates, with overnight synthesis cross-referencing 90-day history and calendar/Notion integration. Google's official governance statement (April 2026) reaffirmed that Gemini in Gmail performs isolated email summarization with no model training on personal emails and no data retention—confirming organizational readiness for enterprise rollout. A named 40-person firm deploying Microsoft 365 Copilot reported 15–20 hours/week time savings from email summarization within 60 days; Microsoft 365 Copilot reached 50% enterprise adoption with email summarization cited as the most-used feature (78% of users, 45 min/day saved). However, platform reliability cracks widened. Apple Intelligence email/notification summarization (iOS 26.4) produced widespread failures: tone/context misreading (sarcasm misinterpretation), missed key information on complex text, and non-idiomatic tone rewrites, with users forced to disable the feature entirely. MacRumors documented the failures and subreddit failures showing systematic quality gaps versus online models. Gmail's Gemini summarization (available to 3B+ users) relied on scanning only the first 140-200 chars, causing widespread user opt-outs to disable summaries due to content omission risks despite massive deployment. Technical analysis (Neuriflux, Metrivant) documented how hallucination types (factual, reasoning, citation) and classification opacity concentrate at summary boundaries without source attribution, creating adoption barriers for compliance teams. Wharton research on cognitive surrender found 80% user acceptance of AI errors—a structural risk when users trust summarizer output without verification. Apple's Writing Tools ecosystem risk emerged: seamless ChatGPT integration exposed proprietary emails to training data risk, forcing enterprise governance decisions. Industry adoption milestone: DMA's 2026 Email Tracker reported that AI email summarization (Gmail, Outlook) is now standard platform feature, requiring practitioners to design email composition for AI summarization as mainstream practice. By window end, email thread summarization demonstrated category-level vendor ecosystem maturity with quantified enterprise ROI across multiple verticals, yet simultaneously exposed critical vendor reliability gaps, platform-specific accuracy failures, and user trust dynamics requiring organizational reconfiguration and continued human oversight.
2026-May: Continued platform maturity with reinforced evidence of leading-edge constraints. Google announced Workspace Intelligence at Cloud Next 2026 (April 22), integrating AI Overviews in Gmail to synthesize thread content across 3B users with 13M paying business customers, signaling platform-level feature maturity and scale. Microsoft 365 Copilot for Sales (April 23) confirmed email/conversation summarization as GA feature in production Outlook across all platforms. Real-world deployment case study (Thoughtwave Software & Solutions, April 2026) documented 70% email triage automation on production shared mailbox with multi-agent architecture. Google Workspace adoption analysis revealed 200% growth in AI add-on installs (2023–2025) with Gmail as highest-adoption surface. However, critical reliability limitations persisted: Stanford HAI's 2026 AI Index (May 1) documented knowledge-belief distinction failures in hallucination where models collapse the boundary between fact and confident false assertion—directly applicable to multi-speaker email contexts where participants assert false claims. Security vulnerability in Gemini email summaries (April 24) demonstrated white-text prompt injection allowing malicious actors to hijack summaries for phishing; fixes required governance overhead. Research on evaluation metrics (April 2026) highlighted misalignment between automated evaluation scores and ground-truth quality, a barrier to confidence in summary validation. By window end, email thread summarization remained firmly leading-edge: major vendors shipping at scale with quantified ROI, enterprises deploying across verticals, yet constrained by systematic hallucination mechanisms, security vulnerabilities requiring organizational guardrails, and evaluation metric unreliability that prevents operational trust in unreviewed outputs.