Early Generative AI Projects Are Failing and What to Do About It


Your Weekly AI Briefing for Leaders

Welcome to your weekly AI Tech Circle briefing - What you need to know about Generative AI, without the noise!

I'm building and implementing AI solutions, and sharing everything I learn along the way...

Feeling overwhelmed by the constant stream of AI news? I've got you covered! I filter it all so you can focus on what's important.

Today at a Glance:

  • Early Gen AI projects are failing
  • Generative AI Use Case: Transform Customer Feedback into Product Insights
  • AI Weekly news and updates covering newly released LLMs
  • Courses and events to attend

xAI releases Grok-Code-Fast-1: A New Agentic AI for Speedy Coding

xAI, Elon Musk’s AI startup, launched Grok-Code-Fast-1, an agentic coding model designed for speed and efficiency. Built from scratch with programming-focused training data, this model excels at tool-driven coding flows, making rapid prototypes and iterative tasks feel nearly instantaneous. Launch partners, including GitHub Copilot, Windsurf, and Cursor, have early access, and xAI is initially offering unrestricted use to encourage adoption.

Why It Matters:

Grok-Code-Fast-1 is designed for real-world engineering speed, processing up to ~92 tokens per second with a response latency of around 67ms, which is an order of magnitude faster than most current models in coding tasks. Pricing as low as $0.20 per million input tokens and $1.50 per million output tokens (lower with cache) makes high-performance agentic AI accessible.

Early GenAI Projects Are Failing (95%): What to Do and How to Climb the Maturity Ladder

A recent report from MIT’s NANDA initiative, 'State of AI in Business 2025,' got my attention, and it is also widely being referred to in several publications.

This report has revealed a strange truth:

95% of generative AI pilot projects deliver no measurable ROI or P&L impact.

Only 5% of companies successfully scale pilots into business value.

And this is despite $30-40 billion in enterprise GenAI investment.
Failures aren’t about weak models or regulations, but about poor execution tools that don’t integrate, don’t learn, and don’t fit into workflows.

Adoption is high (80% of organizations have tried LLMs), but true transformation is rare.

Only 5% reach production.

Why Pilots Stall: The “Learning Gap”
Most GenAI tools lack memory, feedback loops, and adaptability.

Employees often turn to consumer tools like ChatGPT instead of “official” corporate systems.

This “shadow AI economy” refers to a scenario where nearly every employee utilizes AI, but not through company-initiated efforts.

What the 5% Get Right:

  • Workflow-first mindset: LLMs embedded into real processes.
  • Learning systems: AI that improves with feedback and memory.
  • External partnerships: Vendors that co-develop succeed more than internal builds.
  • Outcome focus: Measured in ROI (hours saved, costs reduced, retention gained).

Crossing the Chasm of Generative AI:
Three winning approaches:

  1. Buy rather than build.
  2. Empower line managers rather than central labs.
  3. Select tools that integrate deeply and adapt over time.

The most innovative organizations are already testing agentic systems that can learn, remember, and act independently within set boundaries.

What To Do: Apply the GenAI Maturity Model

This is where the GenAI Maturity Model becomes a practical roadmap:

  • Level 1 – Aware: Run experiments, but don’t confuse pilots with strategy.
  • Level 2 – Exploring: Select high-value pilots with clear ROI metrics. Avoid vanity use cases.
  • Level 3 – Operational: Ensure tools integrate into workflows with feedback loops.
  • Level 4 – Integrated: Expand across functions, balancing human oversight and AI autonomy.
  • Level 5 / 6 – Autonomous / Transformative: Use agentic AI with persistent memory, adaptive learning, and orchestration across processes.

Call to Action:

The maturity framework helps executives identify their current position and chart their next steps. Instead of chasing hype, it creates a disciplined path from pilots to production.

Leaving it to you to share your feedback, views, how you are doing it, and what you are learning from the early projects.

Gen AI Maturity Framework:

A few more updates have been made to GenAIMaturity.Net, and you can try out Maturity Assessments. This entire portal is vibe-coded, and content is being reviewed and added frequently.

Top Stories of the Week: Microsoft Unveils First Homegrown AI Models: MAI-Voice-1 & MAI-1-Preview

Microsoft introduced two in-house models under its new MAI initiative:

  • MAI-Voice-1: Speech model generating 1-minute audio in <1 second on a single GPU.
  • MAI-1-Preview: General-purpose text model trained across 15,000 H100 GPUs, now public for testing.

Why It Matters: Microsoft’s move reduces reliance on OpenAI. By owning both speech and text foundation models, Microsoft gains control over performance, features, and innovation cycles, paving the way for tighter OS-level integration of GenAI.

The Cloud: the backbone of the AI revolution

  • Use OpenAI's Open Weight Models in OCI Data Science's No-Code Interface source
  • How Do You Teach an AI Model to Reason? With Humans source

Generative AI Use Case of the Week:

Several Generative AI use cases are documented, and you can access the library of generative AI Use cases. Link

Transform Customer Feedback into Product Insights

Business Challenges:

  • Feedback is scattered across channels.
  • Manual reading is slow and misses signals.
  • Teams argue priorities without evidence.
  • Survey responses are short and have low signal.
  • Monthly/quarterly insight cycles.

AI Solution:

  • Aggregate reviews, tickets, surveys, posts.
  • LLMs cluster by feature/severity, with sample quotes.
  • Weekly briefs: top 5 issues, root cause hints, links.
  • Smarter follow-ups increase detail.
  • Push issues to the backlog, track resolution over time.

Impact:

  • Revenue: Faster fixes, higher retention, NPS gains.
  • User Experience: Clearer priorities, faster relief.
  • Operations: Analysts validate insights, not read raw text.
  • Process: Standard briefs align teams.
  • Cost: Lower manual review, fewer misdirected builds.

Data Sources:

  • Product reviews and app store comments.
  • Support tickets, chat logs, and email threads.
  • Survey responses from customer experience tools.
  • Community forums and social posts, where permitted by policy.
  • Product catalog, feature map, and release notes for mapping.

Strategic Fit:

This use case creates a continuous link between customers and the roadmap. It supports faster learning cycles and evidence-based decisions. It strengthens transparency with linked verbatim in every insight.

Favorite Tip Of The Week:

Coding with LLMs

Anthropic's Boris Cherny, Claude Code, and Alex Albert discuss the current and future state of agentic coding, the evolution of coding models, and the design of Claude Code's "hackability."

video preview

Potential of AI:

Gemini 2.5 Flash Image: Google introduces Gemini 2.5 Flash Image, an image generation and editing model with multi-image fusion for consistency across sequences and storytelling, suitable for product scenes, explainers, and avatars. All outputs carry SynthID invisible watermarking for provenance.

Things to Know...

Experimentation Trap
Harvard Business Review warns that many teams are stuck in an AI experimentation trap, where scattered pilots do not tie to real outcomes. The fix is simple and strict. Fund fewer use cases and wire each one to an operating metric such as adoption, cycle time, unit cost, or error rate. Build for production from day one with workflow integration, change management, and human review, and keep a shared platform for data connectors and guardrails to avoid one-off builds. Replace demo metrics with audit-ready measures and use pass or kill rules on a fixed cadence. These steps turn pilots into durable value and help cut through the current skepticism around generative AI.


Design for Handovers, Not Just Automation

Most failed GenAI pilots share the same flaw: they try to automate everything, but forget the handover points where humans and AI must work together.

What to Do:

  • Map where AI stops and humans pick up (approvals, judgment calls, escalations).
  • Add structured outputs (summaries, logs, confidence scores) so humans know precisely what the model did.
  • Treat the system as an assistant, not a black box.

Why It Works:

By designing for clean human-AI transitions, businesses reduce friction, avoid compliance issues, and build trust.

The Opportunity...

Podcast:

  • This week's Open Tech Talks episode 163 is "Building Conversational AI Chat Agents with Yam Marcovitz". He is the co-founder and CEO of Parlant, an open-source platform that enables enterprises to build reliable, compliant, and predictable AI agents.

Apple | Amazon Music

show
Building Conversational AI C...
Aug 23 · OPEN Tech Talks: Technol...
31:13
Spotify Logo
 

Courses to attend:

  • CS324 - Large Language Models from Stanford. In this course, students will learn the fundamentals of modeling, theory, ethics, and systems aspects of large language models, as well as gain hands-on experience working with them.
  • Introduction to Deep Learning from MIT. In this course, Students will gain foundational knowledge of deep learning algorithms, practical experience in building neural networks, and an understanding of cutting-edge topics, including large language models and generative AI.

Events:


Tech and Tools...

  • WhisperLiveKit: Real-time speech transcription directly in your browser, with a ready-to-use backend and server, and a simple frontend.
  • Koog is a Kotlin-based framework designed to build and run AI agents entirely in idiomatic Kotlin. It enables you to create agents that can interact with tools, manage complex workflows, and communicate with users.

The Investment in AI...

  • Augment Secures $85 Million in Series A Funding to Improve AI Logistics Assistant “Augie”
  • Euclid Power raises $20M in Series A funding to accelerate renewable energy projects with its AI-driven platform and services.

That’s it for this week - thanks for reading!

Reply with your thoughts or favorite section.

Found it useful? Share it with a friend or colleague to grow the AI circle.

Until next Saturday,

Kashif


The opinions expressed here are solely my conjecture based on experience, practice, and observation. They do not represent the thoughts, intentions, plans, or strategies of my current or previous employers or their clients/customers. The objective of this newsletter is to share and learn with the community.

Dubai, UAE

You are receiving this because you signed up for the AI Tech Circle newsletter or Open Tech Talks. If you'd like to stop receiving all emails, click here. Unsubscribe · Preferences

AI Tech Circle

Learn something new every Saturday about #AI #ML #DataScience #Cloud and #Tech with Weekly Newsletter. Join with 278+ AI Enthusiasts!

Read more from AI Tech Circle

Your Weekly AI Briefing for Leaders Welcome to this week’s AI Tech Circle briefing, clear insights on Generative AI that actually matter. I’m building and implementing AI solutions every day, and this space is where I share what works, what doesn't, and what’s worth your attention. If the flood of AI news feels overwhelming, relax, I’ve already done the filtering. You’ll find only the updates, ideas, and experiments that truly move the needle. Today at a Glance: Turning Insight into Action...

Your Weekly AI Briefing for Leaders Welcome to your weekly AI Tech Circle briefing - What you need to know about Generative AI, without the noise! I'm building and implementing AI solutions, and sharing everything I learn along the way... Feeling overwhelmed by the constant stream of AI news. I've got you covered! I filter it all so you can focus on what's important. Today at a Glance: When Agents Forget How to Build Context-Aware Memory Generative AI Use Case: Municipal Government Department...

Your Weekly AI Briefing for Leaders Welcome to your weekly AI Tech Circle briefing - What you need to know about Generative AI, without the noise! I'm building and implementing AI solutions, and sharing everything I learn along the way... Feeling overwhelmed by the constant stream of AI news. I've got you covered! I filter it all so you can focus on what's important. Today at a Glance: When Agents Forget How to Build Context-Aware Memory Generative AI Use Case: AI-enabled Sales Assistant for...