New: The Day the Ship Date Stopped Moving, the last post in our Day Two series.New: The Day the Ship Date Stopped Moving. Read the post

Skip to main content

The Day the Ship Date Stopped Moving

BlogDay Two
Post 6 of 6

Thread AI Editorial · November 10, 2026

An established life sciences consultancy is preparing to roll out its first AI product for a longtime client. Near the top of the project plan sits the launch date the firm promised, crossed out and rewritten three times in a year, with a short note beside each change.

The first note mentions a question about records FDA inspectors might ask to see. The second points to a security review. The third cites a finding from the client’s audit team.

The agent is designed to speed up the consultancy’s core work, supplier qualification for mid-sized pharmaceutical and medical device companies. Before a client works with a new supplier, the firm checks supplier audit reports, certifications, and quality records against the client’s requirements. The firm’s reviewers then recommend to the client whether to work with the supplier.

The review work had been piling up for the longtime client, which asked whether AI could help clear the backlog. The consultancy built an agent that reads each supplier’s documents against that client’s requirements and drafts a recommendation for a reviewer from the firm to check. The prototype ran on a capable open-source framework and was working within a few weeks.

Early results were promising enough that the firm saw a bigger opportunity to turn its supplier review playbook into a product. Every client needs some version of this review, so the same product could serve all of them, with the firm’s reviewers still making the final calls.

Years of client work, turned into one product.

Years of client engagements
The firm’s review
playbook
The product
Supplier review
agent
The firm’s reviewers
Make final supplier
recommendations
Client A
Client B
Client C
Client D
Every new
client
  1. Years of client engagements
  2. The firm’s review playbook
  3. The productSupplier review agent
  4. The firm’s reviewersMake final supplier recommendations
  5. Client AClient BClient CClient DEvery new client

The work fell to experts in supplier quality who had never built or run an AI product. The prototype came together in a few weeks, so 12 weeks to launch seemed like plenty. But a product the client would use every day, and that the firm hoped to sell to others, had to answer to the client’s quality team, security reviewers, and auditors. Critical questions, like what records the agent should keep or how a reviewer would sign off on a recommendation, dragged on for weeks.

Three Notes, One Question

As the timeline slipped, notes started appearing on the plan. After the third slip, a managing partner read the notes side by side to understand what went wrong.

The first note came from the client’s quality team, which wanted to know what approval records would show FDA inspectors about the agent’s role in each recommendation. The prototype kept no history, so no one could tell the agent’s draft from the reviewer’s edits, and the ship date moved for the first time.

The second note came from the client’s security team, which wanted proof that the documents the agent read didn’t come from another client, since several of the firm’s clients compete. With no log of the documents the agent pulled, the firm had nothing to show, and the date moved again.

The third note came from the client’s audit team, which asked the firm to prove each recommendation used the requirements in effect at the time. The prototype didn’t track which version of the requirements the agent used, so the date had to move a third time.

Read one at a time, each note looked like a contained fix. Read together, they showed three different groups asking the same thing: “What did this agent do, and why?”

The List Between You and the Date

To answer the three notes, the firm had to build what the prototype skipped, including a record of every draft and edit, document logs, data isolation, and version tracking. This work required an engineering budget, a hiring plan, and specialized engineers the firm had never needed before.

All told, building the agent took weeks. Building the infrastructure around it took quarters.

The open-source framework behind the prototype did its job. Tools like it give teams what they need to build an agent, and they leave the record-keeping, data separation, and version tracking for each team to handle on its own.

Every question sent the team back to build.

01 · SupplierSupplier documents arrive
No log of which documents were read
02 · AgentChecked against the client’s requirements
Requirements version not tracked
03 · AgentRecommendation drafted
Agent’s draft not saved on its own
04 · Human in the loopReviewer checks and edits
No way to tell the reviewer’s edits from the agent’s draft
05 · ClientQuality team gives final approval
No defined sign-off on the record
Launch date
May 14
June 6
August 12
October 30
  1. 01 · SupplierSupplier documents arriveNo log of which documents were read
  2. 02 · AgentChecked against the client’s requirementsRequirements version not tracked
  3. 03 · AgentRecommendation draftedAgent’s draft not saved on its own
  4. 04 · Human in the loopReviewer checks and editsNo way to tell the reviewer’s edits from the agent’s draft
  5. 05 · ClientQuality team gives final approvalNo defined sign-off on the record
  6. ?Launch dateMay 14June 6August 12October 30

The consultancy knows exactly what the agent needs to do, which makes it easy to plan. The launch date slips when the list of unplanned work keeps getting longer. That list grows fastest around governance, because each client brings its own quality team, security team, and auditors, and any of them can ask what the agent did and why.

This pattern reaches well beyond life sciences. Thread AI’s analysis of enterprise AI buying conversations, published as The AI Ship Date Dilemma, found that only 5% had a dated, external commitment to ship with AI. The research traces that hesitation to the work of getting to production, which runs larger and more complex than teams first expect.

One Date, Nothing Beside It

The life sciences consultancy eventually moved the agent onto infrastructure built to run it as a true product for multiple clients, without staffing up like a technology company. Now every recommendation carries its own record. The client’s quality team can show an FDA inspector what the agent drafted and what the reviewer changed, security reviewers can see the documents behind it, and auditors can see which requirements it was checked against.

Every question answered from a single record.

01 · SupplierSupplier documents arrive
Documents logged, this client’s only
02 · AgentChecked against the client’s requirements
Requirements version linked
03 · AgentRecommendation drafted
Agent’s draft saved
04 · Human in the loopReviewer checks and edits
Reviewer’s changes saved beside the draft
05 · ClientQuality team gives final approval
Approval recorded
LaunchOctober 30
  1. 01 · SupplierSupplier documents arriveDocuments logged, this client’s only
  2. 02 · AgentChecked against the client’s requirementsRequirements version linked
  3. 03 · AgentRecommendation draftedAgent’s draft saved
  4. 04 · Human in the loopReviewer checks and editsReviewer’s changes saved beside the draft
  5. 05 · ClientQuality team gives final approvalApproval recorded
  6. LaunchOctober 30

Without the move, every client the firm added would have brought notes of its own, and each launch date would have moved the way the first one did. The plan for the firm’s next client has one launch date and nothing written beside it, because the only work left is setting up that client’s requirements. This time, the list stopped growing, so the date stopped moving.

The Series

This is Post 6 of six, and the second of two about productizing the playbook. Read the thinking behind this series in the manifesto, and our research about product development timelines in the AI Ship Date Dilemma report.

Post 1
Published

Your Customers' Regulators Will Ask What the Agent Did – and Why

For companies whose customers already depend on their product, adding AI means answering to those customers’ regulators too. This post follows a claims software company that ships an agent to review insurance claims, then can’t explain one of its denials to a state examiner because the reasoning was never recorded when the decision was made.

Post 2
Published

The Demo Was the Easy Part

Businesses that run their operations on a product hold every new feature to the same service commitments. This post follows an insurance software company whose overnight deploy leaves quote requests stalled mid-decision while every health check stays green, because nothing recorded where each request stopped or how to resume it.

Post 3
Published

What Can This Agent Access for Each of Your 200 Clients?

Turning an internal tool into a product for a new market pays off if it ships while the opportunity is still open. This post follows a company that plans to sell its internal dispute-reconciliation agent, then learns that keeping each client’s data, billing, and limits separate could take quarters to build, long enough to miss the opening.

Post 4
Published

A 97% Success Rate Is a Liability

Teams moving fast into unfamiliar territory often launch first and plan to iterate later. This post follows a company building its first logistics product, whose exception-handling agent slips from 99% to 97% success as volume grows, leaving 1,500 failed runs a day with nothing built to handle them.

Post 5
Published

Assembled by Your Team, Owned by Your Team, Forever

Codifying expertise lets a firm reach clients its experts will never have time to serve. This post follows a pay-consulting firm that turns its partners’ methodology into an agent product for 40 clients, then finds that keeping each client’s limits in place has it staffing like an infrastructure company.

Post 6
This Post

The Day the Ship Date Stopped Moving

Turning a playbook into a product means answering to every client’s reviewers. This post follows a life sciences consultancy that builds a supplier-review agent in weeks, then watches its launch date move three times as the client’s quality, security, and audit teams each ask what the agent did, and why.