AI implementation cost ranges from around $100,000 upfront plus a few hundred dollars per user per year for an off-the-shelf assistant to several million dollars upfront for a fine-tuned or custom-built model, according to Gartner's published estimates. For most enterprise use cases the biggest lines are people, data preparation and integration rather than model fees, so a credible budget prices all eight cost categories below, for the build and for the first year of running.
Every figure here comes from a named source checked on 4 November 2026. Where none exists, the budget is labelled illustrative and the arithmetic is shown, so you can swap in your own rates.
How much does AI implementation cost?
The most quoted public estimate is a table Gartner released in July 2024, pricing five ways to deploy generative AI alongside its prediction that at least 30% of generative AI projects would be abandoned after proof of concept.
| Approach (Gartner’s label) | Example use case | Upfront cost | Recurring cost per user per year |
|---|---|---|---|
| Consume: commercial GenAI apps | Coding assistants | ~$100K to $200K | ~$280 to $550 |
| Embed: GenAI APIs in custom apps | Personalised sales content | ~$750K to $1M | ~$790 to $1.2K |
| Extend: models with data retrieval | Document search with RAG | ~$750K to $1M | ~$1.3K to $11K |
| Customise: fine-tuned models | Virtual assistant | ~$5M to $6.5M | ~$8K to $11K |
| Build: custom models from scratch | Medical, insurance or financial-services LLMs | ~$8M to $20M | ~$11K to $21K |
Source: Gartner, July 2024. US dollars, rounded as Gartner published them.
Two caveats apply. The estimates are more than two years old, and model prices have changed since. And they describe deployment approaches, not single use cases; Gartner itself stressed that generative AI costs are less predictable than other technology costs and depend on the use cases and approach chosen. Its survey published in May 2024 found GenAI embedded in existing applications was the most common primary approach, cited by 34% of respondents, while 21% named training or fine-tuning bespoke models.
The eight cost categories of AI implementation
Budgets go wrong when they are built outwards from a vendor quote. Build them from the work instead, using these eight categories.
| Category | What it covers | Main cost drivers |
|---|---|---|
| People | Product owner, engineers, data scientists, testers, delivery management | Team size, months of build, contractor rates |
| Data preparation | Finding, cleaning, classifying, permissioning and indexing data | Number of sources, data quality, sensitivity, refresh frequency |
| Platform and licences | AI platform, assistants, vector store, gateway, observability | Seats, editions, minimum commitments, add-ons |
| Model usage and compute | API tokens, or GPUs and hosting for self-run models | Volume, prompt length, model tier, calls per task, utilisation |
| Integration | Connectors, identity, systems of record, write-back actions | Number of systems, API quality, legacy constraints |
| Security and governance | Threat modelling, red teaming, risk assessment, logging, legal review | Risk tier, regulation, data classes, autonomy level |
| Change and training | Training time, champions, process redesign, communications | Number of users, depth of process change |
| Run and support | Monitoring, on-call, evaluation re-runs, model upgrades, service desk | Service level, number of live systems, rate of change |
People
People are usually the largest build line. A first production use case on a bought platform usually involves a business product owner, two or three engineers, part of a data engineer, a tester who owns the evaluation set, a security reviewer and someone to run delivery; price each in person-months.
AI implementation costs and salaries
The US Bureau of Labor Statistics publishes median pay by occupation; its May 2025 figures are below. It also reports that wages were 70.0% of private employers’ compensation costs in June 2026, so dividing a wage by 0.70 gives a rough employer cost before overheads.
| Role on an AI team | Closest BLS occupation | Median wage, May 2025 | Rough employer cost (wage ÷ 0.70) |
|---|---|---|---|
| AI, integration or platform engineer | Software developers | $135,980 | ~$194,300 |
| Data scientist | Data scientists | $120,230 | ~$171,800 |
| Applied machine learning researcher | Computer and information research scientists | $140,300 | ~$200,400 |
| Security reviewer | Information security analysts | $129,180 | ~$184,500 |
| Tester and evaluation owner | Software quality assurance analysts and testers | $104,300 | ~$149,000 |
| Delivery or project manager | Project management specialists | $102,320 | ~$146,200 |
These medians mix junior and senior staff across all industries, so replace them with your own pay bands or contractor quotes where you can.
Data preparation
This is the line most easily left out of a vendor quote. Gartner’s survey of 1,203 data management leaders, published in February 2025, found 63% of organisations lacked the right data management practices for AI or did not know whether they had them, and Gartner predicted that through 2026 organisations would abandon 60% of AI projects not supported by AI-ready data. Its survey of 275 service and support leaders, released on 4 November 2026, found the most AI-forward service organisations investing nearly 1.8 times more in data and knowledge-management foundations than in the AI use cases themselves. It grows with the number of sources, messy content, permission rules and refresh frequency, and it recurs.
Platform and licences
Two list prices, checked on 4 November 2026, show the shapes you will meet:
- Microsoft 365 Copilot is $30.00 per user per month paid yearly, or $31.50 paid monthly on an annual commitment, on top of a qualifying Microsoft 365 licence.
- Claude Enterprise is US$20 per seat per month, billed annually with a 20-seat minimum, plus usage charged at API rates.
Model both parts of seat-plus-usage pricing, and price seats for actual users.
Model usage, inference and compute
APIs charge per million input tokens (instructions, question and retrieved passages) and per million output tokens. Anthropic’s list prices show how much the tier matters: Claude Sonnet 5.5 is $2 input and $10 output, while Claude Haiku 5.5 is $0.10 and $0.50 for prompts up to 100,000 tokens, a twentyfold gap, with 50% off for batch processing and cheaper cached input.
Forecasting is hard because tokens scale with adoption, prompt length and calls per task. Presenting its October 2026 survey of 2,002 CIOs, Gartner described AI costs as probabilistic and set at run time, unlike most technology costs. In McKinsey’s 2026 survey, about one respondent in five said AI operating costs, tokens included, were already limiting their organisation’s AI use. Running models yourself swaps tokens for GPUs, power, hosting and serving engineers; our breakdown of on-premises platform TCO and the 2026 comparison of on-premises LLM costs do that arithmetic.
Integration
Each system of record the AI reads or writes needs a supported interface, a least-privilege service account, error handling and tests that survive the next upgrade, so cost grows with the number of systems and the quality of their APIs. See our patterns for connecting AI to legacy applications.
Security and governance
Every production system needs a threat model, risk assessment, access controls, logging, an evaluation standard and a human-oversight decision. The risk tier drives the rest: an agent that can change customer records needs far more review than a drafting assistant. Plan the testing effort with our guide to red-teaming agents before release, and add the regulatory documentation your sector requires.
Change and training
Training costs working time even when the course is free. US private employers paid an average of $46.89 in total compensation per hour worked in June 2026, so one hour for 2,000 staff is 2,000 × $46.89 = $93,780. Process redesign is the bigger item: McKinsey found nearly three-quarters of AI high performers had fundamentally redesigned workflows, against one-quarter of other respondents. Our role-based training guide covers the programme.
Run and support
Budget per live system per year for monitoring, on-call, the service desk route, evaluation runs, retrieval tuning, index refreshes and model upgrades. The people who stop quality drifting are the run cost, not the cloud bill.
Hidden costs of AI implementation
These lines rarely appear in a first estimate, and most grow after a successful launch, as usage does:
- Review time. If 2,000 AI-drafted documents a month each take three minutes to check, that is 100 hours of reviewer time every month. Measure it in the pilot.
- Evaluation sets. Test questions, expected answers and grading rules have to be written and kept current.
- Model churn. Providers retire model versions, and each migration needs re-testing and sometimes prompt rework.
- Duplicate tools. Teams buying their own assistants pay twice for one capability and leave gaps in logging.
- Idle capacity. Self-hosted GPUs sized for peak cost the same at night as at noon.
- Exit costs. Data export, re-indexing and retraining staff when you switch vendor; settle exit terms early with the enterprise AI procurement guide.
- Stopped pilots. The money spent learning is a programme cost, not a write-off to hide.
How costs differ by deployment model
The deployment model changes the shape of the bill more than its size.
| Managed API or SaaS | Private cloud | On-premises or air-gapped | |
|---|---|---|---|
| What you pay for | Seats and tokens | GPU instances, platform licences, cloud services | Hardware, data-centre space, power, platform licences |
| What scales with use | Token spend, almost linearly | Instance hours, in steps as capacity is added | Little, until capacity runs out and hardware is bought |
| Who runs the models | The provider | Your platform team on the cloud provider’s infrastructure | Your platform and infrastructure teams |
| Budget profile | Variable operating expense | Operating expense, partly committed | Capital expense plus fixed operating cost |
| Usually fits | Low or uneven volume, early use cases, low-sensitivity data | Steady volume with residency requirements | High steady volume, regulated or classified data, no external calls |
People, data preparation, integration, governance, change and run stay on the budget whichever column you choose. For how per-token and flat pricing behave as volume rises, see flat versus pay-as-you-go pricing.
Agentic AI implementation cost
Agents cost more than chat assistants for four reasons: several model calls per task; tools with write access that each need integration, permissions and an audit trail; evaluation of the whole sequence of steps rather than the final answer; and human approval of consequential actions, which is a staffing cost. Anthropic’s engineering team reported in June 2025 that agents typically use about four times more tokens than chat interactions, and multi-agent systems about fifteen times more.
An illustrative comparison at 20,000 tasks a month, priced at Claude Sonnet 5.5 list prices:
- Chat: one call per question with 6,000 input and 600 output tokens gives 120 million input and 12 million output tokens, so 120 × $2 + 12 × $10 = $360 a month.
- Agent: eight calls per task, each averaging 10,000 input and 800 output tokens, gives 1.6 billion input and 128 million output tokens, so 1,600 × $2 + 128 × $10 = $4,480 a month, about $0.22 per task and twelve times the chat bill.
Even at that rate, the token bill is often smaller than the cost of building tools, approvals and evaluation. In June 2025 Gartner forecast that more than 40% of agentic AI projects would be cancelled by the end of 2027, citing escalating costs, unclear business value and inadequate risk controls, which is the case for budgeting agents per completed task. Our guide to implementing AI agents covers delivery, and what assembling an agent platform from frameworks costs covers the platform choice.
AI chatbot implementation cost: a worked example
This illustrative budget, not a quote, prices an internal assistant that answers staff questions from policy documents and the intranet for 2,000 employees, built on a bought platform with retrieval. Monthly rates are the BLS-based employer costs above divided by twelve: about $16,190 for an engineer, $15,380 for a security analyst, $12,420 for a tester and $12,180 for a project manager.
| Line | Assumption | Arithmetic | Year one |
|---|---|---|---|
| Build | 2 engineers for 4 months | 8 person-months × $16,190 | $129,520 |
| Data preparation | 1 engineer for 2 months on six sources | 2 × $16,190 | $32,380 |
| Delivery management | Half a project manager for 4 months | 2 × $12,180 | $24,360 |
| Security and risk review | A quarter of a security analyst for 4 months | 1 × $15,380 | $15,380 |
| Testing and evaluation set | Half a tester for 3 months | 1.5 × $12,420 | $18,630 |
| Training time | 2,000 staff × 1 hour | 2,000 × $46.89 | $93,780 |
| Model usage | 20,000 questions a month, as in the chat example | $360 × 12 | $4,320 |
| Run and support | Half an engineer after launch | 6 × $16,190 | $97,140 |
| Platform licences | Your vendor’s quote for the seats you need | Quote | Quote |
| Total before licences | $415,510 |
The model bill is about 1% of the total, and ten times the usage would still keep it under a tenth. Scope (sources, users, languages, systems to integrate) moves the number far more than any unit price.
AI budget 2026: what organisations are spending
Market figures frame the board conversation; they are not a target for your budget.
- Total spend. Gartner’s September 2026 forecast puts worldwide AI spending at about $2.7 trillion in 2026, up 49.5% on 2025, of which AI infrastructure is roughly $1.48 trillion, much of it bought by hyperscalers and service providers.
- Share of technology budgets. In McKinsey’s survey of 1,719 participants, fielded in May and June 2026, 28% said their organisation spends more than 10% of its information and communication technology budget on AI; high performers were more than twice as likely as others to spend over 15%.
- Direction. The Lenovo CIO Playbook 2026, researched by IDC among 3,120 decision makers, found 96% of organisations planning to increase AI investment over the next 12 months, by 13% on average.
- Pressure. In Gartner’s October 2026 survey, 58% of CIOs reported more pressure to deliver cost improvements from AI, and 51% expected AI to raise the total cost of ownership of their technology.
S&P Global’s 2025 Voice of the Enterprise survey found cost had become the most commonly cited factor in AI project prioritisation. For the finance view of layering and forecasting this spend, see our guide for CFOs on AI spending.
How to build an AI implementation budget
- Start from the use-case list. Rank candidates with our value, risk and effort method and fund the top few properly.
- Choose the approach per use case: buy, configure or build, and where it runs. Our build versus buy guide sets out the decision rules.
- Estimate all eight categories for the build and for each year of running, over three years.
- Model usage in three scenarios, low, expected and high, as tasks per month multiplied by tokens or compute per task.
- Add contingency at programme level, on the evidence below.
- Release money at stage gates. Fund the pilot fully and release production money only when the pilot meets its criteria, as set out in our guide to running an AI pilot program; why pilot and production costs differ explains the gap.
- Put it in the business case. Our business case template follows these categories, and the payback calculator tests your assumptions.
- Track actuals as unit costs, such as cost per task and per active user, next to the KPIs for each use case, and measure return with our AI ROI method.
How much contingency to add
Bent Flyvbjerg and Alexander Budzier’s study of 1,471 IT projects, published in Harvard Business Review in 2011, found an average cost overrun of 27%, but one project in six was a “black swan” with an average cost overrun of 200% and a schedule overrun of almost 70%.
The UK Treasury’s supplementary Green Book guidance on optimism bias, based on a 2002 Mott MacDonald review of large public projects, places ICT development in its equipment and development category. Appraisers start from upper-bound uplifts of 200% on capital cost and 54% on duration, then reduce them towards lower bounds of 10% only as the causes of overrun are shown to be under control.
For AI, set contingency high at the outline stage and cut it at each gate as evidence replaces assumptions, then show what remains as its own business-case line.
How to cut AI implementation cost without cutting value
- Buy the commodity, build the difference. Custom work only where your process or data gives an edge.
- Share one platform. One gateway, retrieval layer, evaluation harness and identity integration should make the second use case cheaper than the first.
- Match the model to the task. Send classification, extraction and routine answers to small models; Haiku 5.5 input costs a twentieth of Sonnet 5.5 input.
- Use caching and batch. Cached input reads for Sonnet 5.5 are $0.10 per million tokens against $2. If 70% of the agent example’s input were cache reads, input would cost 1,120 × $0.10 + 480 × $2 = $1,072 a month instead of $3,200, before cache-write charges.
- Trim context. Retrieve fewer, better passages and keep system prompts short.
- License active users and reassign idle seats every quarter.
- Fund connected use cases. In its November 2026 customer service research, Gartner predicted that by 2028 organisations building AI portfolios will achieve twice the business value of those pursuing standalone use cases.
- Stop what is not working at a gate, with the reasons written down.
Do not cut evaluation, security review or training; their absence returns later as incidents or as tools nobody uses.
How VDF AI fits
VDF AI puts several of these cost categories on one platform: governed AI agents, Networks for multi-agent orchestration, private RAG over company documents in VDF AI Chat, and VDF AI Router in front of approved cloud models and registered on-premises model endpoints. Role-based access control comes with every plan and audit logs record user and agent actions, so the governance line starts from existing controls rather than a custom build.
Two features bear on model usage. VDF AI Router applies model policy and budgets before each call and records why it chose a model, so routine work can go to smaller or local models; its air-gap mode routes to local models only. Networks carry budget caps per run, day or month, and a run that would exceed its cap stops and reports why.
Data clean-up, integration, change management and your team’s time stay in the budget whichever vendor you choose. VDF AI runs in VDF’s managed cloud, with plan prices on the pricing page, or in your own data centre, private cloud or air-gapped network.
Sources
Every figure on this page was checked with its publisher on 4 November 2026; list prices change often, so confirm them before you quote them.
- Gartner: survey of primary GenAI approaches and production rates (7 May 2024), deployment cost estimates with the 30% abandonment prediction (29 July 2024), AI-ready data survey (26 February 2025), agentic AI cancellations (25 June 2025), worldwide AI spending forecast (16 September 2026), 2027 CIO agenda survey (19 October 2026), customer service AI survey (4 November 2026)
- McKinsey: The state of AI in 2026, On the road to ROI (25 August 2026)
- Lenovo: CIO Playbook 2026 with research by IDC (27 January 2026)
- S&P Global Market Intelligence: Voice of the Enterprise, AI and Machine Learning Use Cases 2025 highlights (30 May 2025)
- US Bureau of Labor Statistics, Occupational Outlook Handbook: software developers and testers, data scientists, computer and information research scientists, information security analysts, project management specialists
- US Bureau of Labor Statistics: Employer Costs for Employee Compensation, June 2026
- Microsoft 365 Copilot enterprise pricing
- Claude plans and API pricing
- Anthropic Engineering: How we built our multi-agent research system (13 June 2025)
- HM Treasury: Green Book supplementary guidance on optimism bias
- Flyvbjerg and Budzier: Why Your IT Project Might Be Riskier Than You Think (arXiv version of the HBR article)