AI architecture

Composability is more than a buzzword.

Composability is a testable property. The test belongs in your procurement process, not in the postmortem after a renewal.

By Jacob AndraTalbot West08-02-2025

The word has been in enough pitch decks that it has lost its edges. A vendor says modular and means their engineering team can ship new features independently without taking the whole platform down. That is a useful property for a software product. It says nothing about whether you, the buyer, can remove their component, replace it with something better, or take your data with you when you go.

Those are different questions, and most enterprise buyers do not think to ask them until a contract renewal is approaching and the switching cost has quietly become prohibitive.

Bottom line
  1. 01Composability is a testable property, and the test belongs in your procurement process.
  2. 02Modular means the vendor can add features. Removable means you can take them out.
  3. 03Lock-in in AI systems hides in embeddings, prompt logic, evaluation data, and fine-tuned weights, not in the interface layer.
  4. 04AI switching costs run 2.3x to 5.7x the original implementation investment. Composable architecture is how you preserve the option to leave.
  5. 05A composable system is necessary but not sufficient. Architecture discipline determines whether replaceable components are well-arranged.

Composable AI is the architecture paradigm that answers those questions before the contract is signed.

The core claim is specific enough to be testable: a composable AI system is one in which each capability component can be replaced without requiring changes to the components around it. Not replaced in theory, with a six-month migration project. Replaced as a matter of routine, because the interfaces between components were designed to that standard from the beginning.

Fig 01 / The urgency is not hypothetical
94%of organizations are concerned about vendor lock-in in AI and cloud systems.Parallels 2026 / n=540
78%of companies with fully scaled composable technology report clear AI ROI, against 13% in early planning.MACH Alliance 2026 / n=600
2.3–5.7xthe original implementation investment: the cost of switching AI platforms.Zenodo 2026
15–30%better pricing at renewal for enterprises with documented multi-vendor AI strategies.Zenodo 2026

A 2026 Parallels survey of 540 IT professionals found 94% of organizations are concerned about vendor lock-in in AI and cloud systems, with nearly half saying they are very concerned, and that number has climbed every year since 2024. This is not concern about an abstract risk. It is a reaction to switching costs already accumulated: in proprietary embeddings, in vendor-managed prompt layers, in workflow automations built on APIs that do not export cleanly.

This article is for the evaluation side of that decision: you are assembling, sourcing, or inheriting a stack and you need to know whether the composability claim survives contact with reality. The companion article on Cognitive Hive AI covers the build side: how to architect a multi-capability system from the ground up. This one covers how to assess what you are buying into.

Where the term came from

Composable architecture has a longer history than its AI application suggests. The MACH Alliance, founded in 2020, codified the pattern for enterprise technology: Microservices, API-first, Cloud-native, and Headless.

MMicroservicesCapability modules are independently deployable.
AAPI-firstInterfaces are open-standard, not internal convention.
CCloud-nativeDeployment is cloud-agnostic or hybrid.
HHeadlessNo capability is bundled into a monolith that cannot be separated.
Fig 02 / The MACH principles, translated to AI

Composable commerce applied the same logic to retail: instead of a monolithic e-commerce platform from a single vendor, you assemble best-of-breed components for your cart, payment processing, search, personalization, and inventory, each connected through standard APIs, each replaceable without touching the others.

The retail sector adopted this approach at scale. According to Alokai's Composable Commerce Trends Report 2025, 80% of enterprises had adopted or were planning to adopt composable commerce, with 41.67% already running composable systems in active production. The reason was not philosophical: it was competitive. A retailer on a monolithic platform waited for their vendor's roadmap to incorporate visual search, or better recommendation algorithms, or new payment methods. A retailer on a composable stack could integrate a best-of-breed component in weeks. The speed advantage compounded.

The same logic applies directly to AI systems. The vocabulary transferred: composable AI describes AI architectures in which capabilities are modular, independently deployable, and connected through standard interfaces. The MACH principles translate almost directly: services (AI capability modules) are independently deployable, interfaces are API-first and open-standard, deployment is cloud-agnostic or hybrid, and no capability is bundled into a monolithic platform that cannot be separated.

That track record now extends directly to AI returns. In February 2026, the MACH Alliance surveyed 600 technology decision-makers across seven global markets on the relationship between composable infrastructure and AI performance. The result was unambiguous: 78% of companies with fully scaled composable technology report clear AI ROI, compared to 13% of companies in the early planning stages of composable adoption. Six times more AI returns, on the same underlying investments, attributable to the composable foundation.

98%of mature composable enterprises can support AI at scale, against 33% of early-stage counterparts.
94%say composable architecture directly accelerates AI deployment.
97%say vendor certification for AI in composable environments would influence their vendor selection.
Fig 03 / MACH Alliance, February 2026, n=600

The 97% figure is a signal that the market is moving toward demanding accountability on composability claims, not just accepting them.

The MACH ecosystem also produced years of hard evidence on where composability claims fail in practice. The failure modes in composable commerce, hidden coupling in shared data stores, proprietary event schemas, fine-print data portability clauses, are the same failure modes appearing now in AI platform contracts. The field already has a postmortem record. Buyers do not need to discover these problems themselves.

What composability actually requires

Composability is not a feature. It is a set of architectural properties that are either present in a system or not. Four are necessary.

Property 01

Contract-defined interfaces

Every boundary between components is specified: data format, schema version, latency expectation, error behavior, and deprecation policy. The contract is documented, versioned, and maintained as a first-class artifact. An implicit interface, one that works because two components were built by the same team and share internal conventions, is not composable. When one of them is replaced, the implicit assumptions surface as failures.

Property 02

No shared hidden state

Components in a composable system do not share state through side channels: a common database they both write to, a shared cache with undocumented keys, a message queue whose schema is maintained by neither component exclusively. Shared hidden state is the most common source of cascade failures in systems that look composable on paper. Replace one component, it stops writing a key the other component reads, and the failure is not at the interface layer where anyone would think to look for it.

Property 03

Independent deployability

Each component can be updated, rolled back, or replaced on its own release schedule without coordinating with the components it connects to. This is the property that enables the speed advantage composable commerce demonstrated: deploy a better recommendation engine on Tuesday without scheduling a cross-system release window.

Property 04

Data portability at the boundaries

The data that flows between components, and the data that each component accumulates over time, belongs to the organization, not to the vendor. It is stored in formats that other systems can read without proprietary translation. When a component is replaced, the historical data travels with the workflow, not with the vendor.

Fig 04 / The four necessary properties

The four properties above define whether a component is composable in isolation. Composability also operates across two structural axes, and a well-functioning system requires both.

Axis A / Vertical

Layers of the stack

  1. Interface
  2. Memory
  3. Retrieval
  4. Orchestration
  5. Model

A vertically composable system lets you replace the underlying model without rewriting the orchestration layer. It lets you swap the retrieval architecture without changing the memory layer above it. Each layer has a defined contract with the layer above and the layer below.

Axis B / Horizontal

Capabilities side by side

FraudCommsCompliance

A fraud detection module, a customer communication module, a compliance checking module, all operating independently on the same input stream. A horizontally composable system lets you replace the fraud detection engine without touching the communication module.

This is the axis the original MACH composable-commerce work documented most thoroughly, and it is the one most enterprise AI buyers neglect.

Fig 05 / Two structural axes, both required

The evaluation checklist

This is the test. Run it against any AI platform or component before signing, and against any system you are inheriting.

QuestionThe answer that should worry you
01Can you replace the underlying model at any node without rewriting downstream logic?

"Yes, but you would need to remap the output schema." Remapping downstream logic is rewriting downstream logic.

02Can you export your prompts, system instructions, and fine-tuning data in a format another vendor could consume?

"Our prompt management is proprietary, but we have an export API." An export API that produces a vendor-specific format is not portable.

03Can you export your evaluation benchmarks and test sets?

"Evaluations run inside our platform." If you cannot run your evals on a different stack, you cannot verify a replacement.

04Do the interfaces between components follow open standards (REST, gRPC, OpenAPI, MCP)?

"We use our own internal protocol for performance reasons." Performance is a real concern; proprietary protocols are permanent lock-in.

05Can a component from a different vendor be substituted at any node?

"Our components are optimized to work together." Optimization for the vendor's convenience is coupling by another name.

06Where are your embeddings stored, and in what format?

"In our vector store, optimized for our retrieval layer." Embeddings tied to a proprietary retrieval format do not travel.

07What happens to your fine-tuned weights if you stop using this platform?

"You can download the weights." Follow up: in what format, and can you serve them on infrastructure you control?

08Can the system run in an on-premises or air-gapped environment?

"We support private cloud deployment with our managed agent." A managed agent is still the vendor's software running on your hardware.

No vendor answers all of these questions well.

The goal is not to find a platform that passes every test. The goal is to know which tests it fails before you sign, so the lock-in is a deliberate architectural decision rather than a surprise discovered at renewal time.

Where lock-in actually hides

The interface layer is where composability is described. It is rarely where lock-in lives.

The actual leverage is in four places that are easy to overlook during procurement.

Layer 01

Embeddings tied to one provider's model

Your retrieval system is built on embeddings generated by a specific model. When that model changes its embedding space, through a version update, a deprecation, or a migration to a new architecture, every document in your vector store needs to be re-embedded. The cost scales with corpus size and historical throughput. Organizations that did not plan for this encounter it when they want to switch retrieval models and find a re-embedding project waiting that was never in the budget.

Layer 02

Prompt logic living in the vendor's console

Your system's behavior is defined by prompts stored in a vendor-managed prompt management layer. The prompts are visible to you, but they execute inside the vendor's infrastructure, are versioned by the vendor's tooling, and are evaluated against the vendor's benchmarks. When you try to reproduce that behavior on another stack, the exported prompts are not enough: the implicit behaviors encoded in the vendor's serving layer do not travel with the text.

Layer 03

Evaluation data you cannot export in a useful format

You have built up a library of evaluation cases, human ratings, and failure annotations over months of production operation. That data is the most valuable asset in the system: it defines what good looks like for your specific use case. If it lives in a vendor platform and exports in a proprietary format that no other evaluation framework reads natively, you lose it when you switch. Starting a new evaluation baseline from scratch on a replacement system means months of reduced confidence in production.

Layer 04

Fine-tuned weights that do not travel

You fine-tuned a model on proprietary data. The weights are held by the vendor, or returned to you in a format that requires their serving infrastructure to run. You cannot take the trained capability and deploy it on infrastructure you control. The fine-tuning investment is permanently coupled to the vendor relationship.

Fig 06 / Four layers below the interface documentation

The embeddings problem is compounded by a degradation problem that operates even when you are not switching anything. MIT research across 32 datasets and four industries found that 91% of machine learning models degrade over time. Gartner data shows 67% of enterprises experience measurable degradation within 12 months of deployment. Models left unchanged for six months see error rates climb 35% on new data.

91%of machine learning models degrade over time, across 32 datasets and four industries.MIT
67%of enterprises experience measurable degradation within 12 months of deployment.Gartner
5%of AI agents in production have mature monitoring infrastructure.Cleanlab 2025
Fig 07 / Degradation runs whether or not you switch

When your embeddings are stored in a proprietary format tied to one vendor's retrieval layer, degradation is both harder to detect, because you lack an independent baseline, and harder to remediate, because improving the model means rebuilding the retrieval layer from scratch.

Silent provider updates compound the risk. When OpenAI or Anthropic revises their underlying model, every enterprise on that API receives the change with no prior notification. Stanford research documented significant behavioral shifts in GPT-4 across quarterly updates: tasks that worked reliably in one version failing in the next. A Cleanlab 2025 production survey found that only 5% of AI agents in production have mature monitoring infrastructure. Most enterprises discover behavioral shifts through customer complaints, not dashboards.

None of these are hidden in the sense of being undisclosed. They are hidden in the sense that they are not what procurement teams examine when evaluating an AI platform. The interface documentation looks clean. The lock-in is in the data layer below it.

Four exposures accumulating at once, unmeasured
Microsoft CopilotEmbedded in daily knowledge work.
Salesforce AgentforceEmbedded in CRM and customer data.
ServiceNow AIEmbedded in years of accumulated ITSM configuration.
AWS BedrockEmbedded in developer infrastructure.

No one in the organization is measuring the aggregate.

Fig 08 / The typical mid-market stack, per Vaasblock, June 2026

A June 2026 Vaasblock analysis documented the scale of simultaneous accumulation: a typical mid-market enterprise is currently building switching cost exposure across four separate AI vendors at once. Unlike the ERP wave of the 1990s, where switching costs were visible migration projects with line-item price tags, AI switching costs accumulate in data pipelines, workflow automations, and institutional knowledge encoded in vendor-managed systems. None of it surfaces on a balance sheet until a contract renewal conversation is already underway.

Zenodo-published research puts AI platform switching costs at 2.3x to 5.7x the original implementation investment. Enterprises with documented multi-vendor AI strategies, by contrast, negotiate 15 to 30% better pricing at renewal, because they retain credible alternatives and vendors know it.

Regulatory / EU AI Act, August 2026

As of August 2026, the EU AI Act requires providers and deployers of high-risk AI systems to maintain continuous monitoring programs, track system performance in real-world conditions, and report serious incidents within defined timeframes. Composable architectures are structurally better positioned to meet these requirements: when components have defined interfaces and independent logging, audit trails are architectural rather than retrofitted. Monolithic platforms that embed AI throughout a shared infrastructure make it difficult to isolate which component produced a given output, which is precisely what regulators need to establish.

What composability costs

A composable architecture carries overhead that a monolithic platform does not. Naming it plainly is what makes the rest of this argument credible.

Cost 01

Integration surface is larger

In a monolithic platform, the vendor owns the interfaces between components. In a composable stack, you own them. That means defining data contracts, maintaining schema versions, testing interface behavior, and coordinating upgrades when any component changes. The MACH Alliance's own 2025 research found that 37% of organizations cite integration complexity as a primary concern when implementing composable architectures. That number is honest, not disqualifying.

Cost 02

Version drift is a standing concern

When each component has its own release cadence, combinations that worked together at one point drift apart over time. A composable stack requires a compatibility matrix and a practice for testing component combinations before deploying updates. This is a standard problem in microservices engineering. It is not a solved problem out of the box.

Cost 03

The seams require testing

Every interface boundary in a composable system is a place where unexpected behavior can emerge. Integration testing across a composable stack is more expensive than unit testing a single platform. Organizations that treat this as optional discover it when a production incident traces to an interface boundary that was never explicitly tested.

Fig 09 / The composability premium, stated plainly

These costs are real and belong in the architectural estimate. The alternative is not cost-free: it is vendor lock-in discovered at the moment your requirements diverge from your vendor's roadmap, at which point switching costs have already compounded to 2.3x to 5.7x the original implementation investment, payable on your vendor's schedule.

Composable is necessary, not sufficient

A system can be perfectly substitutable at every component boundary and still be badly arranged.

Composability answers the question: can this be replaced without disturbing what is around it? It does not answer: what should be placed where, at what level of abstraction, in what coordination topology?

Those are the questions that Cognitive Hive AI addresses. CHAI is the architecture discipline for how multi-capability systems should be arranged: which substrates belong at which nodes, how decision nodes nest into higher-order decision nodes, how failure is contained when a component degrades, and how authority is assigned when components disagree.

A composable stack built without that discipline is a collection of replaceable parts in no particular order.

It is better than a monolith. It is not yet an architecture.

The practical implication for buyers: composability is the minimum bar. Ask the evaluation questions in this article before you sign. Once you have established that the components you are buying can actually be replaced, the second question is whether the system is arranged in a way that makes sense for your use case, your governance requirements, and your operational constraints. Those are different questions that require different analysis.

For the system-of-systems framing that situates both composability and CHAI within a full organizational AI strategy, that article addresses the layer above both.

The diagnostic / One question for the next vendor conversation

If we decided to replace this component in eighteen months, what would that migration actually involve: in engineering time, in data work, and in downtime?

Listen for specificity. A vendor with a genuinely composable architecture can answer that question concretely and quickly, because they have designed for it.

A vendor whose composability is primarily a marketing claim will give you a general answer about their flexibility and then change the subject.

The specificity of the answer is the test.

Jacob AndraJacob Andra
About the author

Jacob Andra is the CEO of Talbot West. He hosts The Applied AI Podcast and spends his time pushing the limits of what AI can accomplish in real-world applications. Jacob speaks, writes, and publishes extensively on digital transformation, AI integration, and business process improvement. His expertise spans multiple disciplines, including business strategy, systems integration, digital transformation, and applied artificial intelligence. He's the co-developer of Cognitive Hive AI (CHAI), a modular, composable ensemble framework, and the developer of the Talbot West AI Prioritization and EXecution (APEX) methodology for mapping business opportunities and surfacing the best opportunities for applied AI.

Deep dive

What is the MACH Alliance and why does it matter for AI?
The MACH Alliance is an industry consortium that defines and promotes composable enterprise technology architecture: Microservices, API-first, Cloud-native SaaS, and Headless. Founded in 2020, it grew out of the composable commerce movement in retail and e-commerce. It matters for AI because the failure modes the composable commerce ecosystem documented in 2021 through 2024 (hidden coupling, proprietary data schemas, vendor lock-in below the interface layer) are reappearing in AI platform deployments. The Alliance's certification criteria and the postmortem literature from composable commerce deployments that failed are the most useful external evidence base for AI buyers evaluating composability claims.
Is composable AI the same as microservices architecture?
Not exactly. Microservices is an implementation pattern for how software is structured and deployed. Composable AI is a property of how capabilities relate to each other: whether they can be replaced independently, whether their interfaces are open-standard, whether their data is portable. You can build a composable AI system without microservices, using well-defined APIs between larger components. You can also build a microservices architecture that is not composable because the services share hidden state or use proprietary internal protocols. Composability is the goal; microservices is one implementation approach that can serve it.
What is the difference between composable AI and multi-agent AI?
Multi-agent AI describes systems where multiple AI agents coordinate to accomplish tasks. Composable AI describes a property of how those agents and other components are connected: whether they can be replaced independently. Most current multi-agent deployments are not composable in the meaningful sense: the agents share a common model, run on a vendor's orchestration layer with proprietary handoff protocols, and cannot be individually replaced without rearchitecting the system. Composable multi-agent AI would be a system where each agent is independently replaceable, runs behind a standard interface, and does not share hidden state with its neighbors.
How does composable AI relate to vendor lock-in in AI specifically?
Vendor lock-in in AI has four main sources that do not appear in traditional software: embedding format dependency (your vector store is tied to a specific model's embedding space), prompt logic in proprietary management layers, evaluation data in non-portable formats, and fine-tuned weights that require the vendor's serving infrastructure. These are below the interface layer, which is why they are not addressed by API standards or open protocols. Composable AI architecture addresses them by requiring data portability as a first-class requirement rather than a post-hoc consideration.
Can small organizations implement composable AI, or is this only for enterprises?
Composable architecture scales down well. The minimum viable composable AI system is two components with a defined interface between them. Starting small with explicit interface contracts is actually easier than retrofitting composability into a larger system built without it. The discipline overhead (maintaining contracts, testing interfaces) is proportional to the number of boundaries in the system, which is low when the system is small. The main risk for smaller organizations is over-engineering: not every AI use case requires a composable architecture. A single well-chosen model serving a stable, bounded task does not need composable infrastructure. The pattern is most valuable when requirements are likely to evolve, capability types are diverse, or regulatory requirements demand auditability.
What does a composability audit of an existing system look like?
A composability audit runs the evaluation checklist in this article against each component boundary in a system you already own. It identifies which interfaces are contract-defined and which are implicit, where hidden state exists, which data assets are in portable formats and which are vendor-locked, and which components have independent deployability in practice versus in theory. The output is a map of actual lock-in: where it exists, how severe it is, and what it would cost to remediate. For organizations that have already deployed AI at scale, this audit is usually more valuable than a greenfield composability design, because it reveals where the real constraints are rather than where you assumed they would be.

Sources