What technology stack does a small business need for AI automation? Start with the business applications you already trust, add a workflow layer that owns state and retries, use a model only for the step that needs interpretation, enforce identity and validation outside the model, and capture enough evidence to investigate every material outcome. Choose products last. The architecture should still make sense if any one vendor is replaced.
A list of fashionable tools is not an architecture. A practical stack describes responsibilities and boundaries: where authoritative data lives, which component may decide, which component may act, who approves sensitive actions, and how the business knows whether the workflow is helping. This vendor-neutral view also makes buying, integrating, and building easier to compare.
The five layers of a dependable SME stack
1. Systems of record remain authoritative
Customer status belongs in the CRM, invoices in the finance system, tickets in the help desk, and approved documents in the governed repository. The AI layer may interpret or propose, but it should not become an invisible second database. Write down the owner, identifier, permitted fields, freshness rule and fallback for each source.
2. Orchestration owns the workflow
The workflow layer receives an event, checks prerequisites, records state, calls approved services, waits for review, retries temporary failures and routes permanent exceptions. This is where idempotency matters: replaying an event must not send the same message twice or create duplicate records. Keep business rules readable and separate from prompts whenever possible.
3. Models have narrow jobs
Use models for tasks that benefit from interpretation: classify an enquiry, extract fields, retrieve passages, draft a response or recommend a next action. Use ordinary code for totals, permissions, mandatory fields, thresholds and irreversible actions. A model output is untrusted input until the workflow validates it.
4. Control is not a prompt
Authentication, authorisation, data boundaries, schemas, rate limits and approval gates must be enforced by systems the model cannot talk around. OAuth security guidance emphasises narrowly scoped access and protection against token misuse. OWASP likewise recommends least-privilege tools and explicit approval for high-impact agent actions. The practical SME rule is simple: give each workflow only the permissions required for its current step.
5. Evidence makes operation possible
Capture a correlation ID across the whole case, the versions of the workflow and model configuration, decision metadata, validation results, approval, final action, latency and cost. OpenTelemetry provides vendor-neutral conventions for traces, metrics and logs; adopting its concepts can reduce lock-in even when an SME uses a managed monitoring product.
A lean starting stack
| Capability | Start lean | Add only when evidence requires it |
|---|---|---|
| Entry and records | Existing forms, inbox, CRM, help desk and document store | Dedicated portal or domain application |
| Workflow | One orchestration service with durable state, retries and approvals | Queues, event bus and specialised workers at higher volume |
| AI | One approved model service and a small evaluation set | Model routing, specialist extraction, speech or vision |
| Knowledge | Approved documents with ownership and citations | Retrieval index when search quality and scale justify it |
| Security | SSO where available, scoped service identities, secret manager and audit log | Central policy engine and advanced data controls |
| Evidence | Structured logs, business counters, error alerts and reviewed samples | Distributed traces, evaluation pipelines and cost allocation |
This is an illustrative architecture, not a product prescription. A five-person company may use managed products for every row. A larger SME may own more components. The design question is whether responsibilities are explicit, not whether the tools are custom.
How to select tools without assembling a fragile collection
- Map one workflow: document the trigger, data, decisions, actions, exceptions, owner and measurable outcome.
- Classify every step: deterministic rule, AI interpretation, human judgment or system action.
- Set non-negotiable controls: identity, permission, data location, approval, retention, audit and recovery.
- Prototype the riskiest boundary: usually data access, exception accuracy, integration reliability or user review—not the happy-path prompt.
- Test replacement: identify how to change the model, connector or workflow product and what data or evaluations must move.
- Price production: include support, monitoring, failures, human review and change, not only model usage.
Use the build, buy or integrate decision matrix for ownership choices and the AI automation cost guide for a full life-cycle budget.
Common stack anti-patterns
- The model as database: important facts are hidden in conversation history instead of an authoritative record.
- The prompt as policy: security or approval depends on instructions the model may misunderstand.
- One super-agent: a broad identity can read and write across unrelated systems.
- No durable state: a timeout leaves nobody sure whether an external action happened.
- Logs without business meaning: technical success is recorded, but wrong routing or customer harm is invisible.
- Tool-first architecture: the workflow is distorted to fit disconnected subscriptions.
Production readiness checklist
Before launch, prove the workflow can authenticate correctly, reject unauthorised requests, validate structured outputs, avoid duplicate actions, time out safely, retry only safe operations, route exceptions, expose an approval preview, record evidence, alert an owner and fall back to a manual process. NIST's AI RMF Core frames this as continuous governance, mapping, measurement and management across the system life cycle—not a one-time launch review.
Primary sources checked for this guide
Checked 11 August 2026. These sources support the architecture's risk, identity and observability principles; they do not endorse a specific vendor stack.
- NIST AI Resource Center — AI RMF Core
- OWASP — AI Agent Security Cheat Sheet
- IETF / RFC Editor — OAuth 2.0 Security Best Current Practice
- OpenTelemetry — What is OpenTelemetry?
Architecture before subscriptions
Turn one workflow into a stack you can operate.
I help SMEs define the boundaries, controls, integrations and evidence required for a production AI workflow.
Request an architecture review →