Quick answer: SAP AI architecture has five layers. Joule is the assistant people talk to. Joule Studio is where teams build their own skills and agents. AI Foundation, with SAP AI Core and Generative AI Hub, runs the models, orchestration, and grounding. SAP Business Data Cloud and the SAP Knowledge Graph supply governed data and business context. According to SAP, these now come together on SAP BTP as the SAP Business AI Platform, announced at SAP Sapphire 2026.
Divya is an SAP BTP developer preparing for her first AI project. (Divya is a fictional example.) In one week, her client mentioned Joule, SAP AI Core, Generative AI Hub, Joule Studio, and Business Data Cloud, often in the same sentence.
She opened five SAP pages and got five diagrams. Each was correct. None showed how the pieces connect.
So she asked a simple question: if Joule is the answer on the screen, what's behind it?
What Is the SAP AI Architecture in 2026?
The SAP AI architecture is a layered stack in which Joule sits on top as the user experience, and every other piece supplies building tools, models, or business data underneath.
At SAP Sapphire in May 2026, SAP gave the stack a single name. SAP describes the SAP Business AI Platform as "a new foundation for building and deploying enterprise AI grounded in real business context" that unifies SAP Business Technology Platform, SAP Business Data Cloud, and SAP Business AI into one governed environment.
That is an umbrella, not a new product to install. The pieces you already know, such as SAP AI Core and Generative AI Hub, still exist inside it.
Why the map matters for your career
Clients rarely ask, "Can you configure SAP AI Core?" They ask, "Can Joule answer questions about our policies?" or "Can we build an agent for invoice disputes?" To answer well, you need to know which layer does the work. That is what this map gives you.
The SAP AI Map: Five Layers in One Table
The easiest way to understand SAP AI architecture is to read it from the top (what users see) to the bottom (where data and infrastructure live).
Read the table as a request flowing down and an answer flowing up. A user asks Joule. Joule may call a skill or agent. A language model in Generative AI Hub helps understand and write the reply. Data and context come from business systems, documents, and SAP Business Data Cloud. The answer travels back to the user, within that user's permissions.
SAP AI architecture map: five layers from experience to platform
Turn the architecture into practical consulting skills.
The SAP Joule for Consultants Practical Bootcamp uses hands-on scenarios for functional and technical consultants. SAP Joule is included as the recommended foundation course.
[[course-card]]
What Is SAP Joule, and Where Does It Sit?
Joule is the top layer of the SAP AI architecture: the AI assistant users talk to inside SAP applications.
The SAP Architecture Center groups what Joule does into four patterns: transactional (for example, approving a purchase order), navigational (finding the right app), informational (answers from SAP Help and customer content), and analytical (questions about business metrics). It also notes that Joule runs on SAP BTP, connects to systems such as SAP S/4HANA, SAP SuccessFactors, SAP Ariba, and SAP Concur, and provides role-based access.
Joule is not one model. It is an orchestrator. It decides whether a request needs a skill, an agent, a document search, or a system call, then assembles the reply. At Sapphire 2026, SAP also introduced Joule Work, a workspace where users describe an outcome and, in SAP's words, Joule "orchestrates the right combination of workflows, data and agents to get it done."
What Is Joule Studio?
Joule Studio is the build layer: the place where teams create their own Joule skills and agents when standard Joule is not enough.
According to the Joule Studio product page , a skill handles a single, repetitive task with fixed inputs and outputs, such as checking stock levels. An agent handles multistep problems that need reasoning, such as predicting a shortage and recommending a reorder. SAP describes Joule Studio as a capability in SAP Build running on SAP BTP, with a no-code environment.
At Sapphire 2026, SAP expanded the picture. The Sapphire Innovation News Guide lists a new Joule Studio for agents, apps, and workflows, with low-code and pro-code options and support for MCP and the A2A protocol, plus a Joule Studio Runtime. SAP lists general availability for both as Q3 2026, so check the current status before you promise either to a client.
SAP AI Core vs Generative AI Hub: What Is the Difference?
SAP AI Core is the runtime that runs AI workloads, while Generative AI Hub is the set of capabilities on top that gives you access to large language models, orchestration, and grounding.
People mix these two up more than any other pair. SAP Learning puts it clearly:
Both belong to AI Foundation , which SAP Learning describes as the technical basis for building and operating AI solutions on SAP BTP.
Where grounding fits
Generative AI Hub also handles grounding. The SAP Architecture Center RAG reference describes a grounding service in SAP AI Core that ingests documents, stores embeddings in the SAP HANA Cloud Vector Engine. It retrieves the most relevant chunks for each question. This answers from company content instead of general internet knowledge. Our next article, on Joule grounding, explains this one diagram in detail.
Where Does SAP Business Data Cloud Fit?
SAP Business Data Cloud is the data and context layer: it gives AI governed, business-ready data from SAP and non-SAP sources.
SAP describes SAP Business Data Cloud as a fully managed SaaS solution that unifies and governs SAP data and connects it with third-party data. It brings together SAP Datasphere, SAP Analytics Cloud, SAP Databricks, and business warehouse modernization.
Why does AI need it? SAP's own answer is short: "AI agents are only as powerful as the data in which they are grounded," as SAP wrote when explaining Joule agents . The same article describes the SAP Knowledge Graph as revealing "the connections between data and processes," so agents find the most relevant data for their decisions.
The SAP Architecture Center also shows the link downward: data products from Business Data Cloud can feed models that are then deployed and served in SAP AI Core.
Which SAP AI Piece Does Your Project Actually Need?
Your project needs the layer that matches the problem: Joule for user tasks, Joule Studio for custom automation, Generative AI Hub for custom AI apps, and Business Data Cloud for data foundations.
Ask these five questions in order:
A note on cost: according to SAP Learning , Joule Base capabilities are included with SAP product licensing, while Joule Premium capabilities and Joule Agent actions require AI Units. That also shapes which layer a project starts with.
Decision guide: which SAP AI component fits your project?
Building AI apps on BTP? See how the SAP AI Masterclass covers SAP AI Core, Generative AI Hub, RAG, and agents →
Common Mistakes When Reading the SAP AI Architecture
The most common mistake is treating every SAP AI name as a separate product you must buy and learn at once.
Which SAP Joule or SAP AI Course Fits Your Role?
Start with the layer closest to the work you do today, then add one layer below it.
Working in BASIS or security? See how the SAP BTP Masterclass builds the platform layer Joule runs on →
Free SAP Joule Guides and Resources From ZaranTech
ZaranTech shares free e-books, guides, and learning resources on its LinkedIn page and in the SAP Learner Community . These go deeper on each layer of the map:
Follow ZaranTech and the SAP Learner Community for new free guides every week.
SAP AI Architecture FAQs
What is the SAP AI architecture?
It is the set of layers SAP uses to deliver AI: Joule as the user experience, Joule Studio for building, AI Foundation (SAP AI Core and Generative AI Hub) for models, and SAP Business Data Cloud for data and context, all on SAP BTP.
What is the difference between SAP AI Core and Generative AI Hub?
SAP Learning describes SAP AI Core as the runtime for AI workloads. Generative AI Hub is a set of capabilities in AI Foundation that gives access to many large language models plus orchestration and grounding.
What is SAP Business AI Platform?
SAP announced it at Sapphire 2026 as a foundation that unifies SAP BTP, SAP Business Data Cloud, and SAP Business AI into one governed environment for building and running enterprise AI.
Does Joule run on SAP AI Core?
Joule runs on SAP BTP. According to the SAP Architecture Center, it uses large language models made available through Generative AI Hub, which is built on SAP AI Core.
Which SAP AI component should I learn first?
Most consultants should start with Joule, because it is what users see. Developers and BTP profiles should add Generative AI Hub and SAP AI Core next, then Joule Studio for agents.
Back to Divya's Five Diagrams
Divya closes the five SAP pages and draws one picture of her own: Joule on top, Joule Studio below it, then AI Foundation, then data, then the platform.
In the next client call, when someone says, "We need AI for invoice disputes," she does not list products. She asks which layer the problem lives in. Standard task? Joule. Company-specific process? A Joule Studio agent. Messy data? Business Data Cloud first.
The products did not get simpler. Her map did.
Ready to apply the SAP AI map to client work?
Use the recommended training paths to practise Joule prompts, role design, business scenarios and architecture decisions in a structured environment.
[[course-card]]
[[signup-card]]
About ZaranTech
ZaranTech offers live instructor-led, self-paced, and corporate training in SAP, Workday, AI, and enterprise technologies, with 400+ courses, 32,000+ learners trained, 350+ corporate clients and learners in 37+ countries.
Related Reads
Sources
Checked on 13 Oct 2026. Product names and availability dates change as SAP rolls out the SAP Business AI Platform; confirm before use.