Why Composite Intelligence: where BI ends and AI begins
AI × BI = CI. Composite Intelligence (CI) is the practice of fusing the rigor and trust of Business Intelligence with the adaptability and creativity of Artificial Intelligence so people can understand, predict, and act—in one loop.
A longer preface: a short history of the two traditions
If one zooms out, BI and AI look like two old rivers that finally meet.
In 1958, IBM researcher Hans Peter Luhn sketched “business intelligence” as turning records into useful knowledge. Through the 1990s, the BI river widened: the data warehouse, star schemas, ETL, OLAP cubes—tools to reach consistent answers about yesterday and today. The 2000s democratized access with self-service BI and dashboards; the 2010s moved warehouses to the cloud and strengthened governance. The BI ethos became: stable definitions, auditability, explainability.
AI’s river starts in the late 1950s with perceptrons, forks into expert systems in the 1980s, returns to neural networks with backpropagation, then accelerates with deep learning and the Transformer architecture (2017). Where BI standardized “the truth,” AI pursued adaptation—predicting what’s next, recommending what to do, and increasingly generating language, images, and code.
For decades the rivers ran in parallel: BI delivered trusted numbers but little agency; AI offered agency but sometimes drifted from governed numbers. Composite Intelligence is the confluence: build products that keep BI’s reliability and add AI’s foresight and initiative—so a question can become an answer, a recommendation, and a measured outcome in one place.
TL;DR
- BI excels at trusted numbers and explainable hindsight (what happened, why it happened). Context: When a CFO asks “What’s revenue by country last quarter?”, BI ensures the answer matches the books—same metric definition, same filters, same lineage back to data.
- AI excels at adaptation and action (what will happen, what to do next, and how to automate). Context: Given the same revenue series, AI can forecast next quarter, flag anomalies, propose which markets to nudge, and even draft the email or open a ticket.
- CI blends them into a closed loop: metric consistency + data quality (BI) with prediction, generation, and workflow automation (AI). Context: The loop matters—insights should drive actions, and the outcomes of those actions should flow back into the data to make the next decision better.
A quick map of the territory
| Layer | Questions answered | Typical outputs | Typical tools & platforms |
|---|---|---|---|
| BI (Descriptive/Diagnostic) | What happened? Why? | Metrics, KPIs, dashboards, drilldowns | SQL, dbt, DuckDB/Postgres, Superset/Metabase, Great Expectations |
| AI (Predictive/Prescriptive/Generative) | What will happen? What should be done? | Forecasts, anomaly alerts, scenarios, summaries, recommended actions, generated content | scikit-learn/XGBoost, transformers/LLMs, RAG, orchestration frameworks |
| CI (Composite Intelligence) | Understand → Predict → Decide → Act → Learn | A single experience: trusted metrics + AI insights + actions (with feedback) | Streamlit/Next.js, FastAPI, vector databases, eventing, human-in-the-loop tooling |
Context: Think of CI as a product “spine.” BI keeps bones aligned (definitions, lineage); AI provides muscles and reflexes (predictions, generation); CI stitches them into movement (actions that can be measured).
Where BI ends (and why that’s a feature)
BI’s strengths
- Governed metrics. A “gross margin” tile carries a consistent meaning across dashboards, allowing debates to focus on the business rather than the numbers.
- Explainability. BI answers “why” with drill-downs and dimensions; a KPI can be traced to contributing segments and back to the tables that fed it.
- Reliability. Pipelines are tested; lineage is visible; access is controlled. Operations know what runs when and who can see what.
BI’s limits on its own
- Static answers. Dashboards excel at showing deltas and drivers, but typically do not propose the next move.
- Human bottlenecks. Business questions are translated to SQL by analysts; each new slice or derivation requires time.
- Limited foresight. Forecasts and anomalies often exist as bolt-ons rather than first-class parts of the experience.
Context: None of this is a bug. BI’s job is to be the durable record of what happened and why. CI builds on that stability rather than replacing it.
Where AI begins (and why it needs BI)
AI’s strengths
- Foresight. Models can project likely futures and spot unusual behavior as it starts.
- Synthesis. Large language models can produce concise narratives and suggest next questions—helpful when stakeholders do not speak SQL or statistics.
- Agency. AI can draft emails, create tickets, adjust bids, or generate SQL—turning an insight into a starting action.
AI’s risks without BI
- Shifting numbers. Without governed inputs and metric definitions, models can be confidently wrong.
- Opacity. Stakeholders hesitate to act if an insight cannot be traced back to data they trust.
- Sprawl. Prompts, models, and experiments can proliferate; without controls, trust erodes.
Context: AI is powerful because it is flexible. BI bounds that flexibility—schemas, tested transforms, metric contracts—so AI’s proposals are anchored to reality.
The CI loop (an engineer’s version)
Instrument → Model → Decide → Act → Learn
↑ ↑ ↓ ↓ |
└── BI (metrics, quality, lineage) ──────┘ Instrument (BI). Define data models and metrics-as-code (dbt, views, tests). Add freshness checks and anomaly monitors to establish trust in inputs.
Model (AI). Use tabular ML for forecasts and scores; use LLMs for NL→SQL and explanations. Keep prompts schema-aware and concise.
Decide (BI+AI). Present insights next to the KPI that triggered them. Include uncertainty and alternatives; allow adjustments before committing.
Act (AI). Connect to operational systems—ticketing, email, ad platforms, pricing APIs. Begin with suggestions; log approvals and rejections.
Learn (BI). Write outcomes back: whether a recommendation was applied, and what changed afterward. Feed this into evaluation dashboards and training data.
Context: The loop is the product. Without the “Act” and “Learn” steps, the result is decorated dashboards rather than composite intelligence.
Interested in hands-on examples? See the demos.