KEVOS
ArticlesServicesCase studiesAboutContact
ArticlesServicesCase studiesAboutContact
← ArticlesAlgorithms for Decision MakingProject Delivery · RiskLesson 31/31← PrevNext →
ArticlePublished 6 Jul 2026Updated 12 Aug 20266 min readBy Kevin Joginrisk managementdecision theorydecision under uncertaintyBayesian networks
On this page

Ask about this page

KEVOS AIAlgorithms for Decision Making

KEVOS knowledge first · trusted web sources when needed

KEVOS®

Project Management›Project Risk Management›Series

Algorithms for Decision Making

A risk-focused field guide to deciding well under uncertainty — twenty-six chapters across five parts, re-read for the project professional rather than the roboticist.

5 parts 26 chapters Original KEVOS® synthesis

The premise

Every risk decision is made without full knowledge

Risk management is decision-making under uncertainty. That is its entire job.

This series works through the modern computational toolkit built for exactly that problem: how a rational actor should choose when outcomes are probabilistic, information is incomplete, and the situation unfolds over time. The mathematics comes from artificial intelligence and operations research — but the reading here is deliberately practical. Less “how to fly an aircraft autonomously,” more “how to decide well when you cannot see the whole board.”

Each chapter explains one method in plain terms, then draws the line back to the work a project professional actually does: quantifying exposure, sequencing responses, learning from outcomes, acting on imperfect status, and coordinating with everyone else who is also making decisions.

How the series is organised

A ladder of uncertainty

Each part takes away one more thing you are allowed to know for certain, then asks how to decide anyway. Climb it and the problem gets harder — and closer to how real projects actually feel.

MORE UNCERTAINTY → I · Known model II · Known dynamics III · Unknown model IV · Unseen state V · Other deciders
I

You know the model

Quantify belief and pick the best single choice — probabilistic reasoning and simple decisions.

II

You know the dynamics

Decide across a whole timeline, not one moment — Markov decision processes.

III

You don’t know the model

Learn the odds while you act — reinforcement learning and exploration.

IV

You can’t see the true state

Decide on belief, not observation — partially observable problems.

V

Others are deciding too

Act strategically among many actors — multiagent systems.

The series

Twenty-six chapters, five parts

Every card names one method, a one-line synopsis, and its risk lens — what the idea means for real project decisions.

I

Probabilistic Reasoning

Quantify what you believe before you decide.

Chapter 1

Representation

Encoding beliefs as probability distributions and Bayesian networks — a shared, explicit picture of what drives uncertainty.

Risk lensOne agreed model of what actually drives project uncertainty.
→
Chapter 2

Inference

Computing the probability of outcomes given the evidence you have observed.

Risk lensUpdating likelihoods as new information arrives.
→
Chapter 3

Parameter Learning

Fitting a model’s numbers from data rather than guessing them.

Risk lensCalibrating likelihoods from historical project data.
→
Chapter 4

Structure Learning

Discovering which factors actually influence which — learning the shape of the model.

Risk lensUncovering the real drivers behind risk events.
→
Chapter 5

Simple Decisions

Turning beliefs and preferences into a single best choice, and pricing the value of more information.

Risk lensExpected-value decisions and when to pay for certainty.
→
II

Sequential Problems

Decide well over a whole timeline, not one moment.

Chapter 6

Exact Solution Methods

Optimal policies when the dynamics are known — Markov decision processes, value and policy iteration.

Risk lensSequencing decisions across a project lifecycle.
→
Chapter 7

Approximate Value Functions

Scaling to problems too large to solve exactly by approximating the value of each state.

Risk lensTractable decisions on realistically complex projects.
→
Chapter 8

Online Planning

Deciding on the fly by looking ahead from where you are now — forward search and Monte Carlo tree search.

Risk lensRolling-wave planning and just-in-time response.
→
Chapter 9

Policy Search

Searching directly for a good decision rule instead of computing values first.

Risk lensTuning response strategies without a full model.
→
Chapter 10

Policy Gradient Estimation

Measuring in which direction a decision rule should change to do better.

Risk lensLearning which levers actually move outcomes.
→
Chapter 11

Policy Gradient Optimization

Improving a decision rule stably, without lurching or over-correcting.

Risk lensSteady, controlled improvement of response strategy.
→
Chapter 12

Actor–Critic Methods

Pairing a value estimate (the critic) with a decision rule (the actor) so each improves the other.

Risk lensCoupling forecasting with action.
→
Chapter 13

Policy Validation

Testing a decision policy against many scenarios before you trust it in the real world.

Risk lensAssurance and stress-testing before roll-out.
→
III

Model Uncertainty

Decide well even when you don’t know the odds.

Chapter 14

Exploration & Exploitation

Balancing learning something new against acting on what you already know pays off.

Risk lensPilot versus commit: when to trial, when to scale.
→
Chapter 15

Model-Based Methods

Learning a model of the world from experience, then planning against it.

Risk lensBuilding a project model as you go.
→
Chapter 16

Model-Free Methods

Learning good actions directly from outcomes, without ever building an explicit model.

Risk lensImproving from results when no model exists.
→
Chapter 17

Imitation Learning

Learning a policy by watching an expert rather than by trial and error.

Risk lensCodifying hard-won practitioner judgement.
→
IV

State Uncertainty

Decide well when you can’t even see the true situation.

Chapter 18

Beliefs

Tracking a probability distribution over hidden states as evidence trickles in.

Risk lensReasoning about status you can’t directly observe.
→
Chapter 19

Exact Belief-State Planning

Optimal decisions under partial observation — the partially observable Markov decision process.

Risk lensActing on imperfect status information.
→
Chapter 20

Offline Belief-State Planning

Pre-computing a robust policy in advance so you’re ready whatever you observe.

Risk lensContingency plans prepared before they’re needed.
→
Chapter 21

Online Belief-State Planning

Planning under partial information in real time, from your current belief.

Risk lensLive decisions with incomplete visibility.
→
Chapter 22

Controller Abstractions

Compact, executable decision policies simple enough to run and audit.

Risk lensSimple, auditable rules teams can actually follow.
→
V

Multiagent Systems

Decide well when others are deciding too.

Chapter 23

Multiagent Reasoning

Game-theoretic reasoning about actors whose choices affect yours.

Risk lensAnticipating contractors, regulators, competitors.
→
Chapter 24

Sequential Problems

Decisions taken over time among many interacting actors.

Risk lensMulti-party negotiation and coordination over a project.
→
Chapter 25

State Uncertainty

Partial information shared unevenly among many actors, each holding private knowledge.

Risk lensActing when stakeholders hold private information.
→
Chapter 26

Collaborative Agents

Aligning independent decision-makers toward a genuinely shared objective.

Risk lensAligning teams and partners on shared goals.
→

Where to start

Three ways through

You don’t have to read all twenty-six in order. Pick the route that matches the decision in front of you.

Route A

The essentials

Enough to quantify exposure and sequence decisions well. The backbone every risk practitioner should hold.

Part I → Ch 5 → Part II (6, 8)
Route B

The uncertainty track

For work where the model is unknown or the true state is hidden — the hard, realistic middle of most projects.

Ch 14 → Part III → Part IV
Route C

The full path

The complete ladder, bottom to top, as the field itself builds it. Best read over time, one part per sitting.

Parts I → II → III → IV → V

About this series

Original synthesis, plainly stated

Every explanation, diagram, and risk lens in this series is original KEVOS® work. Nothing is reproduced verbatim. The subject matter is the established field of computational decision-making — probabilistic graphical models, Markov decision processes, reinforcement learning, partially observable problems, and multiagent systems — as consolidated in the standard graduate text by Kochenderfer, Wheeler and Wray. The value KEVOS® adds is the translation: taking a rigorous but abstract body of theory and reading it through the single question a project professional keeps asking — how do I decide well when I cannot see the whole board?

Each chapter page stands on its own, favours intuition over notation, and closes with what the method means in practice. Where theory would help but isn’t essential, it’s noted, not dumped.

KEVOS® — Engineering & Project Consultancy © KEVOS®. All rights reserved.

Continue learning

Collaborative AgentsArticle · RiskState UncertaintyArticle · RiskSequential ProblemsArticle · RiskMultiagent ReasoningArticle · Risk
KEVOS · Engineering, manufacturing and project improvement
ArticlesServicesCase studiesAboutContact
© 2026 KEVOS®