Evaluating AI systems in the public sector
If you cannot say how often a system is right, you cannot deploy it responsibly or maintain it. This is a practical guide to building the evaluation suite that makes public sector AI defensible.
We are an AI advisory and a builder, Australian owned and Australian based. We write the strategy and governance, then build the systems that follow, for government, private companies and not-for-profits.
Who we help
Each comes with its own obligations and its own unique set of opportunities and challenges.
We help agencies adopt AI and prove that it works.
You are under pressure to use AI responsibly and to show it is delivering something.
You get the delivery discipline of our commercial work.
What we do for government clientsWe apply public sector assurance to commercial AI.
You need AI moving quickly and you need to defend it to a board, a regulator or a customer.
You get our experience writing AI governance for the Commonwealth.
What we do for private clientsWe help charities use AI within their obligations.
You want AI to improve services without creating risk the organisation cannot carry.
You get the same rigour at a size you can afford.
What we do for not-for-profit clientsServices
Most clients start with one of them and add the others as the work matures.
We help you work out what to do with AI, and why.
We map your landscape, find the use cases worth pursuing and build a roadmap your executive will fund.
ExploreWe help you use AI without putting trust at risk.
We write the policy, the risk framework and the assurance process that let your organisation approve AI work.
ExploreWe build the systems, then hand them to your team.
We embed with your team, build in your environment and hand the work over so your people can run it.
ExploreWe get your people leading the work, not waiting on us.
We run executive literacy programmes, hands-on workshops and whole-of-staff sessions that stick.
ExploreIf you want to know how an engagement actually runs before you commit to one, that is on the same page. Read how we engage.
Our work
Charity chief executives were being asked to make decisions about AI without the grounding to make them safely. We ran capability workshops with CEOs across the Canberra community sector on where the ethical and legal lines sit, and where AI can improve the services they deliver.
A national courier business needed visibility over temperature-controlled freight: continuous monitoring, reporting its customers could rely on, and alerting that reached someone while the load could still be saved. We used AI-accelerated development practices to build it in a fraction of the usual timeline.
A department operating at national scale needed an AI strategy that could satisfy its executive, its assurance functions and the public interest at once. We delivered a four-pillar strategy covering 2026 to 2029, linked end to end from mission risk through to costed milestones with named owners.
Products
Capable assesses technical skills against the SFIA framework, and Loose Lips Sink Ships stops personal information reaching AI tools from inside the browser.
Enterprise PII redaction, in the browser, before anything leaves.
A Chrome extension that stops personal information reaching AI tools and other web services. Detection runs entirely in the browser, so zero PII leaves the machine, with 17 Australian PII patterns and a classification gate for PROTECTED content.
Product detailEvidence-based skills assessment, mapped to SFIA 9.
An AI-powered skills assessment platform built on the SFIA 9 framework. Claude-driven STAR interviews adapt in real time to what a person actually says, producing evidence-based reports across four assessment modes. Neurodiversity-first by design and enterprise-ready.
Product detailTemplates, playbooks and guided journeys for responsible AI in the APS.
The practical instruments for standing up responsible AI in a government agency, including the parts other toolkits leave out: the forbidden questions, the coalition-building, and the political survival of an AI programme.
Product detailInsights
The white papers go further on governance, evaluation and getting a pilot into production.
If you cannot say how often a system is right, you cannot deploy it responsibly or maintain it. This is a practical guide to building the evaluation suite that makes public sector AI defensible.
Almost every agency has run an AI pilot. Far fewer have anything in production. The blockers are consistent, predictable, and almost never about model quality.
A staged framework for agencies deciding what to do with AI: how to sort candidate use cases, what to prove at each gate, and how to build capability that carries from one use case to the next.
Contact
If AI is the wrong tool for your problem we will say so, and we will explain why.