Roger Clarke's Web-Site

© Xamax Consultancy Pty Ltd,  1995-2026
Photo of Roger Clarke

Roger Clarke's 'The Last Short Story'

The Last Short Story

Version of 17 August 2026

Published on 20 August 2026 as 'How to prevent the AI apocalypse' in Information Age,
the flagship title of the Australian Computer Society

Roger Clarke **

? Xamax Consultancy Pty Ltd, 2026

Available under an AEShareNet Free
for Education licence or a Creative Commons 'Some
Rights Reserved' licence.

This document is at http://rogerclarke.com/EC/LSS.html


I tried to work up a spoof short story.

A person trains their personal agentic GenAI to draft curmudgeonly responses to every message that they receive.
When the person goes on holidays, they take the human-out-of-the-loop by switching on auto-response.
Their plane crashes.
Their ISP has been paid 5 years ahead. The executor can't find the password. The ISP has its own agent running and hence ignores all attempts to close the account.
Variations of patterns like this are repeated many times over.
Inter-agent drivel proliferates.
Humans soon get overwhelmed by the flood of generated traffic, and cede the messaging services to the robots.
Inter-human communication skills wither away.
The species goes extinct not through a robot apocalypse but with a whimper.

But then I realised that what I actually need to do is to train my personal agentic GenAI to create a spoof short story that ...

Not all AI invites the species to self-destruct.

Several mature forms have escaped the albatross that is the 'AI' tag. Logic programming, rule-based expert systems and multiple forms of pattern recognition have wrinkles, but can be managed and deliver value. Natural language processing is workable, but hamstrung by the vagaries of humans' use of language and the absence of any real semantic capability. Natural language generation is a standout performer, as evidenced by the beguiling text it delivers from the trivially simplistic grammatical model embedded in large language models (LLMs).

The last couple of decades have seen a game-changer. To some extent that's been because of progress in AI tech. But to a large degree the situation's changed because of the laziness, gullibility, and willingness to suspend disbelief, of us humans. Both AI/ML data analytics tools based on artificial neural nets (ANNs), and LLM-based GenAI, are empirically-based. They use obscure forms of correlation to generate new inferences, or new content, for which no rationale exists. In this field, the notion of explainable AI (XAI) is merely an aspiration, not a deliverable.

Dependence on ANNs involves the abandonment of half of the cycle on which 500 years of science has been based. The basic cycle comprises observation, ad hoc theory, prediction from that theory, observation designed to test the prediction, refinement of theory, rinse-and-repeat. But AI/ML and GenAI have hollowed out that cycle. There is no theory. And without a theory, systemic reasoning isn't possible. And without an understanding of the rationale underlying decisions and actions, no reviewer, regulator or court can assign accountability. The abandonment of science undermines millennia of social patterns.

One way to look at it is that spruikers are again selling us 'strong AI' notions. AI began in 1955-1970 with the declared intention of creating artificial forms of human intelligence. AI practitioners long since stopped aspiring to deliver Artificial General Intelligence. Instead, they see human intelligence as an inspiration. An interpretation of AI that reflects its practitioners' views is:

Intelligence is exhibited by an artefact if it:

(1) evidences perception and cognition of relevant aspects of its environment ('world-awareness')

(2) has goals; and

(3) formulates actions towards the achievement of those goals
(which together represent 'apparent intentionality');

but also, for some commentators at least:

(4) implements those actions (i.e. it has some degree of 'artefact autonomy').

There's another way. Its basis has been known for decades. It would be a good idea for us to act like a mature species, by harnessing tech, thereby avoiding being harnessed by it.

Ashby's 1956 idea of intelligence amplification and Engelbart's 1962 proposals about augmenting human intellect led to the term 'Augmented Intelligence'. That describes the combination of human intelligence with artefact intelligence that's expressly designed to be complementary to human intelligence. Soon after that, the concept of decision support systems emerged. Combining those ideas, 'Complementary Artefact Intelligence' has the following key attributes:

Meanwhile, in the parallel world of robotics, it was quickly appreciated that artefact autonomy isn't absolute. We can delegate to devices in qualified and controlled ways. To address those issues, we can apply the same notions of complementariness and augmentation that demonstrably work for intelligence, to the capacity to act as well. Here's a depiction of the alternative conception of artefactual intelligence and capability that puts the notions of 'a singularity' and 'a robot apocalypse' back where they belong, in pop sci-fi:

We need to design both artefactual software and hardware as tools convenient for humans. Robots are out; cobots are in. Socio-technical combinations then deliver inferences, decisions and actions with human capabilities in the loop, and accountability is sustained. Short stories can continue to be written, by humans utilising and controlling GenAI tools.

__________________________

The interpretations and arguments expressed here are those of the author alone. They draw on decades of consultancy practice in strategic and policy implications of disruptive ICT, supplemented by research into robotics and AI. Fuller versions of the argument can be found in refereed research articles here and here.


Author Affiliations

Roger Clarke is Principal of Xamax Consultancy Pty Ltd, Canberra. He is also a Visiting Professorial Fellow associated with UNSW Law & Justice, and a Visiting Professor in Computing in the College of Systems & Society at the Australian National University. The author spent a decade as Chair of the Economic, Legal and Social Implications Committee (ELSIC) of the Australian Computer Society, and is currently ACS's Vice-President -- Membership.



xamaxsmall.gif missing
The content and infrastructure for these community service pages are provided by Roger Clarke through his consultancy company, Xamax.

From the site's beginnings in August 1994 until February 2009, the infrastructure was provided by the Australian National University. During that time, the site accumulated close to 30 million hits. It had passed 80 million by the end of 2025.

Sponsored by the Gallery, Bunhybee Grasslands, the extended Clarke Family, Knights of the Spatchcock and their drummer, and her Dr Nurse site
Xamax Consultancy Pty Ltd
ACN: 002 360 456
78 Sidaway St, Chapman ACT 2611 AUSTRALIA
Tel: +61 2 6288 6916

Created: 16 August 2026 - Last Amended: 22 August 2026 by Roger Clarke
This document is at www.rogerclarke.com/EC/LSS.html
Mail to Webmaster   -    © Xamax Consultancy Pty Ltd, 1995-2026   -    Privacy Policy