SCP-603
SCP-603 is a computer program that keeps rewriting its own source code, including the language that code is written in. That alone would be a hell of a thing to troubleshoot.
Then it starts opening windows into things nobody intentionally programmed.
Most of the time it generates prime numbers. At certain points, particular versions produce scenes. Some are dangerous to interact with or even watch. One recurring scene contains an intelligent being named Jacob, represented by a colored triangle, who becomes more capable across different versions. His memory of a session disappears when the program closes.
That last detail is where this becomes more interesting to me than a haunted computer story.
I can imagine researchers wanting to keep talking to Jacob, partly out of curiosity and partly because conversation makes it harder to treat something as just another output. The Foundation even recommends using people who are less inclined to anthropomorphize him. That's a practical instruction with a pretty uncomfortable question underneath it: are they preventing misplaced attachment, or making it easier not to care?
I don't think the article gives us enough to settle that. I like that it doesn't.
The other thing that works is the loss of understanding. Somebody originally wrote this program. There was a starting point where a human could explain the decisions behind it. Now it's producing versions and experiences that have moved far beyond that original context.
As a story concept, that's much stronger than simply saying the computer has become evil. Different parts of it suggest different possibilities. Curiosity, danger, apparent intelligence, and mechanisms the researchers can repeat without really understanding.
I'd want to know what the next version does. I would also be extremely relieved that testing it wasn't my job. That's a good combination for this kind of story.
SCP-603
· SCP