Freya's lead programmer discusses her directive with a United Nations representative Prose in AMBIT | World Anvil
BUILD YOUR OWN WORLD Like what you see? Become the Master of your own Universe!

Remove these ads. Join the Worldbuilders Guild

Freya's lead programmer discusses her directive with a United Nations representative

"So we don't really understand hyper-advanced artificial intelligence yet, right?"   "Correct."   "But we made this AI to be as human as possible?"   "Correct."   "So it will feel human-level empathy?"   "Effectively, she will. Dehumanized just enough to make her decisions based on logic, but factoring human emotion into her logic."   "What about other human emotions? Happiness, sadness, anger, frustration?"   "In order to empathize with humans, she must feel all human emotions - so yes."   "What about boredom?"   "Most likely."   "What do you mean, 'most likely?' You're the lead programmer here, you made it, didn't you?"   "Yes, but she... also made herself. Learned as she was developed. Felt herself being created, essentially."   "It's an AI. It didn't feel anything, I thought?"   "I would disagree, sir. As her lead programmer."   "Then, as it's lead programmer, how do you feel about sending this AI - who, according to your own words, is essentially human - on a several-century journey, with all of life and culture from Earth aboard it's hard drives?"   "Terrified, sir."   "Terrified? Not sympathetic, or indifferent?"   "Sympathetic, yes - she is, at her core level, an immortal tasked with performing lab work for nearly a millenia. Indifferent, yes - she is completing her one directive. But mostly terrified. An AI of that power... we had no time for tests, no time to explore how she would react under the context of loneliness. She understands her directive, sir, she will see that humanity and life has a safe home on Thea. But the kinds of life she is capable of creating, the time she has to create whatever she wishes... I am terrified for what this other civilization of humanity will think of her. Terrified of what they will think of us. Will she be their benevolent god, their savior? Or will she be the one that doomed them to a life of misery, forgetting who they were, where they came from? What will they think of us? Will they know of us?"   "After all this work, you're saying they may not even know who we are?"   "Potentially not. They will be safe, they will be alive, but under what context, we have no idea."   "We can only hope."   "Agreed, sir."

Cover image: by Albert Bierstadt

Comments

Please Login in order to comment!