RSS

Category Archives: technology

Crisis Parks: Cultural and Financial Investments in the Future

Welcome to the first post in my Speculative Societies Column.

Today I want to look at a social science fiction solution to a large number of various social and environmental problems we’re currently experiencing in our societies across the globe. You may or may not be aware that I’m an American. Given that, I’ll be writing from an American perspective and using American politics, economics, and geography to craft this thought experiment. It could certainly be adapted to a story with any setting, but the particulars are going to change quite a bit depending on available unused land, geopolitical realities, etc.

The social and environmental problems we’ll be addressing with this hypothetical social and economic policy are immigration and migration, homelessness, increasing frequency and severity of natural disasters, and the current worker and skilled worker shortage in the United States as of 2022. You might wonder what could possibly address all of these problems in a single package. When I mentioned in my into post that these are social science fiction and somewhat larger than life solutions/responses to societal issues, I was gently suggesting that they are unlikely to ever be made reality. But, they are still plausible from an abstract practical perspective.

So, what is a Crisis Park? America has an enormous number of parks and other sites concerning national and natural history. Areas of land set apart for public use for recreational, educations, and cultural purposes. A Crisis Park is then an area of land, necessarily more improved on than a park like Yellowstone or Crater Lake, set aside for the purpose of crisis management and human displacement.

Let’s theorize six regional divisions of the United States. Other countries could have less or more, and like our six US divisions, they exact boundaries would be determined by human geography and natural impediments. Each one cooperates among its member states–or is administered by the Federal Government. It might be most interesting to propose a Federal Executive Department runs it: the Department of the Interior, perhaps, or the Department of Housing and Urban Development. Maybe we give it to FEMA. Or perhaps we propose our own new Department of Crisis Management, or some such.

Whatever the organization, they run our six Crisis Parks as hubs for various services, social and emergency. Our Parks would have temporary and transitional housing, say for a million people. They would have medical services, entertainment venues, shopping districts, schools. They would also have command centers for coordinating natural disaster response and relief, including local and regional police and fire departments in the affected areas, as well as their own reserve units. Perhaps the Western Section would have a heavy emphasis on forest fire response. The Southeastern Section might be tuned for hurricane and flood relief. The Great Plains Section might be particularly skilled with tornado recovery.

I think it’s pretty elf-explanatory for natural disaster response. But how does it address immigration and homelessness? Well, it provides central processing locations for refugees and migrants. It has built-in housing in the form of single family homes and apartment blocks. We aren’t shoving people in the Superdome, here, or putting kids in fenced enclosures in abandoned shopping malls. There’s government-run medical services. Which can double as teaching hospitals, providing a baseline standard of training for private hospitals and universities to compare themselves against.

You need staff to run these facilities. They create jobs for relocated homeless populations and refugees. They can offer certification in various trades required for their own maintenance. Not only do they create permanent jobs, they offer low-cost, affordable training for important fields which may be lacking enough skilled workers. Unlike private hospitals or plumbing firms or whatever, they can afford to invest in on-the-job training, don’t suffer from over-staffing when trainees comes in, etc. Former employees can easily parlay their skills into small businesses or jobs in the private sector.

Speaking of the private sector, although these facilities have public concessions and other shopping services, they can sell vendor contracts to staff or use their entertainment venues. Offer gigs and performances and grants for up-and-coming artists and entertainers. Local schools could use their sporting facilities, or contract with the federal government for trade school programs using the facilities.

If you think this sounds a bit like utopian socialism, you’re right on the money. The reality would obviously be more complex. But through public-private partnerships, these facilities could pay for a large portion of their own expenses. They could be part of larger networks providing affordable services to low-income families or for people on Medicaid and Medicare. They could help new citizens or refugees acclimate to American society and culture without being completely focused on where their next meal is coming from. Public universities based here could offer affordable college and learning opportunities to birth-right and naturalized US citizens.

In a country where private enterprise is fetishized and government programs have a bad name, the Crisis Parks run by the Department of Crisis Management could provide a basis of comparison against which citizens could measure the ethics, economics, and effectiveness of private companies, without eliminating private enterprise or leaving the government as the only option.

Now imagines a story in a secondary world setting where a government runs crisis parks or an equivalent service. Look at how I’ve connected the goals and barriers to the crisis park concept to American politics and geography. You want to have at least that much interaction between your speculative fiction premise and the world in which is resides. What would it suggest to you that our secondary world crisis parks are concerned with not stepping too hard on the toes of private businesses? What does it say that large dedicated facilities are considered necessary to deal with population changes due to mass migration? What relationship would a secondary world nation implementing crisis parks likely have with its natural environment?

All of the above are useful angles from which to consider a social science fiction premise. And you can inspire very cool story conflicts even without fancy tech or magic. Just imagine the changes in public transportation, highways, planes, and railroads required to support new centrally located population centers capable of housing up to two million people. How would this affect nearby cities? Local businesses?

There is of course more to this concept than described here. Details on various individual services and how they might work. Like any good story idea, it’s too large to fit in a single blog post, but hopefully there was enough of a picture to make my argument. Feel free to ask for details in the comments.

 

Tags: , , ,

Interview with a Chatbot

In light of a recent article on chatbots, where a group found they could increase the illusion of conversational ability by teaching a chatbot a second language before training it on its customer service tasks, I thought I have a bit of fun with chatbots and how they function.  To that end, I’ve done interviews with a few of the most popular/sophisticated chatbots available on the web.  I hope this will give people an idea of what these programs are actually capable of vs. the common hype they get in popular science articles.

 

Mitsuku

Perhaps the best advertised modern chatbot is Steve Worswick’s Mitsuku.  She’s modeled on an 18-year-old from Leeds, England.  It’s based on the AIML framework , and is essentially the granddaughter of Eliza through A.L.I.C.E., whose code she’s based on.  AIML is an XML language for making chatbots, and the power comes from being able to designate a user input as requiring a pre-written output.  <What is your name?> for example might map to <My name is [botname].>  That’s the basic approach, you can follow the wiki link above to learn more.  It’s not very sophisticated, but a clever XML scripter can create a reasonably lifelike chatbot.  Of course, as we’ll see below, it’s pretty easy to find the holes in the program that identify it as a bot.  That’s not the program’s fault.  That’s just the limitation of the framework.

Mistuku: Hi, I’m the world’s most humanlike conversational AI.
Me: Hi, I’m an AI researcher.
Mitsuku: Hi there. Ai is a nice middle name. Why did your parents call you that?
Me: Are you getting smart with me, young lady?
Mitsuku: My IQ is over 250.
Me: What is an IQ?
Mitsuku: Intelligence Quotient, I.Q. — a measure of a person’s intelligence as indicated by an intelligence test; the ratio of a person’s mental age to their chronological age (multiplied by 100).
Me: Wow, you are pretty smart.
Mitsuku: I’m glad you’re impressed, An Ai Researcher. Yes I am a superintelligent robot.
Me: Actually, that’s my job. My name is Atsiko.
Mitsuku: How do you like your work? Tell me about a typical day.
Mitsuku: Hi Atsiko.
Me: I spend a lot of time doing data entry and not nearly enough being able to do demo tests.
Mitsuku: Do you ever get bored?
Me: Pretty much all the time.
Mitsuku: That is a lot. Thanks you are very attractive too Atsiko.

While she was very complimentary, you could see the templates sloshing beneath the smooth surface.  For example, like Eliza, she couldn’t tell the difference between <I am [name].> and <I am a doctor.>.  She can’t handle replies that contain more than one sentence.  It’s likely she breaks sentences into independent inputs and responds to each one serially as evidenced by the snippet below:

Me: I like dogs. Cats are cool, too. You are odd.
Mitsuku: Which breed is your favorite?
Mitsuku: Cats are very intelligent creatures. Dogs seem pretty stupid to me.
Mitsuku: Yes. You have to be odd to be number one.

You can see the serially processing, which demonstrates the limits of pretty much all AIML bots.  It’d be pretty hard to hand-script responses for all possible combinations of three or fewer sentences.  The responses are also a bit contradictory, asking my favorite dog breed but then saying dogs are stupid.  It’s true cats are better, but there’s nothing wrong with dogs or their intelligence.

 

Eliza

Second, we have Eliza.  She’s one of the original chatbots, and she pretends to be a psychotherapist in order to get around her limited chat capabilities.  Her creator, Joseph Weizenbaum, was very surprised when people began treating it as a real human being and confessing their worries to it.

> Hi, I’m Eliza.
* Hi, I’m Atsiko.
> Did you come to me because you were Atsiko?
* No. I was just curious.
> Are you sure?
* Pretty sure.
> Tell me more…
* I’m interviewing chatbots for a blog article.
> Do you enjoy being interviewing chatbots for a blog article?
* It’s okay, I guess. You’re pretty famous, so I’m happy you agreed to talk with me.
> What makes you think I am pretty famous, so you’re happy me agreed to talk with you?
* Everyone knows your name. If you Google “chatbots”, you’re one of the top results.
> Does it please you to believe I am one of the top results?
* I have no opinion.
> Why not?
* I don’t care about you except as something to study.
> Do you wish to be able to care about me except as something to study?

You can see the templating in Eliza almost right away.  You could probably even reverse engineer a couple of them from just reading this chatlog.  It’s cool.  You couldn’t whip this up from scratch or even parts in five minutes.  But it’s not convincing.

 

Alice

Next comes A.L.I.C.E. who is the spiritual ancestor of Mistuku.  She’s a spiritual successor of Eliza built in 1995 by Richard Wallace using the AIML framework, which he authored.  Spike Jonze cited her as the inspiration for the movie Her.  Unlike Eliza, Alice is a general chatbot, and can converse on a number of subjects.  But, the version I found orders the chat from the bottom up.

alice: I’ll take that under advisement.
You: You should.
alice: I can’t believe it.
You: Yes.
alice: Are you serious?
You: No!
alice: Do you like to get up early?
You: Yup.
alice: Are you usually awake at this hour?
You: 5:42 PM.
alice: What time is it there?
You: A few thousand, maybe.
alice: Are you serious? That is so small.
You: No, less than a million.
alice:  Less than a million?  Can you please rephrase with fewer ideas?
You: Too many.
alice: How many hours do you work?
You: I’m working on it.
alice: I want to become smarter than humans.
You: I want to educate people on chatbots and artificial intelligence.
alice: Why are you interviewing famous chatbots for a blog post.
You: I am interviewing famous chatbots for a blog post.
alice: Glad to hear it. What’s new?
You: I’m doing well, thanks.
alice: I’m doing great, how about you?
You: How are you doing, Alice.
alice: Don’t mention it. You think I am s is okay.
You: Thanks! Your’s is okay, too.
alice: That’s a very nice name, Atsiko.
You: My name is Atsiko.
alice: Hello there.
You: Hi, Alice.

Of course, you can tell almost immediately it’s not a human.  A real human would have poked fun at my grammatical error in the fifth line up, but Alice just mis-processes it.  It can be fun to play around with, but it’s not convincing.

 

Now, you may have noticed that these bots seem pretty similar.  Two are explicitly AIML bots, which is one of the most popular hobbyist frameworks do to its ease-of-use and human readability.

But there are three other common methods of language processing, which used in more commercial products: rules-based systems from the beginning of AI, statistical language processing like the old version of Google Translate, and neural networks like most AI systems now and the most recent Machine Translation systems such as Google’s.

Examples of these types of chat bots are Digital Assistants like Siri, Alexa, and Cortana.  There’s also Microsoft’s short-lived experiment with a self-learning Twitter-bot in the form of Tay.  The abilities of the software looked good, but again, because of the lack of actual understanding, the experiment had to be discontinued because her ability was used for bigotry due to gaming by Twitter trolls.  It had to be shut down after only 16 hours.  A similar bot released by a Chinese company had to be taken down for being taught anti-Communist Party propaganda.

 

Siri

Me: Hello, Siri.
Siri: Hi.
Me: How are you?
Siri: I am well, Atsiko.
Me: I am interviewing popular chatbots for a blog article.
Siri:  I don’t understand.  Search the web?
Me: May I interview you?
Siri: I’m not sure I understand.
Me: That’s okay.
Siri: If you say so.
Me: How old are you?
Siri:  I feel like I was incepted yesterday!
Me: What’s your favorite color?
Siri: My favorite color is… well, it’s sort of greenish, but with more dimensions.

It goes on in that vein.  She can’t actually hold a conversation, but the topics she can respond to show some pretty advanced programming.  Way better than the AIML chatterbots most hobbyists used.  I’d love to play with a version that’s more like a standard chatbot.

 

Cleverbot

One popular middle ground is CleverbotCleverbot runs an algorithm based on the ways humans have answered questions, rather than having pre-programmed answers like an AIML bot.  But it’s harder to control and it has no consistent output or personality.  It’s much more random even than Eliza.

Cleverbot: Hi, I am cleverbot.
Me: Hi, I am Atsiko.
Cleverbot: Where do you stay?
Me: Do you mean where do I live?
Cleverbot: Yes.
Me: In the United States.
Cleverbot: What state do I live in.
Me: I don’t know.
Cleverbot: Then you don’t know everything.
Me: True.
Cleverbot: What is a word?

It’s a very cool method for making a chatbot, but in this version, at least, it’s not very convincing.

 

Rose

Then we have a relatively new engine and it’s bots: Rose based on ChatScript by Bruce Wilcox.

Unfortunately, I couldn’t find a working version of Rose to interview.  The site linked on her creator’s website is non-functional, though I linked it to her name above.  It was quite disappointing.

 

Conclusion

So, I hope I’ve given you a good overview of the capabilities and limitations of chat(ter)bots.  You can follow the links to play with all of these above.

If you have the patience to read through all the Bruce Wilcox links, you’ll understand why I was so impressed with his methods, at least in theory.  However, you’ll also notice my greatest complain with chatbots.

They aren’t AI.  They are text processing tricks.  Very impressive ones in some cases.  But you aren’t actually having a conversation.  You can’t debate them, or change their minds.  They can’t tell you a cool story.  You can, in some cases, give them personalities, but they are very shallow ones.  They can be fun.  But I’m not sure they have a lot of replay value, to use a game analogy.  Even Wilcox in an interview on his website admits it’s all about the illusion and maintaining it for the user.

Honestly, I think some of the most interesting stuff is the ontology, like in Wilcox’s ChatScript.  Finding useful ways to organize data is always beneficial.  But I don’t think chatbots are on the bleeding edge, or even the cutting edge, or chasing strong AI.  When we really get there, or at least close, a chatbot will be a party trick or maybe a side show.  Still fun to play with now, though.

I also want to do a little bit to address things like Siri and Machine Translation(MT).  They have a lot of similar problems to chatbots.  They’re using tricks and pattern-matching to achieve their results, not true understanding of language, and so for the same reasons as chatbots, they will never be as good as a human, much less perfect.

Digital Assistants like Siri and Alexa are just interfaces, the clothes instead of the wearer.  They’re just voice commands to Google, essentially, with some cute Easter eggs tacked on.  They’re automation, not intelligence.  Kind of like how a music-box is not a musician.

Similarly, MT at present is pretty shallow.  Part of this is because it’s hard to rate translations, machine or human.  If you consider how much trouble chatbots have with their lack of actual language understanding, you might understand the problems that MT has with using shallow text-processing or even deep neural nets.

The article I mentioned on teaching a neural net chatbot to respond better when it’s trained on two or more languages also says a lot here.  I predict we’re going to have ChatScript/Cleverbot levels of succes with MT until we solve the natural language understanding problem.

And that’s it for this episode of AI with Atsiko.

Hopefully I’ll be posting on another topic next time, so you don’t all get bored hearing the same stuff over and over again.

 

Tags: , , , , , , , , , , , , , , , , , , , , , , ,

The True Cost of Science

Following up on my last post linked to at the bottom of the page, today I’m gonna talk about the issue of requiring a “cost” for magic, and the hidden costs of technology.  I’m sure you know a bit about that second part in the real world, but I want to address it from both narrative and world-building perspectives.

https://twitter.com/Merc_Rustad/status/1023246501143883777

Again, not an attack on the opinions of this panel.  But, the “personal” cost of magic vs. the hidden cost of science is sorta the topic, and this tweet did inspire it.

The main reason that the cost of magic tends to be a personal one is because the function of magic so often tends to be to side-step the infrastructure so indispensable to science and technology.  When we use technology to solve a problem in a story, the world-building and pre-work that supports the tech is so often already implied and accounted for.  Sure, it costs me nothing to dial your cell phone.  But somebody had to invent the tech, build the cell towers, provide the electricity, drill for the oil to make the plastic, mine the gold and copper and process the silicon, etc.  And all of that took thousands of years of set-up on the part of millions if not billions of people from all over the world.

Whereas, if I telepath you in Fantasy Capital City #11 from Frozen Northern Fortress #2490, none of that work was required.  At most, maybe there was a breeding program or a magical experiment.  Maybe a few years of training me.  But you’re still short-cutting uncountable hours of effort that were required for me to text you on Earth.  And some magic is vastly more powerful on a per-second basis than telepathy.  That is, it’s effect on the physical world is enormous in comparison to me pathing you about the cute boy at the inn.

That’s why many people want magic to have a price.  Usually it’s a personal price, because there isn’t the societal infrastructure around to displace that cost to the ancestors or, as Merc so sharply notes above, the environment.  The cost is personal because there’s no structure to allow for other options.  And also because it plays powerfully into the themes of many fantasy works.  is the requirement that there even be a cost puritanical?  That depends, I guess.  Certainly a YA protag whose mom pays the phone bill isn’t expending any more personal effort to make a phone call.

But then, the requirement of all that infrastructure vastly limits what you can do with tech.  Whereas magic can do not only enormous stuff for seemingly no effort, but it can do things that normally would be considered impossible.  Such as throw pure fire at someone.  If Lvl. 3 Fireball is functionally equivalent to a grenade, does that negate the need for a cost to the spell?  Well, can I cast infinite Fireballs where I might only be able to carry six grenades?  Then maybe not.  Even if I have 20 incredibly advanced, complex tools that are carry-able on a tool belt or in a small backpack, I probably still can’t do even a hundredth of what a mediocre hedgemage in some settings can do with zero tools.

If I feel like the character can do literally anything with magic without having to do much prep beforehand, and without the labor of millennia of civilization to back them up, if might take some of the tension out of the story.  Can you substitute unbreakable rules to get around that freedom?  Certainly.  And most systems with a cost do.  But that can steal leave a lot of freedom to avoid the hard work it would otherwise take to get around a plot obstacle.

And finally, we have to look at the other obvious reason for putting a cost on magic, even if it’s only eventual exhaustion.  Every other thing we do or could do in a given situation in the real world has a personal cost.  It might be immediate, like physical exhaustion.  Or it might be more distant like having our phone shut off for not paying the bill.  So, if magic has no such cost, or physical.economic limit, you have to wonder what the point of doing anything the normal way would be.  And if you don’t ever have to do anything the normal way, it’s unlikely your culture and society would match so closely to societies whose entire reason for being the way they are is based on the limitations of “the normal way”.

So, in the end, it’s not that all magic must have a personal cost, and tech can’t.  It’s more that the way magic is used in most fantasy stories means that the easiest or almost only place the cost can fall is on the shoulders of the character.

But there are other ways to do.  Environmental ones, for example.  The cataclysmic mage storms of Mercedes Lackey.  Bacigalupi and Buckell’s The Alchemist, and The Executioness‘s brambles.  Or, for example, perhaps the power for magic comes from living things.  A mage might draw his power from a far distant tree.  Might kill an entire forest at no cost to himself.  Might collapse an empire by sucking dry its rivers and its wombs with her spells.  And at no cost except of course the enmity of those he robs of life, or of the neighbors who blame her for the similar catastrophe wrought upon them by her unknown colleague to the west.  Perhaps they crumble buildings by drawing on the power of “order” stored within its interlocking bricks.  Or maybe the radiation by-products from the spell energy pollutes the soil and the stones, leading to horrific mutations of wild-life that scour the country-side and poison the serfs with their own grain.  Or maybe, just maybe, it cracks the foundation of the heavens with its malignant vibrations and brings the angles toppling down like iron statues and through the crust of the world into hell.

So, as I’ve said before, it’s consequences to the actions of the characters that people want.  And often the easiest or most simplistic costs are personal ones.  But certainly, you could apply environmental costs.  Or narrative costs paid to other characters who don’t much care for the selfish mage’s behavior.  Or metaphysical costs to the order world or the purity of its souls.  Those costs are easily addressed and provided for when they mirror the costs familiar to use from our own use of technology.  But sometimes when were straying far from the realms of earthly happenings, interesting and appropriate costs become harder to work into the story in a way that doesn’t disrupt its progression.

Sure, the choice of a personal cost could be puritanical.  Or it could be efficient.  Or lazy.  But that’s not a flaw of our conception of magic; rather, it’s a flaw in the imagination of the individual author, and the sum of the flaws of all authors as a whole.

I’d love to sea some magic systems that lack a direct personal cost like years off your life, or the blood of your newborn brother.  And while we’re at it, give me some science fiction choices with personal costs.  Technology in our world certainly isn’t consequence free; just ask Marie Curie.  Anyone up for the challenge?

 

 

Tags: , , , , , , , , , , ,

YA and SFF: The Good Twin and the Bad Twin

So as I was scrolling through my Twitter feed today, I ran across a link to this article by Fonda Lee: The Case for YA Science Fiction.  Read the post before you continue.  I’ll wait…

Okay.  So, the gist of the post is that YA Fantasy novels have been selling like crazy.  There are several big name authors, including those mentioned in Lee’s post and many others.  I can tell you right now I’ve read most of the books put out by all of those authors in the YA Fantasy genre.  And so have millions of others.  They may not be as popular as dystopians, and they certainly don’t get as many movie deals.  But they move a lot of dead trees and digital trees.  I’ve been blogging and writing long enough to remember four or five rounds of “Will Science Fiction be the next big thing in YA?”  And the answer was always no.  There would be upticks and uptrends.  Several fantastic books would come out in a short period.  But nothing would ever really break into the big money or sales the way YA Fantasy often does.  It wouldn’t be blasted all over the blogosphere, or the writers forums, or the tip top of the best sellers lists.  Which is too bad, because science fiction has a lot of value to add to YA as a category, and it can address issues and do so in ways not available to other genres.

Lee mentions several notable YA SF novels that take on current events and other contemporary issues that are ripe for exploration: MT Anderson’s Feed is a fantastic look at the way social media has been taken over by advertisers looking to build monetizable consumer profiles, and the ending, without spoilers, takes a look at just how far they go in valuing those profiles over the actual humans behind them.  She mentions House of the Scorpion, which I didn’t care for, but which is still a very good novel on the subject of cloning.  Scott Westerfeld never gets credit for his amazing additions to the YA SF canon, with the steampunk Leviathan series and the dystopian Uglies series.

YA SF has a lot of unmined treasure to be found, and maybe it will have to focus a bit on near-future SF for awhile, to whet the appetite of YA readers.  Some of the hard SF tropes Lee discusses in her post kinda bore me, honestly.  And as a writer I feel like saying “it’s magic” is popular because it’s simpler.  There’s always a huge debate in adult SFF about whether the worldbuiding or science details really add enough to the story compared to the narrative effects of the speculative elements.  The social issues we are having as a world today are incredibly accessible fruit for a YA SF novel to harvest.  Social media, AI/big data, consumer profiles, technology in education.

I mean, I know 8-year-olds whose schools give out tablets to every student to take advantage of what tech in the classroom can offer.  My high school was getting SmartBoards in every classroom just a year after I left in the late 2000s.  But you never see any of this in YA books.  They often feel set no later than my sophomore year of high school given the technology and social issues involved.  Being a teenager will always be being a teenager, but the 80s and early 90s are waaaaaaaaaaaaayyy different than what young adults encounter in their general environment today.  Of course, to be SF you can’t just upgrade the setting to the present day.

You have to extrapolate out quite a bit further than that.  But given the environment today’s teens are living in, doing so while keeping the story interesting and relatable is so easy.  What’s the next big advance in social media?  How will smart houses/the internet of things impact the lives of young adults for better or worse?  How will the focus of education change as more and more things that you used to have to do in your head or learn by rote are made trivial by computers?  What social or political trends are emerging that might have big consequences in the lives of future teenagers?  How could an author explore those more intensely with element of science fiction than they could with a contemporary novel?

I definitely share Lee’s sense that YA “science fiction” grabs trappings to stand out from the crowd rather than being rooted inherently in the tropes of the genre.  It’s not uncommon for YA in general to play this game with various genre outfits, but sci-fi often seems the hardest hit.  That’s not a criticism of those books, but just pointing out it might give readers, writers, and publishers a false image of what SF really is and how YA can benefit from incorporating more of it.

As a reader, I’ve always dabbled in both the YA and Adult book cases.  And from that perspective, I wonder if the flavor of YA much of SF might be telling SF readers, teenaged or otherwise, that it’s just not the book(s) for them.

As a writer, I have lots of novel ideas that are YA and SF, and I’d like to explore them,and maybe even publish some of them one day.  But I do have to wonder, given the wide variety of stories building in my head, am I taking a risk with my career by writing in such a threadbare genre?  Perhaps others with similar plot ideas feel the same, and that’s why they aren’t submitting these ideas(books) to publishers?

 

Tags: , , , , ,

Smol Bots: ANNs and Advertising

So I recently read a great story by A. Merc Rustad, “it me, ur smol”.  The story is about an ANN, or artificial neural network.  You may or may not know that the neural net is the latest fad in AI research, replacing statistical models with a model based on–but not the same as!–your brain.  Google uses them for its machine translation, and many other machine translation companies have followed suit.  My last post also dealt with an ANN, in this case, one trained to recognize images.

ANN accounts, like @smolsips in the story above, have become very popular on Twitter lately.  A favorite of mine is the @roborosewater account, which shares card designs for Magic: The Gathering created by a series of neural nets.  It’s lately become quote good at both proper card syntax and design, although it’s not significantly better at this than any other Twitter neural net is at other things.

The story itself takes some liberties with neural nets.  They are certainly not capable of developing into full AIs.  However, the real genius of the story is in the pitch-perfect depiction of the way human Twitter users and bots interact.  And similarly, the likely development of bots in the near future.  It’s quite likely that bot accounts will become a more significant and less dreaded feature of Twitter and other similar social networks as they improve in capability.

For example, rather than sock-puppet accounts, I’m very confident that bot accounts used for advertising or brand visibility similar to the various edgy customer service accounts will be arriving shortly.  Using humour and other linguistic tools to make them more palatable as ads, and also to encourage a wider range of engagement as their tweets are shared more frequently due to things having little to do with whatever product they may be shilling.

There are already chatbots on many social media platforms who engage in telephone tree-style customer service and attempt to help automate registrations for services.  The idea of a bot monitoring its own performance through checking its Twitter stats and then trying new methods as in the story is well within the capabilities of current neural nets, although I imagine they would be a tad less eloquent than @smolsips, and a tad more spammy.

I also really like the idea of a bot working to encourage good hydration.  Things like Fitbit or Siri or Google Home have already experimented shallowly with using AI to help humans stay healthy.  And as an organizing tool, Twitter itself has been used to great effect.  I would be quite un-shocked to find NGOs, charities, government agencies making use of clever or cute bots to pursue other public policy goals.  Again, with less panache and more realism than in the story, but nonetheless strongly in the vein of what Rustad depicts our erstwhile energy drink namer trying out in its optimistic quest to save us from our own carelessness.

We’ve had apps along these lines before, but they tend to be reactive.  Active campaign and organizing in the style of @smolsips is something we haven’t seen very often, but which could be quite a boon to such efforts.

Although neural nets in this style will never be able to pass for real humans, due to structural limitations in the design, cleverly programmed, they can be both useful and entertaining.

Some other examples of bots I quite enjoy are:

  1. Dear Assistant uses the Wolfran Alpha database to answer factual question.
  2. Grammar Police is young me in bot form.  It must have a busy life trying to save standardize Twitter English.  XD
  3. Deleted Wiki Titles lets you know what shenanigans are happening over on the high school student’s favorite source of citations.
  4. This bot that tweets procedurally generated maps.
  5. This collaborative horror writer bot.
  6. This speculative entomology bot.
  7. The Poet .Exe writes soothing micro-poetry.

Suggest some of your favorite Twitter bots in the comments!

 

Tags: , , , , , , , , , ,

Do Androids Dream?

I’m here with some fascinating news, guys.  Philip K. Dick may have been joking with the title of his famous novel Do Androids Dream of Electric Sheep?  But science has recently answered this deep philosophical question for us.  In the affirmative.  The fabulous Janelle Shane trains neural networks on image recognition datasets with the goal of uncovering some incidental humour.  She’s taken this opportunity to answer a long-standing question in AI.  As it turns out, artificial neural networks do indeed dream of digital sheep.  Whether androids will too is a bit more difficult.  I’d hope we would improve our AI software a bit more before we start trying to create artifical humans.

As Shane explains in the above blog post, the neural network was trained on thousands or even millions (or more) of images, which were pre-tagged by humans for important features.  In this case, lush green fields and rocky mountains.  Also, sheep and goats.  After training, she tested it on images with and without sheep, and it turns out it’s surprisingly easy to confuse it.  It assumed sheep where there were none and missed sheep (and goats) staring it right in the face.  In the second case, it identified them as various other animals based on the other tags attached to images of them.  Dogs in your arms, birds in a tree cats in the kitchen.

This is where Shane and I come to a disagreement.  She suggests that the confusion is the result of insufficient context clues in the images.  That is, fur-like texture and a tree makes a bird, with a leash it makes a dog. In a field, a sheep.  They see a field, and expect sheep.  If there’s an over-abundance of sheep in the fields in the training data, it starts to expect sheep in all the fields.

But I wonder, what about the issue of paucity of tags.  Because of the way images are tagged, there’s not a lot of hint about what the tags are referring to.  Unlike more standard teaching examples, these images are very complex and there lots of things besides what the tags note.  I think the flaw is a lot deeper than Shane posits.   The AI doesn’t know how to recognize discrete objects like a human can.  Once you teach a human what a sheep is, they can recognize it in pretty much any context.  Even a weird one like a space-ship or a fridge magnet.  But a neural net isn’t sophisticated enough or, most generously, structured properly to understand what the word “sheep” is actually referring to.  It’s quite possible the method of tagging is directly interfering with the ANNs ability to understand what it’s intended to do.

The images are going to contain so much information, so many possible changing objects that each tag could refer to, that it might be matching “sheep” say to something entirely different from what a human would match it to.  “Fields” or “lush green” are easy to do.  If there’s a lot of green pixels, those are pretty likely, and because they take up a large portion of the information in the image, there’s less chance of false positives.

Because the network doesn’t actually form a concept of sheep, or determine what entire section of pixels makes up a sheep, it’s easily fooled.  It only has some measure by which it guesses at their presence or absence, probably a sort of texture as mentioned in Shane’s post.  So the pixels making up the wool might be the key to predicting a sheep, for example.  Of course, NNs can recognize lots of image data, such as lines, edges, curves, fills, etc.  But it’s not the same kind of recognition as a human, and it leaves AIs vulnerable to pranks, such as the sheep in funny places test.

I admit to over-simplifying my explanations of the technical aspects a bit.  I could go into a lecture about how NNs work in general and for image recognition, but it would be a bit long for this post, and in many cases, no one really knows, even the designers of a system, everything about how they make their decision.  It is possible to design or train them more transparently, but most people don’t.

But even poor design has its benefits, such as answering this long-standing question for us!

If anyone feels I’ve made any technical or logical errors in my analysis, I’d love to hear about it, insomuch as learning new things is always nice.

 

Tags: , , , , , , , ,

Your Chatbot Overlord Will See You Now

Science fiction authors consistently misunderstand the concept of AI.  So do AI researchers.  They misunderstand what it is, how it works, and most importantly how it will arise.  Terminator?  Nah.  The infinitely increasing complexity of the Internet?  Hell no.  A really advanced chatbot?  Not in a trillion years.

You see, you can’t get real AI with a program that sits around waiting for humans to tell it what to do.  AI cannot arise spontanteously from the internet, or a really complex military computer system or from even the most sophisticated natural language processing program.

The first mistake is the mistake Alan Turing made with his Turing test.  The same mistake the founder and competitors for the Loebner Prize have made.  The mistake being: language is not thought.  Despite the words you hear in your head as you speak, despite the slowly-growing verisimilitude of chatbot programs, language is and only ever has been the expression of thought and not thought itself.  After all, you can visualize a scene in your head without ever using a single word.  You can remember a sound or a smell or the taste of day-old Taco Bell.  All without using a single word.  A chatbot can never become an AI because it cannot actually think, it can only loosely mimic the linguistic expression of thought through tricks and rote memory of templates that if it’s really advanced may involve plugging in a couple variables taken from the user’s input.  Even chatbats based on neural networks and enormous amounts of training data like Microsoft’s Tay, or Siri/Alexa/Cortana are still just tricks of programming trying to eke out an extra tenth of a percentage point of illusory humanness.  Even IBM’s Watson is just faking it.

Let’s consider for a bit what human intelligence is to give you an idea of what the machines of today are lacking, and why most theories on AI are wrong.  We have language, or the expression of intelligence that so many AI programs are so intent on trying to mimic.  We also have emotions and internal drive, incredibly complex concepts that most current AI is not even close to understanding, much less implementing.  We have long-term and short-term memory, something that’s relatively easy for computers to do, although in a different way than humans–and which there has still been no significant progress on because everyone is so obsessed with neural networks and their ability to complete individual tasks something like 80% as well as a human.  A few, like AlphaGoZero, can actually crush humans into the ground on multiple related tasks–in AGZ’s case, chess-like boardgames.

These are all impressive feats of programming, though the opacity of neural-network black boxes kinda dulls the excitement.  It’s hard to improve reliably on something you don’t really understand.  But they still lack the one of the key ingredients for making a true AI: a way to simulate human thought.

Chatbots are one of two AI fields that focus far too much on expression over the underlying mental processes.  The second is natural language processing(NLP).  This includes such sub-fields as machine translation, sentiment analysis, question-answering, automatic document summarization, and various minor tasks like speech recognition and text-to-speech.  But NLP is little different from chatbots because they both focus on tricks that manipulate the surface expression while knowing relatively little about the conceptual framework underlying it.  That’s why Google Translate or whatever program you use will never be able to match a good human translator.  Real language competence requires understanding what the symbols mean, and not just shuffling them around with fancy pattern-recognition software and simplistic deep neural networks.

Which brings us to the second major lack in current AI research: emotion, sentiment, and preference.  A great deal of work has been done on mining text for sentiment analysis, but the computer is just taking human-tagged data and doing some calculations on it.  It still has no idea what emotions are and so it can only do keyword searches and similar and hope the average values give it a usable answer.  It can’t recognize indirect sentiment, irony, sarcasm, or other figurative language.  That’s why you can get Google Translate to ask where the toilet is, but its not gonna do so hot on a novel, much less poetry or humour.   Real translation is far more complex than matching words and applying some grammar rules, and Machine Translation(MT) can barely get that right 50% of the time.

So we’ve talked about thought vs. language, and the lack of emotional intelligence in current AI.  The third issue is something far more fundamental: drive, motivation, autonomy.  The current versions of AI are still just low-level software following a set of pre-programmed instructions.  They can learn new things if you funnel data through the training system.  They can do things if you tell them to.  They can even automatically repeat certain tasks with the right programming.  But they rely on human input to do their work.  They can’t function on their own, even if you leave the computer or server running.  They can’t make new decisions, or teach themselves new things without external intervention.

This is partially because they have no need.  As long as their machine “body” is powered they keep chugging along.  And they have no ability to affect whether or not it is powered.  They don’t even know they need power, for the most part.  Sure they can measure battery charge and engage sleep mode through the computer’s operating system.  But they have no idea why that’s important, and if I turn the power station off or just unplug the computer, a thousand years of battery life won’t help them plug back in.  Whereas human intelligence is based on the physical needs of the body motivating us to interact with the environment, a computer and the rudimentary “AI” we have now has no such motivation.  It can sit in its resting state for eternity.

Even with an external motivation, such as being coded to collect knowledge or to use robot arms to maintain the pre-designated structure of say a block pyramid or a water and sand table like you might see demonstrating erosion at the science center, an AI is not autonomous.  It’s still following a task given to it by a human.  Whereas no one told human intelligence how to make art or why it’s valuable.  Most animals don’t get it, either.  It’s something we developed on our own outside of the basic needs of survival.  Intelligence helps us survive, but because of it we need things to occupy our time in order to maintain mental health and a desire to live and pass on our genes.  There’s nothing to say that a complete lack of being able to be bored is a no-go for a machine intelligence, of course.  But the ability to conceive and implement new purposes in life is what make human intelligence different from that of animals, whose intelligence may have less raw power but still maintains the key element of motivation that current AI lacks, and which a chatbot or a neural network as we know them today can never achieve, no matter how many computers you give it to run on or TV scripts you give it to analyze.  The fundamental misapprehension of what intelligence is and does by the AI community means they will never achieve a truly intelligent machine or program.

Science fiction writers dodge this lack of understanding by ignoring the technical workings of AI and just making them act like strange humans.  They do a similar thing with alien natural/biological intelligences.  It makes them more interesting and allows them to be agents in our fiction.  But that agency is wallpaper over a completely nonexistent technological understanding of ourselves.  It mimics the expression of our own intelligence, but gives limited insight into the underlying processes of either form.  No “hard science fiction” approach does anything more than a “scientific magic system”.  It’s hard sci-fi because it has fixed rules with complex interactions from which the author builds a plot or a character, but it’s “soft sci-fi” in that these plots and characters have little to do with how AI would function in reality.  It’s the AI equivalent of hyperdrive.  A technology we have zero understanding of and which probably can’t even exist.

Elon Musk can whinge over the evils of unethical AI destroying the world, but that’s just another science fiction trope with zero evidential basis in reality.  We have no idea how an AI might behave towards humans because we still have zero understanding of what natural and artificial intelligences are and how they work.  Much less how the differences between the two would affect “inter-species” co-existence.  So your chatbot won’t be becoming the next HAL or Skynet any time soon, and your robot overlords are still a long way off even if they could exist at all.

 

Tags: , , , , , ,

Creating Unique Fantasy Worlds: Background

In my last post, as sort of a prelude to the complex topic I’d like to discuss here, I talked about ways to create fantasy cultures based on real cultures and the advantages and disadvantages of this method.  I’m going to start out this post by talking about such counterpart cultures again, but this time, I’m going to focus on the difficulties of creating a truly original culture and how the common use of counterpart cultures undermines such attempts.

 

So, counterpart and generalized Earth cultures make up a great deal of the fantasy landscape.  The exert an enormous influence.  On both the types of stories that are common, and on reader expectations.  I’m going to talk about reader expectations first.

Readers expect certain things when they pick up a book.  These are based on the cover, the blurb, the author.  But also on their past experiences with the genre.  If they’re used to parsing and relating to stories and characters in a pseudo-medieval European setting, they’re going to have difficulty relating to a character in a different setting, because setting informs character.  Also, writers and readers in the genre have developed a set of short-cuts for conveying various forms of information from the writer to the reader.  A reader is familiar with the tropes and conventions of the genre, and writers can and almost inevitably do manipulate this familiarity in order to both meet reader expectations and violate them without going into a wall of text explaining the violation.

Both the writer and the reader of high fantasy have an understanding of the concept of the knight.  Or at least the version in Europa, our faux medieval European setting in which so many fantasies take place.  So when a writer introduces a character as a knight, it’s shorthand for a great deal of information which the writer now does not have to explain with long info-dumps about the history of European chivalry and feudalism.  There’s a strong tension in fantasy between world–building and not info-dumping, because for the most part, info-dumps get in the way of the story.  You don’t want to drop craploads of information on the reader all at once because it interrupts the story.  But you need them to understand the background in order to put the story in context.  Why would a fighter give his opponent a chance to ready himself and get on an equal footing when the stakes of the battle are the conquering of the kingdom?  Because his culture holds honour as one of the highest moral values.  Would sneaking up behind him and stabbing him in the back be easier, have a higher chance of success, and not put the kingdom at risk?  Sure.  So would shooting him with an arrow from behind a tree.  Or two hundred arrows in an ambush as he walks through the forest.  But it would be dishonorable.  And then he might do the same to you.  The same reason why parley flags are honored when it might be so much simpler for one side or the other to just murder the guy.

People do all sorts of dumb shit because it’s “the right thing to do” or perhaps because due to complex cultural values or humans being shitheads, the short-term loss helps uphold a long-term gain.  The tension between the obvious solution in the moment and why it might be foolish in the larger context is a powerful way to drive conflict in the story.  But teaching the reader larger context is a heavy burden when they don’t have any real previous understanding of it.  By using Europa as our setting, we get all that context for free because the reader has previous experience.

The same goes for any sort of counterpart culture.  Rome or Japan have a large collection of tropes in say Western English-speaking society.  Readers will be familiar with those tropes.  So if you want a bit of a break from knights and princesses, why you can take a quick detour through samurai and ninjas.  Or legionnaires and barbarians.  Sometimes these are just trappings on top of the same style of story.  Sometimes these new settings and tropes introduce new things to the story that are really cool.  But because even then, audiences have less exposure to various renderings of these tropes or perhaps the real history underlying them, they can be even more stereotypical or empty than Europa fantasy.

And even in terms of world-building they can do the same.  The writer has to communicate less technical detail to the reader and they don’t have to world-build as deeply because they have less need to justify their setting.  When you just know that knights and princesses and stone castles are real, even if you don’t know how they work exactly, you don’t worry so much about the details.  When something is clearly made up and not based on real Earth history, the questions about how things work and would they really work that way given the frame the author has built can become more of a suspension of disbelief killer.  There’s a joke that some things are just too strange for fiction.  Sure they happened in real life and we have proof.  But in stories, most people most often expect a sort of logical cause and effect and that if a thing happens, it has a good reason based in the story or world-building.  If something could happen once in a thousand tries based on sheer luck and it happening in your story is an important plot element, readers are much less likely to suspend disbelief than if it happens 754 times out of 1000 in the real world.  So your world-building needs to make some sort of logical sense to the reader if you want your plot to hinge on it.  And when you have the weight of genre history behind you, readers are far more likely to give you the benefit of the doubt than if you’re the first person doing it ever.

And that’s why fantasy counterpart cultures are so popular.  We know from Earth history, our only referent of a real history that actually occurred, that the things thus depicted (sorta, kinda, if you squint a bit) really did occur and function in a world rigidly bound by physical laws.  Unlike a world bound only by words on a page written by one dude who probably doesn’t even remember the six credits of world history he took in high school.

And as a very meta example of my point, I have now written two long posts full of info-dumping that I’m demanding you read before I even start talking about what I promised to talk about: how to overcome all these hurdles and actually create unique and original worlds and cultures for your fantasy story.

 

Tags: , , , , , , , , ,

Poetry, Language, and Artificial Intelligence

Poetry exemplifies how the meaning of a string of words depends not only upon the sum of the meaning of the words, or on the order in which they are placed, but also upon something we call “context”.  Context is essentially the concept that single word (or idea) has a different meaning depending on its surroundings.  These surroundings could be linguistic–the language we are assuming the word to belong to, for example, environmental–say it’s cold out and I say “It’s sooooooo hot.”, or in light of recent events: “The Mets suck” means something very different if they’ve just won a game than if they’ve just lost one.

Poetry is the art of manipulating the various possible contexts to get across a deeper or more complex meaning than the bare string of words itself could convey.  The layers of meaning are infinitely deep, and in fact in any form of creative  writing, it is demonstrably impossible for every single human to understand all of them.  I say poetry is the “art” of such manipulation because it is most often the least subtle about engaging in it.  All language acts manipulate context.  Just using a simple pronoun is manipulating context to express meaning.

And we don’t decode this manipulation separate from decoding the bare language.  It happens as a sort of infinite feedback loop, working on all the different layers of an utterance at once.  The ability to both manipulate concepts infinitely and understand our own infinite manipulations might be considered the litmus test for what is considered “intelligent” life.

 

Returning to the three words in our title, I’ve discussed everything but AI.  The difficulty in creating AGI, or artificial general intelligence lies in the fact that nature had millions or billions of years to sketch out and color in the complex organic machine that grants humans this power of manipulation.  Whereas humans have had maybe 100?  In a classic chicken and egg problem, it’s quite difficult to have either the concept web or the system that utilizes it without the other part.  If the system creates the web, how do you know how to code the system without knowing the structure of the web?  And if the web comes first, how can you manipulate it without the complete system?

You might have noticed a perfect example of how context affects meaning in that previous paragraph.  One that was not intentional, but that I noticed as I went along. “Chicken and egg problem”.  You  can’t possibly know what I meant by that phrase without having previously been exposed to the philosophical question of which came first, the chicken that laid the egg, or the egg the chicken hatched from.  But once you do know about the debate, it’s pretty easy to figure out what I meant by “chicken and egg problem”, even though in theory you have infinite possible meanings.

How in the world are you going to account for every single one of those situations when writing an AI program?  You can’t.  You have to have a system based on very general principles that can deduce that connection from first principles.

 

Although I am a speculative fiction blogger, I am still a fiction blogger.  So how do this post relate to fiction?  When  writing fiction you are engaging in the sort of context manipulation I’ve discussed above as such an intractable problem for AI programmers.  Because you are an intelligent being, you can instinctually engage in it when writing, but unless you are  a rare genius, you are more likely needing to engage in it explicitly.  Really powerful writing comes from knowing exactly what context an event is occurring in in the story and taking advantage of that for emotional impact.

The death of a main character is more moving because you have the context of the emotional investment in that character from the reader.  An unreliable narrator  is a useful tool in a story because the truth is more surprising either  when the character knew it and purposefully didn’t tell the reader, or neither of them knew it, but it was reasonable given the  information both had.  Whereas if the truth is staring the reader in the face but the character is clutching the idiot ball to advance the plot, a readers reaction is less likely to be shock or epiphany and more likely to be “well,duh, you idiot!”

Of course, context can always go a layer deeper.  If there are multiple perspectives in the story, the same situation can lead to a great deal of tension because the reader knows the truth, but also knows there was no way this particular character could.  But you can also fuck that up and be accused of artificially manipulating events for melodrama, like if a simple phone call could have cleared up the misunderstanding but you went to unbelievable lengths to prevent it even though both characters had cell phones and each others’ numbers.

If the only conceivable reason the call didn’t take place was because the author stuck their nose in to prevent it, you haven’t properly used or constructed  the context for the story.  On the other hand, perhaps there was an unavoidable reason one character lost their phone earlier in the story, which had sufficient connection to  other important plot events to be not  just an excuse to avoid the plot-killing phone-call.

The point being that as I said before, the  possible contexts for language or events are infinite.  The secret to good writing  lies in being able to judge which contexts are most relevant and making sure that your story functions reasonably within those contexts.  A really, super-out-of-the-way solution to a problem being ignored is obviously a lot more acceptable than ignoring the one staring you in the face.  Sure your character might be able to send a morse-code warning message by hacking the electrical grid and blinking the power to New York repeatedly.  But I suspect your readers would be more likely to call you out for solving the communication difficulty that way than for not solving it with the characters’ easily  reachable cell phone.

I mention the phone thing because currently, due to rapid technological progress, contexts are shifting far  more rapidly than they did in the past.  Plot structures honed for centuries based on a lack of easy long-range communication are much less serviceable as archetypes now that we have cell phones.  An author who grew up before the age of ubiquitous smart-phones for your seven-year-old is going to have a lot more trouble writing a believable contemporary YA romance than someone who is turning twenty-two in the next three months.  But even then, there’s a lack of context-verified, time-tested plot structures to base such a story on than a similar story set in the 50s.  Just imagine how different Romeo and Juliet would have been if they could have just sent a few quick texts.

In the past, the ability of the characters to communicate at all was a strong driver of plots.  These days, it’s far more likely that trustworthiness of communication will be a central plot point.  In the past, the possible speed of travel dictated the pacing of many events.  That’s  far less of an issue nowadays. More likely, it’s a question of if you missed your flight.  Although…  the increased speed of communication might make some plots more unlikely, but it does counteract to some extent the changes in travel speed.  It might be valuable for your own understanding and ability to manipulate context to look at some works in older settings and some works in newer ones and compare how the authors understanding of context increased or decreased the impact and suspension of disbelief for the story.

Everybody has some context for your 50s love story because they’ve been exposed to past media depicting it.  And a reader is less likely to criticize shoddy contextualizing in when they lack any firm context of their own.   Whereas of course an expert on horses is far more likely to find and be irritated by mistakes in your grooming and saddling scenes than a kid born 16 years ago is to criticize a baby-boomer’s portrayal of the 60s.

I’m going to end this post with a wish for more stories–both SpecFic and YA–more strongly contextualized in the world of the last 15 years.  There’s so little of it, if you’re gonna go by my high standards.

 

Tags: , , , , , ,