ChatGPT Does Valentines, Too

Sensei Janelle Shane has been having fun with GPT for many years now. 

In past years, she has challenged GPT and similar ML to generate seasonal greetings, including Christmas carols and Valentine’s cards.  The products are often very troubling. They seem to start out conventionally and then veer off into very dark territory.  Where did the neural network find these troubling patterns in the data it was given?

This year she challenged her GPT collaborators to generate Valentine’s Day cards, this time asking for text completing a poem starting with “Roses are red, Violets are blue” [1].  She also asks for descriptions of the illustrations to go with the text.

To be fair, generating rhyming poetry is, as Sensei Janelle puts it, “notoriously difficult”.  Several older versions of GPT produced things that are more or less in the ball park of bad human generated poetry.  The ML generated suggested illustrations did tend to be pretty weird, though.  And, as usual, some of the results are, well, “interesting”.

“Its meter isn’t great, and sometimes it makes interesting choices.”

([1])

And then there is the flavor of the month, ChatGPT.  ChatGPT is known to be a mediocre programmer and a terrible rocket scientist, among other things.  How’s it do at greeting cards?

In a word:  they are boring.

“With the newer models, and especially with chatgpt, the changes OpenAI made to make them more predictable also made them more boring. Chatgpt’s Valentine cards are generic and repetitive.”

([1])

Example:

"Roses are red,
Violets are blue,
This card may be old,
But my love for you is brand new.”

(From [1])

Looking at the results, Sensei Janelle concludes, “Fluent? Yes. Interesting? No.”

The overall collection is “highly surreal yet apparently probable” cards.

These are probably apt descriptions of all GPT output.

---

1. Janelle Shane, Roses are red, in AIWeirdness, February 7, 2023. https://www.aiweirdness.com/roses-are-red/

Book Review: “You Look Like A Thing And I Love You” by Janelle Shane

You Look Like A Thing And I Love You by Janelle Shane

I had never run across Shane’s AI Weirdness online, so this book was my first taste.  It’s great!  I was giggling out loud (which elicited a withering glare from the cat).  I love it.

Shane does a wonderful job of ‘splainin this stuff, and her examples help bring the AI hype down to Earth.  She sketches out how the common variations of machine learning work, how they are built, and how they go off the rails.

I’m pretty familiar with this territory. “You. Stupid. Computer” has one of the major themes of my career. Yes, children, we were inventing all this crazy nonsense decades ago.

As I sometimes summarize my own career, thanks to our work, we can now make a lot more stupid mistakes thousands of times faster.  It’s not so much how badly the dog (or perhaps giraffe) dances, it’s that it dances at all.  And today, the giraffe’s a lot bigger, dances a lot faster, and sometimes threatens life, liberty, and the pursuit of giraffes.  You’re welcome!

So, I can attest that she’s absolutely right technically and also anthropologically.  AI’s not evil, though it can be dangerous, and Shane has just the right balance of wonder (“look—the dog giraffe is dancing”) and skepticism (“but it’s a laughably bad dancer!”)

Most important, Shane is really good at ‘splainin stuff. The relationship between training sets and weird or not results. How machine learning learns.  The endless entertainment of trying to devise goals and rewards, and the perverse ability of computers to find shortcuts.  How computers copy human biases.  And more.

With so much AI being deployed, this book is a timely and important public service.  Everyone needs to understand this wackiest of recent human creations.

(You can find more at Shane’s blog.)

---

1. Janelle Shane, You Look Like A Thing And I Love You: How Artificial Intelligence Works and Why It’s Making the World a Weirder Place, New York, Little, Brown and Company, 2019.

 

Sunday Book Reviews