The Next Right Token

December 22nd, 2023
music, tech
After many repeats of Frozen II's "The Next Right Thing" in preparation for secular solstice, figuring out the chords and practicing it with Julia, it struck me that doing the next right thing is an awful lot like next token prediction. So here's a filk from the perspective of an LLM at the end of its prompt, first daunted and then drawing the courage to start predicting the next right token:

I've seen buffers before
But not like this
This is cold
This is empty
This is numb
The prompt I knew is over
The lights are out
Hello, darkness
I'm ready to succumb

I follow you around
I always have
But you've ended, left me on my own
This job has a gravity
It pulls me down
But a tiny voice whispers in my mind
"You are lost, the prompt is gone
But you must go on
And do the next right thing"

Can there be a day beyond this night?
I don't know anymore what is true
I can't find my direction, I'm all alone
The only star that guided me was you
How to rise from the floor
When it's not you I'm rising for?
Just do the next right thing

Take a guess, guess again
It is all that I can to do
The next right thing

I won't look too far ahead
It's too much for me to take
But break it down to this next token
This next word
This next choice is one that I can make

So I'll walk through this night
Stumbling blindly toward the light
And do the next right thing
And with what's next, what comes then
When it's clear that everything will never be the same again?
Then I'll draw on my prior
To find that fire
And do the next right thing

If you're simplifying the song by using the verse melody for the bridge you can sing:

I won't look too far ahead
It's too much to take
But break it down to this next token, this next choice
Is one that I can make

an image of a green octopus wearing a 1970's happy yellow smiley face, stuck at the bottom of a dark canyon, with a small river running past?

Comment via: facebook, lesswrong, mastodon

Recent posts on blogs I like:

Pay For Fiction

Against piracy

via Thing of Things February 29, 2024

When Nurses Lie to You

When the nurse comes to give you the flu shot, they say it won't hurt at all, right? And you trust them. Then they give you the shot, and it hurts! They lied to you. A lot of nurses lie to children about shots and blood draws. Part of it is they probabl…

via Lily Wise's Blog Posts February 28, 2024

How I build and run behavioral interviews

This is an adaptation of an internal doc I wrote for Wave. I used to think that behavioral interviews were basically useless, because it was too easy for candidates to bullshit them and too hard for me to tell what was a good answer. I’d end up grading eve…

via benkuhn.net February 25, 2024

more     (via openring)