The Next Right Token

December 22nd, 2023
music, tech
After many repeats of Frozen II's "The Next Right Thing" in preparation for secular solstice, figuring out the chords and practicing it with Julia, it struck me that doing the next right thing is an awful lot like next token prediction. So here's a filk from the perspective of an LLM at the end of its prompt, first daunted and then drawing the courage to start predicting the next right token:

I've seen buffers before
But not like this
This is cold
This is empty
This is numb
The prompt I knew is over
The lights are out
Hello, darkness
I'm ready to succumb

I follow you around
I always have
But you've ended, left me on my own
This job has a gravity
It pulls me down
But a tiny voice whispers in my mind
"You are lost, the prompt is gone
But you must go on
And do the next right thing"

Can there be a day beyond this night?
I don't know anymore what is true
I can't find my direction, I'm all alone
The only star that guided me was you
How to rise from the floor
When it's not you I'm rising for?
Just do the next right thing

Take a guess, guess again
It is all that I can to do
The next right thing

I won't look too far ahead
It's too much for me to take
But break it down to this next token
This next word
This next choice is one that I can make

So I'll walk through this night
Stumbling blindly toward the light
And do the next right thing
And with what's next, what comes then
When it's clear that everything will never be the same again?
Then I'll draw on my prior
To find that fire
And do the next right thing

If you're simplifying the song by using the verse melody for the bridge you can sing:

I won't look too far ahead
It's too much to take
But break it down to this next token, this next choice
Is one that I can make

an image of a green octopus wearing a 1970's happy yellow smiley face, stuck at the bottom of a dark canyon, with a small river running past?

Comment via: facebook, lesswrong, mastodon, substack

Recent posts on blogs I like:

Disagreeing charitably with others: a guide

Purporting to give advice about how to be charitable to people you disagree with is always an act of hubris.

via Thing of Things May 18, 2026

Fiddle Practice

For a while I wasn't learning how to play violin very well because whenever it was time to practice I didn't want to. I didn't really like practicing, because (1) it's boring, (2) I have better things to do, and (3) actually I guess there …

via Anna Wise's Blog Posts May 3, 2026

New Pony

I have a new pony. I got her from the Goodwill. Her name is "Rainbow" and her nickname is "Sparkles". We went the usual way, in the pink stroller. We went downstairs and I played with some of the toys. I found the pony in the toy area. …

via Nora Wise's Blog Posts May 3, 2026

more     (via openring)