The Next Right Token

December 22nd, 2023
music, tech
After many repeats of Frozen II's "The Next Right Thing" in preparation for secular solstice, figuring out the chords and practicing it with Julia, it struck me that doing the next right thing is an awful lot like next token prediction. So here's a filk from the perspective of an LLM at the end of its prompt, first daunted and then drawing the courage to start predicting the next right token:

I've seen buffers before
But not like this
This is cold
This is empty
This is numb
The prompt I knew is over
The lights are out
Hello, darkness
I'm ready to succumb

I follow you around
I always have
But you've ended, left me on my own
This job has a gravity
It pulls me down
But a tiny voice whispers in my mind
"You are lost, the prompt is gone
But you must go on
And do the next right thing"

Can there be a day beyond this night?
I don't know anymore what is true
I can't find my direction, I'm all alone
The only star that guided me was you
How to rise from the floor
When it's not you I'm rising for?
Just do the next right thing

Take a guess, guess again
It is all that I can to do
The next right thing

I won't look too far ahead
It's too much for me to take
But break it down to this next token
This next word
This next choice is one that I can make

So I'll walk through this night
Stumbling blindly toward the light
And do the next right thing
And with what's next, what comes then
When it's clear that everything will never be the same again?
Then I'll draw on my prior
To find that fire
And do the next right thing

If you're simplifying the song by using the verse melody for the bridge you can sing:

I won't look too far ahead
It's too much to take
But break it down to this next token, this next choice
Is one that I can make

an image of a green octopus wearing a 1970's happy yellow smiley face, stuck at the bottom of a dark canyon, with a small river running past?

Comment via: facebook, lesswrong, mastodon

Recent posts on blogs I like:

Your Fave Is Problematic Politics

In favor of liking things, especially if the thing is Kamala Harris

via Thing of Things October 18, 2024

Inner dialogue, walking down the sidewalk

A discussion I have with myself a lot The post Inner dialogue, walking down the sidewalk appeared first on Otherwise.

via Otherwise October 10, 2024

Startup advice targeting low and middle income countries

This post was inspired by a week of working from Ambitious Impact’s office in London, and chatting with several of the startup charities there. While my experience is in the for-profit world, I think it’s applicable to entrepreneurs working on impact-driv…

via Home September 27, 2024

more     (via openring)