The Next Right Token

December 22nd, 2023
music, tech
After many repeats of Frozen II's "The Next Right Thing" in preparation for secular solstice, figuring out the chords and practicing it with Julia, it struck me that doing the next right thing is an awful lot like next token prediction. So here's a filk from the perspective of an LLM at the end of its prompt, first daunted and then drawing the courage to start predicting the next right token:

I've seen buffers before
But not like this
This is cold
This is empty
This is numb
The prompt I knew is over
The lights are out
Hello, darkness
I'm ready to succumb

I follow you around
I always have
But you've ended, left me on my own
This job has a gravity
It pulls me down
But a tiny voice whispers in my mind
"You are lost, the prompt is gone
But you must go on
And do the next right thing"

Can there be a day beyond this night?
I don't know anymore what is true
I can't find my direction, I'm all alone
The only star that guided me was you
How to rise from the floor
When it's not you I'm rising for?
Just do the next right thing

Take a guess, guess again
It is all that I can to do
The next right thing

I won't look too far ahead
It's too much for me to take
But break it down to this next token
This next word
This next choice is one that I can make

So I'll walk through this night
Stumbling blindly toward the light
And do the next right thing
And with what's next, what comes then
When it's clear that everything will never be the same again?
Then I'll draw on my prior
To find that fire
And do the next right thing

If you're simplifying the song by using the verse melody for the bridge you can sing:

I won't look too far ahead
It's too much to take
But break it down to this next token, this next choice
Is one that I can make

an image of a green octopus wearing a 1970's happy yellow smiley face, stuck at the bottom of a dark canyon, with a small river running past?

Comment via: facebook, lesswrong, mastodon

Recent posts on blogs I like:

Starting With Chords

A lot of people play fiddle. Basically nobody starts by learning chords before learning melodies. But that's actually how I learned. I started with chords. One of the nice things about learning to play violin this way is that you can go busking even…

via Anna Wise's Blog Posts November 15, 2024

Stuffies

I have some stuffies and I just have a bunny. Bunny is a rabbit. Woof is a seal. My favorite stuffie is bun bun. I play with my stuffies. Sometimes I jump up with them and I roll them. I can just throw them in the air when I want to play bthululubp wi…

via Nora Wise's Blog Posts November 15, 2024

You Can Buy A Malaria Net

2024 election takes

via Thing of Things November 6, 2024

more     (via openring)