GPT’s behavior when prompted with anomalous tokens like ' SolidGoldMagikarp' can be used to associate fine-tuned models with base models. An idea inspired by black box cryptanalysis.

Simulacra and simulation in self-supervised models

Measuring optimization from curation

Describing our elusive, recursive volition to (proto-)AGI in words

How to get GPT-3 to sort a list: make it think it’s a python interpreter running list.sort()

Mechanisms of meta-learning, beating few-shot benchmark performance with 0-shot prompts, and Bayesian analysis of prompt ablation

Loom, a tool for generating, navigating and visualizing natural language multiverses

I asked GPT-3 to come up with titles for paintings and had CLIP+BigGAN paint them

More figurative fancies from GPT-3’s imagination illustrated by BigSleep (CLIP + BigGAN)

A scene written by GPT-3 and illustrated by BigSleep (CLIP + BigGAN)

BigSleep (CLIP + BigGAN) generates pictures of “the 1990s”, “the 1910s”, … , “the 2030s”

Compilation of images generated with BigSleep from human-written prompts

“Actualities seem to float in a wider sea of possibilities from out of which they were chosen; and somewhere, indeterminism says, such possibilities exist, and form part of the truth.”

Combining multipart prompts, logit biases, and counterfactual parsing to make GPT-3 emulate fake Google search results given a query / Wikipedia pages given a title

"Like programming, but more fluid. You’re not programming a computer, you’re writing reality. It’s strange. It’s always different. It’s never the same twice."

Context-aware parsing using counterfactual probabilities predicted by GPT-3

Improving GPT-3’s performance on SAT analogy questions using task-agnostic prompt pipelines

You’re a human with access to a streamlined interface that provides an array of continuations to a given text, as well as continuations spawned from each of those suggestions, recursively ad infinitum…

Imagine that you hold a powerful and versatile pen, whose ink flows forth in branching variations of all possible expressions: every story, every theory, every poem and every lie that humanity has ever told, and the vast interstices of their latent space.