GPT’s behavior when prompted with anomalous tokens like ' SolidGoldMagikarp' can be used to associate fine-tuned models with base models. An idea inspired by black box cryptanalysis.
Simulators Sep 2
Simulacra and simulation in self-supervised models
Quantifying curation Jul 6
Measuring optimization from curation
Describing our elusive, recursive volition to (proto-)AGI in words
How to get GPT-3 to sort a list: make it think it’s a python interpreter running list.sort()
Mechanisms of meta-learning, beating few-shot benchmark performance with 0-shot prompts, and Bayesian analysis of prompt ablation
Preview of loom, a tool for generating, navigating and visualizing natural language multiverses
I asked GPT-3 to come up with titles for paintings and had CLIP+BigGAN paint them
More figurative fancies from GPT-3’s imagination illustrated by BigSleep (CLIP + BigGAN)
A scene written by GPT-3 and illustrated by BigSleep (CLIP + BigGAN)
BigSleep (CLIP + BigGAN) generates pictures of “the 1990s”, “the 1910s”, … , “the 2030s”
CLIP art Jan 31
Compilation of images generated with BigSleep from human-written prompts
“Actualities seem to float in a wider sea of possibilities from out of which they were chosen; and somewhere, indeterminism says, such possibilities exist, and form part of the truth.”
Combining multipart prompts, logit biases, and counterfactual parsing to make GPT-3 emulate fake Google search results given a query / Wikipedia pages given a title
"Like programming, but more fluid. You’re not programming a computer, you’re writing reality. It’s strange. It’s always different. It’s never the same twice."
Context-aware parsing using counterfactual probabilities predicted by GPT-3
Improving GPT-3’s performance on SAT analogy questions using task-agnostic prompt pipelines
HITL thought experiment Oct 16
You’re a human with access to a streamlined interface that provides an array of continuations to a given text, as well as continuations spawned from each of those suggestions, recursively ad infinitum…
Pen Oct 16
Imagine that you hold a powerful and versatile pen, whose ink flows forth in branching variations of all possible expressions: every story, every theory, every poem and every lie that humanity has ever told, and the vast interstices of their latent space.