The best description of my problem solving process is the Feynman algorithm,
which is sometimes presented as a joke where the hidden subtext is “be smart”, but
I disagree. The “algorithm” is a surprisingly lucid description of how thinking works in the
context of hard problems where the answer can’t simply be looked up or trivially
broken down, iterated upon in a bottom-up fashion, or approached with similar methods.
Feynman’s thinking algorithm is described like this:
- Write down the problem
- Think real hard
- Write down the solution
(This algorithm may or may not have actually been used by Feynman, it’s as far as I can tell
Murray Gell-Mann’s account of Feynman’s approach.)
The trick is that there is no trick. This is how thinking works.
It appears that when you feed your brain related information, without further active involvement,
it starts to digest the information you’ve fed it.
Thinking is a background process. There’s no Sherlock Holmes-style string of brilliant deductions;
the brain is a connection-making machine. If you feed it data points, it will find ways of connecting
the dots.
So to solve a problem, you start by feeding your mind the relevant information in a fairly literal sense.
It’s a direct parallel to how you’d prompt a LLM. Just bring up all the things you think are relevant.
Imagine if you were to task someone else with solving the problem, imagine what they might have use of knowing,
really go over anything you think might be useful. It’s good to write that down in the simplest way possible.
It should be very clear to you what question you are attempting to answer. What is written on paper is not the
important thing, the act of assembling the question is the work!
To answer the question, what you do next is to remove yourself from further inputs.
As long as you keep feeding your brain with more data, the queries never resolve, and
eventually the stuff you fed it first will fall out of the context window and amount to nothing.
For this reason, it’s crucial to step away from the keyboard. Go for a walk, or sit down in a quiet place,
take a shower; whatever you choose to do, just keep thinking about the problem.
As you do this, all the background processing you kicked off earlier will begin to resolve.
Not immediately, it may take a while—hours, sometimes days—but as it does you get sudden
insights into the problem domain. You may or may not immediately find a solution to the problem,
but you’ll often at least find a deeper understanding.
The conclusions must be written down. Not only because these insights are fleeting and
can be hard to recall, it also appears to act as a sort of feedback to the brain that the
information is important, that it’s on the right track, to keep going.
The perhaps most inspired period of my life was sometime in 2021, before I’d moved
in with my girlfriend. What I’d inadvertently ended up doing was to arrange my life
into something very similar to the algorithm above.
I’d grind away and work on the search engine all week, filling my brain with all manner of information
related to the work I was doing, and then I’d go visit her over the weekend, not bringing a computer.
Without exception, by the time the weekend was over, I’d have several pages worth of new ideas written
down in a notebook that I’d implement over the following week, rinse and repeat.
I keep coming back to the gardening metaphor of thought.
What you think today is the result of what you read yesterday. If you want to have relevant,
interesting, useful thoughts; use your reading as a template. It will not only model the topics
you are thinking about, but the very thoughts themselves. It’s as much pruning gossip and
irrelevant noise as it is planting the interesting and insightful and well thought-out.
