Article summary · Feb 2024
Prompt-Ideals for spaced repetition
Mostly someone else’s words. I keep it as reading, not as my own writing.
- Spaced repetition systems have a troubling shortcoming, they are only as good as the prompts you give them. But when starting out you are likely to write bad prompts, which will cause you to stop using them.
- Prompt Design is task design, when writing prompts you are giving your future self a recurring task, performing that task should change you in a useful way.
- The key element which distinguished spaced repetition from other study methods (such as re-reading material) is that you must Retrieve the needed information, promoting the “testing effect”. Writing good prompts means invoking all the key details of the material through the retrieval practice
- Properties of effective retrieval practice prompts - They all come down to providing the proper scope for your questions, which is usually “one level up” from what you currently consider as base-knowledge. Properly identifying this however is easier said than done, you will need to break knowledge down into its discrete components.
- You aim to answer the following question “which tasks, when performed in aggregate, require lighting the bulbs which are activated when you have that idea “fully loaded” into your mind?
- Retrieval prompts should be focused - too much detail will dull your concentration while ambiguous questions will leave you unable to identify the part of your answer that differed from the not
- Precision - It should be clear what is asked and what type of answer is expected
- Consistent - This should light consistent answers, lighting the same bulbs each time you perform the task,
- Tractable - Strive to write prompts which you can almost always answer correctly. Break the task down and add cues.
- Effortful - While giving cues, don’t give the answer away, the practice should not be trivial and should actually involve retrieving the answer from memory.
- To Successfully implement all the previous components of successful prompting, ask yourself what knowledge are you trying to characterize, and what questions when answered will reinforce that knowledge
- An essential skill for prompt taking, noticing good opportunities to write prompts in order to solidify the knowledge
- When writing prompts reinforcing factual knowledge, support these with prompts explaining why these facts are true
- It is known that information is easier to recall when it is connected to other memories, this is called elaborative encoding. Use this to connect new-found knowledge to previous experiences. Vivid associations work best.
- Write more prompts than you think is necessary - the amount of knowledge that you want to retain from an article is fixed while the amount of prompts vary, by economizing on the amount of prompts all that is achieved is that each prompt is denser and hence harder to review and internalize.
- The scope of a “focused” prompt should vary depending on your knowledge of the subject, the more familiar you are with the concepts, the more complexity that can be contained in each prompt.
- Expertise may be seen as the ability to think in terms of increasingly complex “chunks”
Procedural Knowledge
- When prompting for procedural knowledge, ask yourself what are the key verbs, adverbs, objects and subjects relating to the procedure.
- If the procedure branches and has conditionals be sure to include the predicate in the prompt
Conceptual Knowledge
- To understand a concept, strive to understand both its components and its relationships
- Useful lenses for understanding concepts:
- Attributes and tendencies - what is common for the concept, what is always true, what is never true
- Similarities and differences - Notice in what ways the concept is similar/dissimilar to adjacent concepts
- Parts and wholes - To what family does the concept belong? What different sub-concepts does it contain?
- Causes and effect - What does\doesn’t the concept do? What causes the concept to do that? When is it used?
- Significance- Why does the concept matter? In what situations does it shine?
Salience Prompts
- It is important when you are dealing with an open list i.e a list whose number of members is likely to increase over time.
- First, write prompts focused on each tagged item, linking the item to the tag
- Q. When puréeing vegetables to make soup, how can I produce a richer flavor without adding fat? A. Thin the purée with chicken stock instead of water.
- Next, write prompts about the tag itself, inspired by noticed patterns
- Q. What should I ask myself if I notice I’m using water in savory cooking? A. “Should I use stock instead?”
- Last, Write a prompt which fuzzily links from the tag to its instances by asking for examples
- Q. Name two ways you might use chicken stock. A. e.g. cooking grains, steaming hearty greens, making purée soups, deglazing pans
- First, write prompts focused on each tagged item, linking the item to the tag
- Often it is beneficial to include constraints in the prompt, something along the lines of “give an example of using X that you haven’t given before”. This is no longer about retrieval but rather generation and applying the knowledge gained. This will often make you remember it better due to the generation effect
- Besides their impact on memory and understanding, prompts have another important effect which is that they keep you in contact with the idea over time. To really internalize a new idea, you need to bring it into your life and make meaning with it. In particular, if it’s anew skill, you probably haven’t really understood it until you’ve put it into practice several times on your own. Salience however fades over time, if you don’t notice an opportunity to apply the newfound knowledge soon after acquiring it chances are that you’ll forget the concept. By continually reminding oneself of the concept thereby increasing your salience of it, you greatly enhance the chances that you’ll apply and internalize it
- This is highly reminiscent of spaced repetition for fact-remembering. In the same way we can craft prompts whose goal is not to internalize a fact or procedure, but rather to keep ideas relevant in your mind.
- When possible, phrase salience prompts around contexts where those ideas might be meaningful in your life.
Iterative Prompt Writing
- When reading articles for the first time, if you try to be comprehensive as possible, you will likely exhaust yourself and burn out. Furthermore, when reading for the first time you’re still developing a sense of the material and discerning what’s important and what is not - meaning effective prompt writing at this stage is difficult bordering on impossible
- At first blush you may not know which elements will be particularly challenging to remember, which ideas access the “essence” of the components, which capture subtle implications and you may need to live with new ideas for a while before you can write prompts which connect eh, vibrantly with whatever really matter to you -> Adopt an iterative approach:
- At first when reading an article attempt to write a small number of prompts 5-10 about whatever seems most important, meaningful or useful.
- This should make the reading you do seem more engaging, a telltale sign that your overdoing it is that reading will become a “chore”.
- At first when reading an article attempt to write a small number of prompts 5-10 about whatever seems most important, meaningful or useful.
- When reading material for the first time, remind yourself that it’s a “first pass” you can always add more materials later on. For most resources this first pass will end up being the only time that you encounter the material, but for the resources that prove to be important and peak your curiosity, multiple passes may be needed, add more prompts each time and notice how they become increasingly more complex, focusing on patterns
- In the first pass on difficult material, try crafting “Easy” prompts, focus on facts, notation, terms, etc…
Litmus Tests for efficient prompting
- No False positives - ensure that you will not be able to produce the correct answer without really knowing the information. Such False positives may occur if you allow
- Pattern matching - long questions with unusual words might help you memorize the shape of the question and the corresponding answer, rather than internalizing the knowledge. Close deletions are most prone to this
- Binary prompts
- No false negatives - If the prompt doesn’t contain enoughguh context, you may fail to product the correct answer even though you have internalized the knowledge. I.e one that has correct answers besides the one you intend.
Iterating on written Prompts
- Prompts are meant to help you internalize knowledge, as mentioned writing these may not be trivial. If you notice that a prompt is continuously met with a sigh for any reason (can’t remember it’s answer, its answer is too trivial, you no longer care about it etc,,,) consider splitting it up, combining a couple of prompts into one, deleting altogether… Do not hesitate, the decisions made in the past should not be viewed as final