simplerethink

LLM Wiki

A pattern for building personal knowledge bases using LLMs.

This is an idea file, it is designed to be copy pasted to your own LLM Agent (e.g. OpenAI Codex, Claude Code, OpenCode / Pi, or etc.). Its goal is to communicate the high level idea, but your agent will build out the specifics in collaboration with you.

The core idea

Most people's experience with LLMs and documents looks like RAG: you upload a collection of files, the LLM retrieves relevant chunks at query time, and generates an answer. This works, but the LLM is rediscovering knowledge from scratch on every question. There's no accumulation. Ask a subtle question that requires synthesizing five documents, and the LLM has to find and piece together the relevant fragments every time. Nothing is built up. NotebookLM, ChatGPT file uploads, and most RAG systems work this way.

IMPORTANT

See the following links for further updates to Github Desktop for Ubuntu. These are official instructions. (also mentioned by fetwar on Nov 3, 2023)

For the sake of "maintaining the tradition" here is the updated version.

Creating Shakespearean n-grams with just the command-line and regexes

This is a quick example showing how to use regexes to find tri-grams in Shakespeare...well, 570,872 of them, anyway, if we do some basic filtering of non-dialogue.

Though tokenization and n-grams should typically be done using a proper natural language processing framework, it's possible to do in a jiffy from the command-line, using standard Unix tools and ack, the better-than-grep utility.

What are n-grams?

Country	Alpha-2 code	Alpha-3 code	Numeric code	Latitude (average)	Longitude (average)
Afghanistan	AF	AFG	4	33	65
Åland Islands	AX	ALA	248	60.116667	19.9
Albania	AL	ALB	8	41	20
Algeria	DZ	DZA	12	28	3
American Samoa	AS	ASM	16	-14.3333	-170
Andorra	AD	AND	20	42.5	1.6
Angola	AO	AGO	24	-12.5	18.5
Anguilla	AI	AIA	660	18.25	-63.1667
Antarctica	AQ	ATA	10	-90	0

	# This script is to be used on nextdns.io => Security => Block Top-Level Domains (TLDs) => Add a TLD
	# Once the modal window is open, in the console you can run the below code to block all TLDs that are
	# not in the validTLD array.

	const delay = ms => new Promise(res => setTimeout(res, ms));

	const blocker = async () => {

	// List of TLDs that should not be blocked
	let validTLD = [

	/**
	*
	* Search Query Mining Tool
	*
	* This script calculates the contribution of each word or phrase found in the
	* search query report and outputs a report into a Google Doc spreadsheet.
	*
	* Version: 2.2
	* Updated 2015-09-17: replacing 'KeywordText' with 'Criteria'
	* Updated 2016-10-11: replacing 'ConvertedClicks' with 'Conversions'