molon molon

LLM Wiki

A pattern for building personal knowledge bases using LLMs.

This is an idea file, it is designed to be copy pasted to your own LLM Agent (e.g. OpenAI Codex, Claude Code, OpenCode / Pi, or etc.). Its goal is to communicate the high level idea, but your agent will build out the specifics in collaboration with you.

The core idea

Most people's experience with LLMs and documents looks like RAG: you upload a collection of files, the LLM retrieves relevant chunks at query time, and generates an answer. This works, but the LLM is rediscovering knowledge from scratch on every question. There's no accumulation. Ask a subtle question that requires synthesizing five documents, and the LLM has to find and piece together the relevant fragments every time. Nothing is built up. NotebookLM, ChatGPT file uploads, and most RAG systems work this way.

NOTICE: This guide is no longer relevant, as a lot has changed over time and Go supports Apple Silicon natively just fine now!

Compile Go for Apple Silicon (M1)

Follow these short instructions on how to compile Go for Apple Silicon (M1). From here on out, we may simply refer to it as the "ARM device".

This entire process should only take about 5-10 minutes, but please read through everything carefully, in order to avoid any potential issues along the way.

Note that at the time of writing this, Go was not yet officially available for Apple's ARM.

Use Proxy for Git/GitHub

Generally, the Git proxy configuration depends on the Git Server Protocol you use. And there're two common protocols: SSH and HTTP/HTTPS. Both require a proxy setup already. In the following, I assume a SOCKS5 proxy set up on localhost:1080. But it can also be a HTTP proxy. I'll talk about how to set up a SOCKS5 proxy later.

SSH Protocol

When you do git clone ssh://[user@]server/project.git or git clone [user@]server:project.git, you're using the SSH protocol. You need to configurate your SSH client to use a proxy. Add the following to your SSH config file, say ~/.ssh/config:

ProxyCommand nc -x localhost:1080 %h %p

	# Example:
	# https://fiddle.fastlydemo.net/fiddle/4ac44faf
	#
	# the principle of this design is that we want
	# requests to be cached using a key that varies
	# on the "Fastly-Client-IP" and "User-Agent" headers
	# but only for responses that indicate "429 Too Many Requests"
	#
	# whenever we get a "429 Too Many Requests" response, we'll
	# we'll ensure it is cacheable, and that will result in the Vary headers

	// Globally register all base components for convenience, because they
	// will be used very frequently. Components are registered using the
	// PascalCased version of their file name.

	import upperFirst from 'lodash/upperFirst'
	import camelCase from 'lodash/camelCase'

	export default async ({ Vue }) => {
	console.log('loading components')
	// https://webpack.js.org/guides/dependency-management/#require-context

	package main

	import (
	"os/exec"
	"unsafe"

	"golang.org/x/sys/windows"
	)

	// We use this struct to retreive process handle(which is unexported)

	This is free and unencumbered software released into the public domain.

	Anyone is free to copy, modify, publish, use, compile, sell, or
	distribute this software, either in source code form or as a compiled
	binary, for any purpose, commercial or non-commercial, and by any
	means.

	In jurisdictions that recognize copyright laws, the author or authors
	of this software dedicate any and all copyright interest in the
	software to the public domain. We make this dedication for the benefit

	How to install windows on digital ocean,
	use this tutorial :
	https://milankragujevic.com/how-to-install-windows-10-on-digitalocean


	how to create own image :
	Reans Web - Creating Custom Image on Digital Ocean '(2022 Update)'

	Click here to watch on youtube : https://youtu.be/wtHBDEl5DIw

	require 'net/http'
	require 'json'
	require 'uri'
	require 'yaml'

	##
	# Make a certain obfuscated js less obnoxious to analyze.
	#
	class Obfuscated
	attr_accessor :script

	function simulatedClick(target, options = {}) {
	if (target.ownerDocument === undefined) return;

	const event = target.ownerDocument.createEvent('MouseEvents');
	const opts = { // These are the default values, set up for un-modified left clicks
	type: 'click',
	canBubble: false, // switch off to avoid closing for compose popup
	cancelable: true,
	view: target.ownerDocument.defaultView,
	detail: 1,