Shawel Negussie shawel

Purpose

Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.

Avoid being a link dump. Try to provide only valuable well tuned information.

Prelude

Neural network links before starting with transformers.

A half-hour to learn Zig

This is inspired by https://fasterthanli.me/blog/2020/a-half-hour-to-learn-rust/

Basics

the command zig run my_code.zig will compile and immediately run your Zig program. Each of these cells contains a zig program that you can try to run (some of them contain compile-time errors that you can comment out to play with)

How to create an HTTPS certificate for localhost domains

This focuses on generating the certificates for loading local virtual hosts hosted on your computer, for development only.

Do not use self-signed certificates in production ! For online certificates, use Let's Encrypt instead (tutorial).

Thread Pools

Thread pools on the JVM should usually be divided into the following three categories:

CPU-bound
Blocking IO
Non-blocking IO polling

Each of these categories has a different optimal configuration and usage pattern.

# Remove java 7
sudo yum remove -y java

# Install basic packages
sudo yum install -y git

# Download and install java 8
wget --no-cookies --no-check-certificate --header "Cookie: gpw_e24=http%3A%2F%2Fwww.oracle.com%2F; oraclelicense=accept-securebackup-cookie" "http://download.oracle.com/otn-pub/java/jdk/8u131-b11/d54c1d3a095b4ff2b6607d096fa80163/jdk-8u131-linux-x64.tar.gz"
tar -xzvf jdk-8u131-linux-x64.tar.gz

A lot of people mentioned other immutable JS libraries after reading my post. I thought it would be good to make a list of available ones.

There are two types of immutable libraries: simple helpers for copying JavaScript objects, and actual persistent data structure implementations. My post generally analyzed the tradeoffs between both kinds of libraries and everything applies to the below libraries in either category.

Libraries are sorted by github popularity.

	import numpy as np
	import scipy as sp

	def jsd(p, q, base=np.e):
	'''
	Implementation of pairwise `jsd` based on
	https://en.wikipedia.org/wiki/Jensen%E2%80%93Shannon_divergence
	'''
	## convert to np.array
	p, q = np.asarray(p), np.asarray(q)

	import config from '../config'

	let components = {}

	//For each component in the config fiel into an object
	for (var i = config.length - 1; i >= 0; i--) {
	components[config[i].name] = require(config[i].path).default
	}

	export default components

	import org.apache.spark.SparkContext
	import org.apache.spark.rdd.RDD

	/**
	* aggregate_by_key_example demonstrates how to use aggregateByKey to sum up
	* values by key and also keep the values themselves.
	*
	* Given the input:
	*
	* Seq(("001", 1), ("001", 2), ("001", 3), ("002", 0), ("002", 7))

	S3_ACCESS_KEY_ID_GITLAB_BACKUP=<ACCESS_KEY>
	S3_SECRET_ACCESS_KEY_GITLAB_BACKUP=<SECRET_KEY>