Claudemir Woche titowoche30

Note

I’ve written a newer optimized 2026 version of this guide with a faster setup using Zinit + Starship and improved plugin loading.

This version avoids slow shell startups and works better with modern Zsh setups.

Updated guide: https://gist.github.com/n1snt/2cccc8aa5f7b645a7628d3512c70deb6

See how a minor change to your commit message style can make you a better programmer.

Format: <type>(<scope>): <subject>

<scope> is optional

	import logging
	import boto3
	from argparse import ArgumentParser, HelpFormatter
	from botocore.exceptions import ClientError, ProfileNotFound

	# logger config
	logger = logging.getLogger()
	logging.basicConfig(level=logging.INFO,
	format='%(message)s')

	from pyspark.sql.types import *
	from pyspark.sql.functions import *

	#Flatten array of structs and structs
	def flatten(df):
	# compute Complex Fields (Lists and Structs) in Schema
	complex_fields = dict([(field.name, field.dataType)
	for field in df.schema.fields
	if type(field.dataType) == ArrayType or type(field.dataType) == StructType])
	while len(complex_fields)!=0:

	// Based on following links:
	// http://andrew.hedges.name/experiments/haversine/
	// http://www.movable-type.co.uk/scripts/latlong.html
	df
	.withColumn("a", pow(sin(toRadians($"destination_latitude" - $"origin_latitude") / 2), 2) + cos(toRadians($"origin_latitude")) * cos(toRadians($"destination_latitude")) * pow(sin(toRadians($"destination_longitude" - $"origin_longitude") / 2), 2))
	.withColumn("distance", atan2(sqrt($"a"), sqrt(-$"a" + 1)) * 2 * 6371)

	>>>
	+--------------+-------------------+-------------+----------------+---------------+----------------+--------------------+---------------------+--------------------+------------------+
	\|origin_airport\|destination_airport\| origin_city\|destination_city\|origin_latitude\|origin_longitude\|destination_latitude\|destination_longitude\| a\| distance\|

	Download/Copy all related *.zip files in one directory.
	Open terminal and change to that directory which has all zip files.
	Enter command zip -s- FILE_NAME.zip -O COMBINED_FILE.zip
	Enter unzip COMBINED_FILE.zip