Sripathi Krishnan sripathikrishnan

TestService

Windows Service with Python 3.5 and pyinstaller

Requirements

Python 3.5.x
Visual C++ Build Tools 2015
PyInstaller 3.2

AWS Elastic Beanstalk deploy user restricted IAM policy

An IAM user policy document to give minimal rights for deploying an Elastic Beanstalk application.

Where:

REGION: AWS region.
ACCOUNT_ID: AWS account ID.
APPLICATION_NAME: Desired target Elastic Beanstalk application name(space).
IAM_INSTANCE_PROFILE_ROLE: The instance profile (IAM role) Elastic Beanstalk EC2 instaces will run under.

Internet Scale Services Checklist

A checklist for designing and developing internet scale services, inspired by James Hamilton's 2007 paper "On Desgining and Deploying Internet-Scale Services."

http://mvdirona.com/jrh/talksandpapers/jamesrh_lisa.pdf

Basic tenets

Does the design expect failures to happen regularly and handle them gracefully?
Have we kept things as simple as possible?

General Background and Overview

Probabilistic Data Structures for Web Analytics and Data Mining : A great overview of the space of probabilistic data structures and how they are used in approximation algorithm implementation.
Models and Issues in Data Stream Systems
Philippe Flajolet’s contribution to streaming algorithms : A presentation by Jérémie Lumbroso that visits some of the hostorical perspectives and how it all began with Flajolet
Approximate Frequency Counts over Data Streams by Gurmeet Singh Manku & Rajeev Motwani : One of the early papers on the subject.
[Methods for Finding Frequent Items in Data Streams](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.187.9800&rep=rep1&t

	"""
	Copies all keys from the source Redis host to the destination Redis host.
	Useful to migrate Redis instances where commands like SLAVEOF and MIGRATE are
	restricted (e.g. on Amazon ElastiCache).

	The script scans through the keyspace of the given database number and uses
	a pipeline of DUMP and RESTORE commands to migrate the keys.

	Requires Redis 2.8.0 or higher.

	foo@bar:~$ redis-cli
	127.0.0.1:6379> dbsize
	(integer) 0
	127.0.0.1:6379> set user:1 1
	OK
	127.0.0.1:6379> set use:the:force luke
	OK
	127.0.0.1:6379> set non:user a
	OK
	foo@bar:~$ redis-cli --eval scanregex.lua , "^user"

	# Copyright (c) 2013 Georgios Gousios
	# MIT-licensed
	# [megansquire] Edited to handle new column names (Date instead of CreationDate)

	create database stackoverflow DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8mb4_bin;

	use stackoverflow;

	create table badges (
	Id INT NOT NULL PRIMARY KEY,


	> ~/tcp_redis_monitor.py 6379

	Timestamp Nb TX bytes RX bytes TX RMA RX RMA
	1333983822.943 1 0 0 0.000 0.000
	1333983823.193 1 0 0 0.000 0.000
	1333983824.194 1 0 0 0.000 0.000
	1333983825.195 1 0 0 0.000 0.000
	1333983826.196 1 0 0 0.000 0.000

	#!/usr/bin/env python

	# with help and inspiration from
	# * ASN1_generate_nconf(3) (specifically the SubjectPublicKeyInfo structure)
	# * http://www.sysmic.org/dotclear/index.php?post/2010/03/24/Convert-keys-betweens-GnuPG%2C-OpenSsh-and-OpenSSL
	# * http://blog.oddbit.com/2011/05/converting-openssh-public-keys.html

	import sys
	import base64
	import struct