vikash-sinha04

vikash-sinha04 / apache_log_topnlinks.scala

Created April 12, 2020 17:19 — forked from girisandeep/apache_log_topnlinks.scala

A example program to find top N IP Addresses from Apache Logs using Spark. This is part of CloudxLab.com.

	var accessLogs = sc.textFile("/data/spark/project/access/access.log.45.gz")

	//Check whats in the RDD. Each record of accessLogs RDDs should be the line //from the files in folder
	accessLogs.take(10)

	//Keep only the lines which have IP
	def containsIP(line:String):Boolean = return line matches "^([0-9\\.]+) .*$"
	var ipaccesslogs = accessLogs.filter(containsIP)

	//Extract only IP

vikash-sinha04 / sigmoidGraph.py

Created March 26, 2019 15:50 — forked from Will-777/sigmoidGraph.py

simple sigmoid function with Python

	#import section
	from matplotlib import pylab
	import pylab as plt
	import numpy as np

	#sigmoid = lambda x: 1 / (1 + np.exp(-x))
	def sigmoid(x):
	return (1 / (1 + np.exp(-x)))

	mySamples = []