Skip to content

Instantly share code, notes, and snippets.

View pbhalesain's full-sized avatar

Prashant Bhalesain pbhalesain

  • Setient Ltd
  • London, UK
View GitHub Profile
@pbhalesain
pbhalesain / timer.py
Created February 19, 2023 08:51
Python Countdown timer.
import time
def countdown(time_secs):
while(time_secs):
mins, secs = divmod(time_secs, 60)
timeformat = '{:02d}:{:02d}'.format(mins, secs)
print(timeformat, end='\r')
time.sleep(1)
time_secs -= 1
#print('stop')
@pbhalesain
pbhalesain / deploy_hdp31hdf34.sh
Created November 1, 2019 13:48 — forked from abajwa-hw/deploy_hdp31hdf34.sh
Deploy HDP 3.1 and HDF 3.4
#!/usr/bin/env bash
# Launch Centos/RHEL 7 VM with at least 8 vcpu / 32Gb+ memory / 100Gb disk
# Then run:
# curl -sSL https://gist.github.com/abajwa-hw/9bf11bcaadaa7f94f9075432ce5b3d0b/raw | sudo -E sh
export create_image=${create_image:-true}
export ambari_version=2.7.3.0
#export mpack_url="http://public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.4.0.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.4.0.0-155.tar.gz"
#export mpack_url="http://public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.4.1.0/tars/hdf_ambari_mp/hdf-ambari-mpack-3.4.1.0-5.tar.gz"
export mpack_url="http://public-repo-1.hortonworks.com/HDF/centos7/3.x/updates/3.4.1.1/tars/hdf_ambari_mp/hdf-ambari-mpack-3.4.1.1-4.tar.gz"
@pbhalesain
pbhalesain / README.md
Created April 21, 2016 17:55 — forked from nicerobot/README.md
Mac OS X uninstall script for packaged install of node.js

To run this, you can try:

curl -ks https://gist.githubusercontent.com/nicerobot/2697848/raw/uninstall-node.sh | bash

I haven't tested this script doing it this way but i run a lot of my Gists like this so maybe this one'll work too.

Alternatively,

curl -ksO https://gist.githubusercontent.com/nicerobot/2697848/raw/uninstall-node.sh

chmod +x ./uninstall-node.sh

Certified Spark Developer - Databricks Certification
https://databricks.com/spark/certification/certified-spark-developer
http://go.databricks.com/spark-certified-developer
Books:
Learning Spark (The main book) - O'reilly
Introduction to Apache Spark (Video Book) - O'reilly - Paco Nathan
Spark Reference Applications https://www.gitbook.com/book/databricks/databricks-spark-reference-applications/details
Spark Knowledge Base (Troubleshoot, Best Practices) https://www.gitbook.com/book/databricks/databricks-spark-knowledge-base/details
Advanced Analytics with Spark - O'reilly - Sean Owen et al.
Fast Data Processing - Packt - Holden Karau
=================================================================
SETTING UP SSHD AS A SERVICE FOR RUNNING HADOOP DAEMONS ON WINDOWS 7
=================================================================
Steps:
1. Download 'setup.exe' from Cygwin website
2. Right-click on 'setup.exe'
3. Leave settings as they are, click through until you come to the plugin selection window
3.1 - Make sure that the installation directory is 'C:\cygwin'