Skip to content

Instantly share code, notes, and snippets.

@sanjeevbadgeville

sanjeevbadgeville/gzip-hdfs

Forked from terrancesnyder/gzip-hdfs
Last active August 29, 2015 14:06
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save sanjeevbadgeville/99a3642ae48e577f4c6c to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save sanjeevbadgeville/99a3642ae48e577f4c6c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gzip-hdfs
hadoop fs -cat /Work/lon_text/lon_order_data_t/cdw320_lon_order_data_t.1.txt | head -100 | gzip > test.csv.gz
cat cdw320_lon_order_data_t.1.txt | head -100 | gzip > ../../tsnyder/cdw320_lon_order_data_t.1.txt.gz
hadoop fs -cat /Work/tsnyder/cdw320_lon_order_data_t.1.txt.gz | gunzip
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment