Skip to content

Instantly share code, notes, and snippets.

@jiyouyou125

jiyouyou125/aggregateop.png

Forked from ilya-pimenov/aggregateop.png
Created February 17, 2016 11:09
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save jiyouyou125/60a6a7f6001d76d0dd04 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save jiyouyou125/60a6a7f6001d76d0dd04 to your computer and use it in GitHub Desktop.
Download ZIP
Full article here — http://ilyapimenov.com/blog/2013/11/14/hyperloglog-with-cascalog.html. We’ll look shortly in how you would utilize awesomeness of both Cascalog and HyperLogLog in order to execute Hadoop M/R tasks with amounts of data too big to have them in their original form.
Raw
ov-chipkaart-accesslogs.txt
Edam 5594 c0a07d21-6227-4c19-8e64-0dbabd77a32e 1380427587
Edam 3886 b7fa390a-00c0-4f9b-9b5b-6e75d1d7c071 1360991703
Delft 2290 182a4ab4-2ea5-4914-a38f-912ef8514ed9 1361493601
Delft 4091 9c49526a-2bce-4a9f-b7c6-cb4df7336d94 1363341076
Amsterdam 6427 cee77961-3f12-4af0-aa95-b490720d8631 1353638371
Amsterdam 6427 cee77961-3f12-4af0-aa95-b490720d8631 1353638271
Amsterdam 6427 cee77961-3f12-4af0-aa95-b490720d8631 1353638271
Amsterdam 6427 cee77961-3f12-4af0-aa96-b490720d8631 1353638271
Amsterdam 6427 cee77961-3f12-4af0-aa97-b490720d8631 1353638271
Amsterdam 6427 cee77961-3f12-4af0-aa98-b490720d8631 1353628371
Haarlem 4584 d944b619-5ccf-426c-a01f-539b1cc276ce 1375984323
Haarlem 1134 854b1801-be30-4943-8157-f06db7a62984 1366265068
Delft 3855 6a38d06d-9b4c-4d39-8ab6-10d7a68f8929 1366380736
Delft 5589 efba0586-d68f-463c-aa03-4672d2788666 1374257096
Den-Haag 3797 5a30ec3d-e9af-4ac1-b0c5-970a13327a52 1382893346
Raw
project.clj
View raw

(Sorry about that, but we can’t show files that are this big right now.)

Raw
screen6_demo_hyperloglog_with_cascalog_core.clj
View raw

(Sorry about that, but we can’t show files that are this big right now.)

Raw
screen6_demo_hyperloglog_with_cascalog_util.clj
View raw

(Sorry about that, but we can’t show files that are this big right now.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment