Skip to content

Instantly share code, notes, and snippets.

@hpetru

hpetru/gist:4cbc31c634e3282d8bb756979c52b3dc

Forked from nside/gist:8078726
Created April 6, 2016 14:42
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save hpetru/4cbc31c634e3282d8bb756979c52b3dc to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save hpetru/4cbc31c634e3282d8bb756979c52b3dc to your computer and use it in GitHub Desktop.
Download ZIP
scrapyd logs grokking for logstash kibana elasticsearch
Raw
gistfile1.rb
filter {
grok {
match => [ "message", "%{TIMESTAMP_ISO8601:ts} \[%{USERNAME:spider}\] %{LOGLEVEL:level}: Crawled %{NUMBER:pages2:int} pages \(at %{NUMBER:pages_rate2:int%} pages/min\), scraped %{NUMBER:items2:int} items \(at %{NUMBER:items_rate2:int%} items/min\)" ]
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment