Archive | monitoring RSS feed for this section

The Virtues of Monitoring

The biggest problem however is aggregating the log data, centralized logging if you will. syslog and all the alternative tools are traditionally sufficient, while on the larger scale end you have custom tools like Cloudera’s Flume or Facebook’s Scribe. There’s also a bunch of paid services specializing on logging, most noteworthy are Splunk and Loggly. Loggly relies on syslog to collect and transmit data from your servers, but they also have a custom API to transmit data. The data is indexed and can easily be searched, which is usually exactly what you want to do with logs. 
There’s a couple of open source tools available too, Graylog2 is a syslog server with a MongoDB backend and a Java server to act as a syslog endpoint, and a web UI allowing nicer access to the log data. A bit more kick-ass is logstash which uses RabbitMQ and ElasticSearch for indexing and searching log data. Almost like a self-hosted Loggly.

(Full Story: The Virtues of Monitoring)

RailsMetrics is an engine that hooks into your application to listen ActiveSupport::Notifications and show you statistics about them – GitHub

RailsMetrics is an engine that hooks into your application to listen ActiveSupport::Notifications and show you statistics about them. RailsMetrics uses threads to save those notifications in the database through an in-process Queue. You can see charts based on each request and see what queries, actions, templates rendering, etc. are slow.
(Link: RailsMetrics is an engine that hooks into your application to listen ActiveSupport::Notifications and show you statistics about them – GitHub)

Glassbox – Project

The Glassbox troubleshooter is an automated troubleshooting and monitoring agent for Java applications that diagnoses common problems with one-click. Drop it onto your existing Java Application Server (Tomcat, JBoss, WebSphere, WebLogic), either in production or testing. Because Glassbox’s troubleshooting knowledge is built in, anyone can isolate a failing connection or a slow-running query instantly. It adapts to your application and pinpoints your errors or performance issue in plain English, and you no longer need to wade through log files and graphs.
(Link: Glassbox – Project)

Link: Sinatra-Tailer: a small app for viewing server log files

Sinatra-Tailer: a small app for viewing server log files
keep an eye on on our servers… log files. Oh, and I was looking for good excuse to play around with Sinatra. So, “with a one, and-a-two, and-a-three…” we have Sinatra-Tailer.

You can read all about it on the github page, but in short it simply performs a tail and displays the last X lines of the log file.
view sourceprint?
1.tail -n /path/to/my/log/file.log


Follow

Get every new post delivered to your Inbox.