Jeff's Professional Side

Last night Bobby, Jason, and I returned to our old habit of attending a monthly meeting of the Atlanta UNIX Users Group. Returning speaker Ryan Matteson gave a rather informative presentation on the topic of Centralized Logging with syslog-ng. I’ve used syslog-ng on and off over the years, and we recommend the GPLv2 version to our services and support customers for use in conjunction with the syslog listener built into OpenNMS. Despite all this, I had never had a proper introduction to syslog-ng, so this meeting was one not to be missed.

Taking a cue from DJ’s recent post, I’m putting my notes from the talk online. Ryan has also put his slides online, so there’s not much marginal value in the following except for a couple of verbal comments that I rolled in.

Read more…

Geeky atlanta, auug, Network Management, OpenNMS, opensource, syslog-ng

The second annual Atlanta Linux Fest took place this past Saturday, the 19th September 2009. IBM was gracious enough to provide the facility, and Canonical and eApps also provided major sponsorship. The show was a success by all measures, well exceeding the organizers’ expectations. The official attendance numbers have not been published, but I have heard numbers between 600 and 700 — not bad for a show only in its second year and that fell on a very rainy day!

At Nick’s request, I had convinced Tarus to give a talk, and I pretty much unilaterally decided that OpenNMS would also be an exhibitor. We scored an absolutely prime spot in the exhibit area and drew in lots of traffic. Our good friends Mita and Robbie at Presentation Rentals (which sponsors ANSMTUG monthly) got us a great deal on a big monitor on which we ran our loop. My amazing wife volunteered to help out with the booth, her first time ever “wearing the shirt” though she’d hung out with us last October at a show in London. We always like to have as many community members representing as we have OpenNMS Group employees, so I recruited local friends Bobby and Robert to help man the booth. I’m confident that each of them fully earned a 100% commission on the free software he sold that day.

A plethora of Papa John's pizza pies, constituting lunch at Atlanta Linux Fest 2009

This show was the project’s first in Atlanta, and as happens in every new city, people came out of the woodwork who use OpenNMS to keep the IT infrastructure running smoothly at local companies that we previously had no idea were part of our user community. It turns out that Georgia Tech, which hosted last year’s Dev-Jam, is a user, as is Georgia Power. Less widely known users that we learned about include the company that provides the data underlying Google Maps‘ and other providers’ integrated roadway traffic services. I hope that some of these people will join the Order of the Blue Polo, especially since both my wife and Bobby were modeling the shirt in question. It’s fitting, and a testament to the show organizers’ excellent taste, that lunch came from a company represented in the OBP.

It was such a busy day for us that nobody had time to snap any pictures of our booth! We were fortunate enough to have, in the booth adjacent to ours, shutterbug Jane Ullah, who captured three of us loafing during a lull in the show traffic. If some images emerge that paint us in a less idle light, I’ll update this post to include them

Food, Geeky, OpenNMS atlanta, atlantalinuxfest, atllinuxfest, canonical, family, Food, ibm, linux, Network Management, OpenNMS, opensource

Shortly after Tarus published this post, I received a Twitter DM from Esmir Alemic asking if I would mind sharing the configuration for the Twitter service monitor. I tried to post this as a comment to Tarus’ post, but my pre-formatted HTML got stripped out. So here it is. I used the Provisioning Groups feature to create the twitter.com node and Twitter service, which in OpenNMS 1.6 requires the addition of a dummy protocol plugin to the capsd-configuration.xml file (in 1.8 you’ll be able to do this using Provisiond instead):


<protocol-plugin protocol="Twitter" class-name="org.opennms.netmgt.capsd.plugins.LoopPlugin" scan="off" />


The real magic lives in the poller-configuration.xml file. Define the Twitter service in the appropriate package (beware the default-empty “strafer” package):

<service name="Twitter" interval="600000" user-defined="false" status="on">
<parameter key="retry" value="1" />
<parameter key="timeout" value="5000" />
<parameter key="page-sequence">
<page-sequence>
<page path="/twitter" port="80" successMatch="(?s).*<title>Twitter \(twitter\) on Twitter.*"
virtual-host="twitter.com"
user-agent="OpenNMS/1.6 (JVM; I; Most Any Platform; en-us)" />
</page-sequence>
</parameter>
</service>


Finally, don’t forget to tell the poller which monitor class to use for the Twitter service:


<monitor service="Twitter" class-name="org.opennms.netmgt.poller.monitors.PageSequenceMonitor" />


I used the PageSequenceMonitor rather than the more basic HttpMonitor because I plan on coming back later and making the page sequence include logging in to a Twitter account, verifying that some more sophisticated tests pass, and logging out again.

OpenNMS Network Management, OpenNMS, twitter

A certain kind of person will recognize the title of this post as the name of the software suite originally known as TRAKKER, and subsequently as eHealth. That kind of person will have worked in the network management sector during the late 1990s and early 2000s and been exposed to this product line from Concord Communications. That’s no mistake – I spent five formative years working at Concord deploying, customizing, and developing various products within the suite before CA acquired the company in 2005 and I got chosen for the first round of layoffs.

Despite the title, this post is not about looking back at a piece of software that helped define an important part of my past career. It’s about looking forward to the amazing ways that OpenNMS is continuing to define both my own future and the future of organizations that are staffed by people smart enough to choose it as their primary IT management platform.

I just got off the phone with a customer who works for a non-profit regional health system in metro Atlanta. Now you understand the post title! This organization has been using OpenNMS for years as an adjunct to an expensive commercial management platform whose name rhymes with “FrogLight”. Recently the IT department hired a particularly smart and good-looking bunch of people who decided to migrate the management of all internal networks, systems, and applications to OpenNMS. These folks recognized that such an effort is best accomplished with expert help, so they engaged my employer to provide professional services and technical support.

The subject at hand for the phone call just completed was to help configure OpenNMS to monitor a pair of metrics, namely the number of files and the age of the newest file in a particular directory on a Windows file server. That directory serves as an incoming queue for job processing. If the file count exceeds some maximum number, or if the newest file is older than some maximum age, then the application consuming the queue is known to be headed for trouble, so the application administrator wants to know about it. While this problem is fairly mundane, solving it without installing extra software is hard! The SNMP agent that ships with Windows is not extensible via simple scripts, so there’s no easy solution analogous to extending the Net-SNMP agent’s MIB.

We thought at first that OpenNMS’ support for the NSClient++ quasi-agent would do the trick as a one-off, but it turns out that this approach would require extensive configuration on the managed side, and the customer wanted to avoid the change management impact of installing a package that existed nowhere else in the environment. In the end, we conscripted IIS, which was already installed and running on the managed server, into service as a stand-in agent by whipping up an ASP that prints the two metrics’ values as a simple web page. We configured OpenNMS’ HTTP Collector to pull in the values as first-class node-level performance data. From there it was a simple matter of configuring two high thresholds to compare the collected values in real time against the acceptable maximums.

Apart from knowing that physicians get cranky when they don’t get serviced quickly, I have no idea what kind of jobs pass through the queue that we’re now helping our customer better manage. All that matters from our perspective as a company is that our efforts are helping a bunch of physicians work more efficiently. That fact could come home to me someday since the nearest hospital to my house is part of the customer’s system, and I want any physician who’s working on my body to be happy with the tools at his or her disposal.

This story is just the latest coup in a series that started when the customer’s IT department decided to consolidate management and monitoring onto OpenNMS. After we ironed out the last configuration details of the support ticket at hand, my contact let me know that he would be opening several additional tickets over the coming week. It’s not that he’s having problems with OpenNMS, but that his colleagues are lining up to discuss problems that they think OpenNMS could help them solve. We’ll be here to help him stay on top of that queue as well, which means that our contact will stay happy with both OpenNMS and our support services, which help him apply OpenNMS to meet his job objectives. Because all of OpenNMS is OSD-compliant free and open-source software, its functionality comes at no cost beyond the hardware and staff required to operate it, which means that our customer’s management and board of directors stay happy. Happy management tends to have no reservations about writing a check when the time comes for support renewal.

Geeky, OpenNMS, Software Network Management, OpenNMS