Links

justniffer is a tcp packet sniffer

Justniffer is a tcp packet sniffer. It can log network traffic in a 'standard' (web server like) or in a customized way. It can also log response times, useful for tracking network services performances (e.g. web server, application server, etc.).
Main differences from other sniffers
Most of the sniffers are divided into two categories, packet an text sniffers. Both suffer from incompleteness of information that may be collected and analyzed

* Packet sniffers collect too much data, such as packet headers details, and they make easy to analize low level network problem (such as tcp retrasmissions, or ip fragmentation) but make hard-working and time wasting to analize more high level details ( such as content correctness, keep-alive issues, connection timeouts, response time, etc)
* Textmode sniffers usually rebuild TCP stream but cannot collect low level information such as timestamps. They often rebuild the tcp flow in a too simplistic way and fail when dealing with complex TCP/IP issues (reordering, retransmission, reassemlbying, etc). TCP reassembling and reordering is a complex exercise, and require a deep knowledge of TCP/IP protocol and long experience in the field. Usually,they are useful for pure grabbing content from network traffic.

Justniffer was born to help in toubleshooting perfomance in network tcp based services : HTTP, JDBC, RTSP, SIP, SMTP, IMAP, POP, LDAP, etc.
It can collect low and hight level protocol and performance info reconstructing the tcp flow in a reliable way using portions of the Linux Kernel code. Precisely, it uses a slightly modified version of the libnids libraries that already include a modified version of linux kernel code in a more reusable way.
You can extend traffic analisys with external scripts (bash, python, or any executable). An example is provided: justniffer-grab-http-traffic script use justniffer to saves files (images, text, html pages, javascript, flash, video, etc) captured from HTTP traffic.
Justniffer can generate logs in a customizable way. For example it can mimic the apache access_log

http://justniffer.sourceforge.net/

Filed under  //   http   tcp   tools  
Posted September 29, 2009 by email 
// 1 Comment

Piwik: open source web analytics software

Piwik is a downloadable, open source (GPL licensed) web analytics software program. It provides you with detailed reports on your website visitors: the search engines and keywords they used, the language they speak, your popular pages... and so much more.

Piwik aims to be an open source alternative to Google Analytics.

Piwik is a PHP MySQL software program that you download and install on your own webserver. At the end of the five minute installation process you will be given a JavaScript tag. Simply copy and paste this tag on websites you wish to track (or use an existing plugin to do it automatically for you).

Filed under  //   analytics   logs   tools   web  
Posted September 25, 2009 by email 
// 0 Comments

Timechart: Finding out why your Linux computer performs the way it does has

  
Finding out why your Linux computer performs the way it does has been a hard task. Sure, there is Oprofile, and even 'perf' in recent kernels. There is LatencyTOP to find out where latencies happen.

 But all of these tools are rather limited when the software stack that has the performance issue is more complex than a single program. The tool that comes closest to being useful is `bootchart', but that has a rather limited resolution.

 http://blog.fenrus.org/?p=5

Filed under  //   charts   linux   performance   tools  
Posted September 21, 2009 by email 
// 0 Comments

HexEditor for Mac: HexFiend

http://ridiculousfish.com/hexfiend/

Filed under  //   mac   tools  
Posted September 4, 2009 by email 
// 0 Comments

JVM Tools: Btrace, VisualVM

VisualVM

VisualVM is a tool to monitor and troubleshoot Java applications. It runs on Sun JDK 6, but is able to monitor applications running on JDK 1.4 and higher. It utilizes various available technologies like jvmstat, JMX, the Serviceability Agent (SA), and the Attach API to get the data and automatically uses the fastest and most lightweight technology to impose minimal overhead on monitored applications.

https://visualvm.dev.java.net/

Screencast

 

BTrace

BTrace is a safe, dynamic tracing tool for the Java platform. BTrace can be used to dynamically trace a running Java program (similar to DTrace for OpenSolaris applications and OS). BTrace dynamically instruments the classes of the target application to inject tracing code ("bytecode tracing"). Tracing code is expressed in Java programming language. There is also integration with DTrace for the OpenSolaris platform.

Tracing JDBC SQL queries using BTrace
http://blogs.sun.com/sundararajan/entry/btrace_in_real_world

BTrace Fix on the Mac
http://kensipe.blogspot.com/2009/02/btrace-fix-on-mac.html

BTrace Plugin for VisualVM
http://kenai.com/projects/btrace/pages/BTracePlugin

Monitoring and Troubleshooting Java™ Platform Applications with JDK™ Software
https://visualvm.dev.java.net/files/documents/7163/136082/JavaOne-2009-BOF-4724.pdf

Eclipse Launcher for VisualVM
https://visualvm.dev.java.net/eclipse-launcher.html

Filed under  //   java   jvm   performance   tools  
Posted August 13, 2009 by email 
// 0 Comments