Test tools
AST Update: Smart Stuff for Career Software Testers
Submitted by sbarber on Tue, 18/12/2007 - 04:35. acceptance testing | context-driven testing | functional testing | general software testing | non-functional testing | other online resources | performance testing | perspectives | project management | test management | test tools | useful utilitiesDecember Issue of the Association for Software Testing Newsletter Now Available
Goodbye Mercury.......... Hello HP
Submitted by Erik Petersen on Mon, 18/12/2006 - 02:59. test tools | this.siteSo what was Mercury Interactive that then became Mercury is now to be rebranded HP. Apparently, this is on the basis of the IT industry being more familiar with HP than Mercury. I guess that's true in general, but not in the testing tool space. Even IBM has preserved the Rational name, but Rational had ditched the SQA name when they bought TeamTest. So that great Mercury bull-grabbed-by-the-horns t-shirt from STARwest in October is the last one in a long line of Mercury images.... Guess I could save it for eBay, but it’s too good an image not to wear! (Mind you, I could probably put my old SQA TeamTest t-shirt up on ebay now!)
HP to buy Mercury Interactive
Submitted by sbarber on Wed, 26/07/2006 - 20:51. general software testing | Mercury LoadRunner | performance testing | performance testing tools | test automation | test management tools | test toolsOn Tuesday 7/25/2006, CNNMoney.com (along with *many* others) broke the news that the rumored HP/Mercury deal is really happening. A summary and my reaction is below. See the entire release here and draw your own conclusions.
July 26 2006: 9:22 AM EDTNEW YORK (Reuters) -- Hewlett-Packard agreed on Tuesday to buy Mercury Interactive for about $4.5 billion in stock, or $52 per share, in a bid to expand the computer maker's business software operations.
Multiplicity
Submitted by Mike Kelly on Tue, 25/04/2006 - 20:08. test tools[textile]
Not directly related to testing, but this is a must have development tool - Multiplicity. I've been using it for a week now, and I think I'll buy a license today.
Multiplicity allows you to control multiple machines using one mouse/keyboard. I have a dual monitor system at home to begin with, but I keep many client files on my laptop because that's what I take on site. With multiplicity, I have three screens on my desktop, access to all my files (without having to set up a share or network anything), and for all practical purposes, I don't know it's a separate machine.
You can also copy text back and forth using the clipboard -- it's not much, but I've already found it handy for code and text from documents and emails.
Check it out. Also noteworthy, it's been up and running for a week now and I haven't noticed any bugs. Something rare...
Not directly related to testing, but this is a must have development tool - Multiplicity. I've been using it for a week now, and I think I'll buy a license today.
Multiplicity allows you to control multiple machines using one mouse/keyboard. I have a dual monitor system at home to begin with, but I keep many client files on my laptop because that's what I take on site. With multiplicity, I have three screens on my desktop, access to all my files (without having to set up a share or network anything), and for all practical purposes, I don't know it's a separate machine.
You can also copy text back and forth using the clipboard -- it's not much, but I've already found it handy for code and text from documents and emails.
Check it out. Also noteworthy, it's been up and running for a week now and I haven't noticed any bugs. Something rare...
Roll Your Own Tools.. Real-time Graphing and Round Robin Data Storage
Submitted by Corey Goldberg on Tue, 25/04/2006 - 04:18. java | Open Source | test toolsI have spent a lot of time playing around with graphics libraries and toolkits for integrating real-time graphs within my own testing and monitoring tools. It seems like there are many open source tools available in the world of performance testing and system monitoring. And lots of people roll their own tools in whatever programming language they are into... but many lack graphics capabilities.
Two of the toolkits/libraries I end up using often for my own homebrew test tools are: RRDTool , and JRobin.
from the RRDTool site:
"RRD is the Acronym for Round Robin Database. RRD is a system to store and display time-series data (i.e. network bandwidth, machine-room temperature, server load average). It stores the data in a very compact way that will not expand over time, and it can create beautiful graphs. It can be used via simple shell scripts or as a perl module."
So...
RRDTool is a really good back-end for storing time-series data; which is pretty much all we care about when we are doing performance testing. It has bindings for various scripting languages, or can be invoked from the command line. If you are developing tools that need a data repository and graphing capabilities, this provides you both. You create an RRD and then you begin inserting data values at regular intervals. You then call the graphing API to have a graph displayed. The cool thing about this data storage is its “round robin” nature. You define various time spans, and the granularity at which you want them stored. I fixed binary file is created, and this never grows in size over time. As you insert more data, it is inserted into each span. As results are collected, they are averaged and rolled into successive time spans. It makes a much more efficient system than using your own complex object structures, or a relational database, or file system storage.
You will probably recognize the graphs it creates, as RRDTool is integrated in many popular monitoring tools (it is Free/Open Source, GPL License). I have built many tools around RRDTool, and it is really a nice system.
If you are in the Java world, there is a very cool project named JRobin. JRobin is a clone of RRDTool in pure Java. So you can create RRD's directly from your Java code.. and all in memory if you want to!
Some days I pretend to be a Java programmer, so I had to build a tool using JRobin. As a proof of concept, I wrote a small network latency monitoring tool. It shows off some of JRobin's capabilities. It pings a host at a given interval and records the latency. A graph of the network latency is rendered in real-time onto a Swing panel.
Here is my network latency monitoring tool: NetPlot (includes Java source code, GPL Licensed)
The tool itself is just a trivial example, and really isn't the point. But you could easily adapt this code or create your own to develop real-time graphs of your own time-series data.
(hmm.. I wonder if I could hook this into JMeter? probably..)
(How freaking ironic?.. I've been using this thing for a while now, but I decided to check the JRobin web site while I'm writing this.. and the developer just ceased development of the project and turned over all related rights to OpenNMS. can someone reading this please take over JRobin maintenance? .. erm seriously)
-Corey Goldberg
www.goldb.org
Two of the toolkits/libraries I end up using often for my own homebrew test tools are: RRDTool , and JRobin.
from the RRDTool site:
"RRD is the Acronym for Round Robin Database. RRD is a system to store and display time-series data (i.e. network bandwidth, machine-room temperature, server load average). It stores the data in a very compact way that will not expand over time, and it can create beautiful graphs. It can be used via simple shell scripts or as a perl module."
So...
RRDTool is a really good back-end for storing time-series data; which is pretty much all we care about when we are doing performance testing. It has bindings for various scripting languages, or can be invoked from the command line. If you are developing tools that need a data repository and graphing capabilities, this provides you both. You create an RRD and then you begin inserting data values at regular intervals. You then call the graphing API to have a graph displayed. The cool thing about this data storage is its “round robin” nature. You define various time spans, and the granularity at which you want them stored. I fixed binary file is created, and this never grows in size over time. As you insert more data, it is inserted into each span. As results are collected, they are averaged and rolled into successive time spans. It makes a much more efficient system than using your own complex object structures, or a relational database, or file system storage.
You will probably recognize the graphs it creates, as RRDTool is integrated in many popular monitoring tools (it is Free/Open Source, GPL License). I have built many tools around RRDTool, and it is really a nice system.
If you are in the Java world, there is a very cool project named JRobin. JRobin is a clone of RRDTool in pure Java. So you can create RRD's directly from your Java code.. and all in memory if you want to!
Some days I pretend to be a Java programmer, so I had to build a tool using JRobin. As a proof of concept, I wrote a small network latency monitoring tool. It shows off some of JRobin's capabilities. It pings a host at a given interval and records the latency. A graph of the network latency is rendered in real-time onto a Swing panel.
Here is my network latency monitoring tool: NetPlot (includes Java source code, GPL Licensed)
The tool itself is just a trivial example, and really isn't the point. But you could easily adapt this code or create your own to develop real-time graphs of your own time-series data.
(hmm.. I wonder if I could hook this into JMeter? probably..)
(How freaking ironic?.. I've been using this thing for a while now, but I decided to check the JRobin web site while I'm writing this.. and the developer just ceased development of the project and turned over all related rights to OpenNMS. can someone reading this please take over JRobin maintenance? .. erm seriously)
-Corey Goldberg
www.goldb.org
Hidden XML Tool
Submitted by Mike Kelly on Wed, 20/07/2005 - 04:05. test tools[textile]
For those of you who don't know, I'm a avid user of the IBM Rational tools. I don't necessarily think they're that much better then any other commercial test tool, but I've done a lot of work with them. I know them fairly well, and they've been good to me over the past few years. All said and done they get the job done.
Having said that, I use the Rational tools a lot.
Recently I've also been doing a lot of web service testing which means I'm looking at a lot of XML. Imagine my surprise today when someone told me that there is an XML diff tool included in the Rational suite of tools. Shocked that I didn't know such a thing, I checked it out. You can find it here: "C:\Program Files\Rational\ClearCase\bin\xmldiffmrg.exe"
So clearly, I don't do a lot with ClearCase or I would already know about this tool.
Either way, I checked it out and I kinda like it. I figure if I didn't know it was there, others might not as know either. If you're paying for the Rational suite of tools, you need to get all the mileage out of them that you can.
If anyone else knows of any other hidden utilities or tools they would like to share, feel free to post them below (Rational related or not). Let's get the word out. I don't like it when I have useful tools installed that I don't even know I have.
For those of you who don't know, I'm a avid user of the IBM Rational tools. I don't necessarily think they're that much better then any other commercial test tool, but I've done a lot of work with them. I know them fairly well, and they've been good to me over the past few years. All said and done they get the job done.
Having said that, I use the Rational tools a lot.
Recently I've also been doing a lot of web service testing which means I'm looking at a lot of XML. Imagine my surprise today when someone told me that there is an XML diff tool included in the Rational suite of tools. Shocked that I didn't know such a thing, I checked it out. You can find it here: "C:\Program Files\Rational\ClearCase\bin\xmldiffmrg.exe"
So clearly, I don't do a lot with ClearCase or I would already know about this tool.
Either way, I checked it out and I kinda like it. I figure if I didn't know it was there, others might not as know either. If you're paying for the Rational suite of tools, you need to get all the mileage out of them that you can.
If anyone else knows of any other hidden utilities or tools they would like to share, feel free to post them below (Rational related or not). Let's get the word out. I don't like it when I have useful tools installed that I don't even know I have.
From "Staplers" to "ScrewDrivers" to "Open Source Enterprise Test-Tools Suite"
Submitted by Antony Marcano on Thu, 13/01/2005 - 12:54. test tools[textile]"Mike Kelly":http://www.testingreflections.com/user/view/55 started with [Stapler Testing] and now he moves onto "Screwdrivers":http://www.testingreflections.com/node/view/1447 . The first was an exercise in "Thinking like a Tester", the latter is an interesting metaphore for Test Tools.
I will try to hide my envy, as I wasn't able to go to the AWTA due to other commitments. I wish I could have been there as it sounds like it was excellent!
In his "Screwdrivers post":http://www.testingreflections.com/node/view/1447 he says...
I will try to hide my envy, as I wasn't able to go to the AWTA due to other commitments. I wish I could have been there as it sounds like it was excellent!
In his "Screwdrivers post":http://www.testingreflections.com/node/view/1447 he says...
AWTA6 Report: Open-Source Web Test Tools
Submitted by bret on Wed, 12/01/2005 - 18:23. events | Open Source | programming languages | test toolsOver the weekend, i hosted the sixth annual meeting of the Austin Workshop on Test Automation. Elisabeth Hendrickson co-hosted the event and Pat McGee and Scott Barber helped with the organization. We had 10 participants this year. Our theme was...

