Blogs
Breaking News breaks records across the net
Submitted by Erik Petersen on Fri, 03/07/2009 - 07:18. events | non-functional testing | performance testing | perspectivesThe website TMZ.com broke the story 20 minutes after his passing, then went down briefly under the load. The LA Times was the first news site, and it fell over soon after. Online news services saw a 20% increase in traffic, but the availability of popular web news sites dropped from 100% to 86% and didn't return for another 4 hours.
Working with User Stories: The Existing Parts
Submitted by Karen N. Johnson on Sun, 28/06/2009 - 17:20.I think of user stories in the same way.
I don’t like to review user stories and believe that they are always “right.” I don’t believe that the stories are always “complete.” And I don’t believe user stories can be the authoritative source for anything more than “what the author thought the application would do at the time they wrote the story.” I am a committed skeptic.
FitNesse - NarrativeFixture Story 1 nearing completion
Submitted by Antony Marcano on Mon, 22/06/2009 - 22:08.The FitNesse Narratives project that I've been working on along with Andy Palmer, has reached a major milestone - our first story is functionally complete. We're finishing off some refactoring and need to automate the build but once those things are in place our 'Iteration 0' Story will be done.
I thought that you'd like a preview of the NarrativeFixture, the star of this story, so you can start to see where we are going. You'll be able to get your hands on it and use it yourself soon enough.
Agile Testing Training in London on 9th July 2009
Submitted by Antony Marcano on Fri, 19/06/2009 - 16:45. agile | eventsYes, that's right... I'm giving a public course in Agile Testing (or Agile QA as some might call it) on Thursday 9th July in London with Rachel Davies and in association with SkillsMatter.
We cover everything from Agile fundamentals through to Acceptance Test Driven Development and Behaviour Driven Development.
Risk Management Strategies... and the misuse of "mitigate"
Submitted by Antony Marcano on Thu, 18/06/2009 - 09:28.I frequently encounter people who tell me of risk management courses that they've been on and tell me of four (straight from Wikipedia) strategies for addressing a risk::
- Avoidance (eliminate)
- Reduction (mitigate)
- Transfer (outsource or insure)
- Retention (accept and budget)
I'm no risk management expert, but I've certainly got plenty of experience in it. I am a lover of language and words and immediately notice one small problem with this model - the use of the word "Mitigate".
"Mitigate" is a commonly misunderstood word. Many use it as a synonym for "reduce" but it actually has a special meaning:
to make something less harmful, unpleasant or bad -Cambridge Dictionary
Farewell testingreflections!
Submitted by Ainars Galvans on Thu, 18/06/2009 - 07:48.There are different reasons for the decision. One of the reasons is that I feel I don’t belong here, not any more or perhaps never had. I feel like testingreflections lives primary under the agile banner. I’ve been inspired a lot by agile ideas, but I never adopted them. I reclaim my personal method .
Asia Pacific CITCON does Brisvegas!
Submitted by Erik Petersen on Thu, 04/06/2009 - 01:58. agile | eventsAfter a great conference in Sydney in 2007 and Melbourne in 2008, The Continuous Integration and Testing conference (CITCON) is coming to Brisbane in 2009, on June 27th. It’s an open space conference where we all meet the night before (June 26th) to propose and vote for sessions (and arrange the session schedule) then we socialize, then we come back on the Saturday and enjoy sessions of demonstrations, discussions, BOF, etc interspersed with eating and socializing again. Participants said it was an amazing experience both years, so may be scintillating in the Brisvegas sunshine.
This is a free conference, running on sponsorship (Special thanks to this years sponsors!). Check out the details including registration at http://www.citconf.com/brisbane2009/
We’ll be at the Acacia Ridge Conference Center, a short distance south of the Brisbane CBD. On a slightly serious note: It may be free to attend, but it still costs money to run so if you do register but can’t come, please tell us so we don’t overcommit on the catering etc, and someone else can take your place (and your t-shirt and show bag!). Folk from the US, NZ, India and around Australia are already registered. Join us for some great CITCONning!
Short and long game thinking, tests driving design and CRAP metrics
Submitted by Erik Petersen on Thu, 28/05/2009 - 05:59. agile | design & development | refactoring | test automationKent Beck recently posted To Test or Not to Test? That’s a Good Question on the complex “theory versus practice” issue of always automating tests, where he states,”Then a cult of [agile] dogmatism sprang up around testing–if you can conceivably write a test you must”. By classifying projects into long game and short game, he argues that ROI becomes a major issue on whether a test stays manual. He says “Not writing the test for the second defect gave me time to try a new feature”, but several people commented that this was a technical debt tradeoff, and Guilherme Chapiewski noted he had done the same thing with a Proof of Concept that went live then he had to rewrite major chunks later. It is interesting that this ROI discussion is reflecting the experiences of the pre-agile functional automation community. Back in November 2001 (Wow! Long time ago!!), I posted to the Agile Testing list some considerations for not automating . While many of these were from the context of two separate development teams and the automaters using expensive test tools, the risks of incomplete automation and insufficient ROI dominate. The benefits of having the same people both develop the code and the tests are great, and beyond my experience when I wrote that post.
I think the ROI issue for code-based tests will go away over time. Much of the creation of code-based tests is mechanical. Just as programming languages replaced assembler and took care of fiddly details (what registers to use, low level comparisons etc) and build utilities replaced simple text file include statements, I think that soon it will be standard practice to have tool-created unit testing to handle mocking, dependency injection and assert-based testing. Mocking was originally very manual, then tools were developed. Dependency Injection was very manual,then tools were developed. For assert-based testing, we’ve already seen Agitar’s tools , zentest and now pex amongst others. I think these tools will become standard, just as coverage tools are now standard in IDEs when they originally were luxuries costing tens of thousands of dollars. Another variation of this is tools like Celerity recently blogged about by Jeffrey Frederick. Celerity is a fast way to run GUI web tests, but could be handled as a mechanical translation not a manual one. Some meta language could generate Celerity and selected browser tests in a single step.
Mechanically generated tests are cheap to produce and overcome ROI issues. However, they only reflect the current code. The benefits of test design infusing the coding approach are missing. If tests are not being automated for whatever reason, some analysis of the refactoring risk should be done, at least to know where and what the error-prone code is. One way of doing this is using the Agitar-created CRAP metric , which Bob Martin recently blogged about as a way to keep design clean. While I currently believe all code should be created test first wherever possible, techniques like the CRAP metric can highlight the complicated bits for refactoring where possible. While it may be a great intellectual challenge, there is no need to refactor a complex industry standard algorithm. [Aside: is there an inherent advantage to doing test first design all the time? Perhaps, just as renaissance masters only painted and sculpted hand and faces and left the rest to their workshop staff, we only need to focus on core functions for test first and do the rest test last?]
As Kent says,”By insisting that I always write tests I learned that I can test pretty much anything given enough time.” Time is often a rare commodity, so Kent argues compromises are often needed in short goal projects. As Ron Jeffries said in a comment on Kent’s post, “My long experience suggests that there is a sort of knee in the curve of impact for short-game-focused decisions. Make too many and suddenly reliability and the ability to progress drop substantially.” I hope that advancements in mechanical generation of tests don’t push us into a short game perspective, impacting the use of hand crafting tests to drive design. At the same time, metrics that can be run as part of the build to highlight areas for refactoring on all projects are proving valuable (and I’m looking forward to state coverage ). By any measure, these are interesting times we live in. Long live long game thinking!
