November 8, 2017
We conclude our two part series by talking about Code Review as a Service, who might need such a thing, what it promises and how it corresponds with what organizations are actually doing. As was the case last week, we share opinions and talk about the fact that marketing often drives the perception, but the devil is always in the details and the details may not be as compelling or flashy but they are relevant and more times than not really tell a fuller story of what is going on.Listen now
October 25, 2017
For this set of two shows, we decided to do a forum of just us regulars, and we were going to look at a couple of news stories. Those stories turned out to be the bulk of an extended conversation. We realized that the theme in all of them were the claims that companies made vs. what actually happens in workplaces and organizations.
Needless to say, this is an opinionated set of shows this go around as we discuss the promise of Machine Learning and what it actually delivers. We look at it in the light of other promises made over the past fifty years and how, often, it’s not the best idea that wins the day, but the first idea to gain traction that does.Listen now
October 11, 2017
We are back with Peter Varhol for Part 2 of our discussion on Machine Learning and AI. In this episode, we pick up with Peter and discuss the pitfalls of machine learning algorithms, where they can help us and where they often fail us. Also, what is the role of the tester and testing in machine learning and AI? How intimately involved with the problem domain do testers need to be? How can they learn to understand the analytical parts and what they need to accomplish within that problem domainListen now
September 28, 2017
QualiTest is celebrating its 20th Anniversary this month. To celebrate, founder and global CEO Ayal Zylberman joined Matt Heusser, Jessica Ingrassellino, Perze Ababa, Justin Rohrman and Michael Larsen to talk about the ups and down, and the growth and changes that QualiTest has been through. Ayal discusses how the climate has changed, the ways in which testing at QualiTest has changed, and what he sees as interesting opportunities for the future. Also, Ayal weighs in with us on the Equifax breach and what it might mean for the quality reputation of Equifax and other companies in the future.Listen now
September 13, 2017
This is the first of a two-parter with Peter Varhol on both the promises and the hype surrounding AI and Machine Learning. Matt, Perze and Michael go down the rabbit hole on the Machine Learning topic with Peter as we try to wrap our heads around both the realities of Machine Learning, AI and the unique testing challenges such systems offer. From Facebook’s Chatbots negotiating an agreement to systems making predictive suggestions in ways that are both intriguing and creepy. There is a lot to the machine learning puzzle that we are just starting to understand and also prepare ourselves to effectively test. Hint: the algorithms themselves are only part of the puzzle.Listen now
August 30, 2017
In an age when computing and communications is happening on anything and everything imaginable, Matt and Michael reached out to Paul Grizaffi of Magenic to discuss the proliferation of the Internet of Things as well as the convergence of so many devices that used to be discrete components requiring space, attention and connections that had to be closely monitored. With the Internet of Things and, more to the point, the spread of Ubiquitous Computing that goes even beyond the Internet of Things, we chatted and geeked-out on some developments in tech that have changed our everyday realities (we went on a tangent on how these technologies are filtering into musical instruments).Listen now
August 16, 2017
We conclude our conversation with Adam Goucher with some discussion about the goals organizations hope to achieve and the fact that many of the problems encountered with CD are people problems as opposed to toolchain problems. We talk about using CD approaches even when your organization has decided not to push several times a day. Additionally, what can you do when the long-distance goal is represented, but it’s not clearly defined and how to get there is also not clearly defined. Adam’s been there and he has plenty to say about it.Listen now
August 3, 2017
Continuous Integration, Continuous Deployment, Continuous Delivery, and a host of other continuous options abound out there. Do you know the difference? Would you like to? We asked Adam Goucher to come out and discuss with us the variations on the theme between these three distinct disciplines, what they mean, how they are implemented, and where testing and testers fit into the processes. This is the first part of a two-part interview. We will conclude this interview in our next episode.
Also, in the news segment, do you trust the idea of an open source autonomous automobile? Also, what happened when stock prices for many big technology companies all read the same stock price at the exact same time? If you are guessing a bug in the system, you’d be right, and we definitely have a few things to say about it.Listen now
July 19, 2017
Brick and Mortar stores have a lot of software in their operations. From supply chain to ordering, point of sale, inventory management, customer procurement and customer satisfaction, that’s a lot of moving pieces to keep track of. It’s a challenging endeavor to keep it all together, and QualiTest’s Mike Hershkovitz joins Matt and Jess to talk about the ins and outs or testing for the retail space.
Also, in a separately recorded segment, the Amazon purchase of Whole Foods and what it might mean is discussed by Matt, Perze, Justin and Michael. Is it really an additional 400-plus Amazon distribution centers, or is there something else going on here?Listen now
July 6, 2017
You know the feeling. Someone is breathing down your neck ,saying that we have to get the release out on this date at this time or else… well, it won’t be pretty, let’s just leave it at that! Sound at all familiar? Yeah, we feel your pain, and we talk about it quite a bit. Deadlines are a reality. Sometimes they are essential and necessary. Often they are nebulous and ill defined. Regardless, testers deal with them and the Testing Show Panel shares a few of our experiences and how we managed, or didn’t manage, those expectations.
Also, eClinicalWorks got to see first hand that untested, buggy and underperforming software can cost more than lost sales. In this case, it got them into $155 million worth of legal troubleListen now
June 21, 2017
Cassandra Leung and Pete Walen join us today in a discussion about Requirements. What are they? Do we get enough of them? Do we understand the ones we do get? Can we make them better, and if so, how can we help that process? If you’ve ever struggled with trying to make sense of a story, or fear that programmers are just implementing things for the sake of implementing them, and there’s no rhyme or reason, you may not be alone. It’s possible that you really are dealing with a severe case of Requirements Deficiency. Fortunately, we are here to help, or at the very least, give it a spirited try.
Also, in the news, Unified Windows Platform and Software Verification Competition. Yes, apparently, these are both “things”, and we pontificate on both of them.Listen now
June 7, 2017
For many testers, Selenium is a well known tool and a familiar friend. For others, it may be something you are curious about but haven’t had a chance to do much with yet. All of our panel has had some level of experience with Selenium, and Brian Van Stone visits us again to tell us what he’s been up to and how his Adventures with Selenium have informed his automation processes and overall testing.
Also on the Selenium and testing tools front, what is up with the VC community making big bets on software testing tools? Is it Silicon Valley business as usual, or is there something else going on here? We investigate, or pontificate, or at least we offer an opinion or four.Listen now
May 24, 2017
This week we are joined by Kim Knup, who is with Songkick and tells us a tale of intrigue and guile, and the behavior of concert attendees. Wait, what? OK, not quite that juicy, but she does work with Songkick, she does test and monitor performance, and it turns out that different audiences and different fans of different performers have distinctly different approaches to how the source and buy tickets through Songkick, and Kim shares some of those examples with us. Also, in our news segment, when Apple Support is down, do we care as much as when AWS is down? In other words, do we grade quality on a curve?Listen now
May 10, 2017
Sometimes, you can find experts on topics in unusual places. This week we discuss security and privacy with Doug Traser, an Information Security Manager with Five9. He’s also the guitar player for Michael’s band, Ensign Red (or is Michael Doug’s singer? We’re never entirely sure). Regardless, if you have questions about security, OWASP, polities that drive you crazy and wondering if any of this makes any sense, Doug has some answers, and maybe raises a few more questions.
Also, in our news segment: what happens when Amazon Echo might hold the key to a murder trial. Can your personal digital home assistant testify against you in a court of law?Listen now
April 26, 2017
Have you found yourself looking at deals and services online that seem too good to be true? Wondering “where’s the catch?” You’re not alone. There are lots of ways that software uses and manipulates us to give up details about ourselves, or to somehow get us to pay for services that we either didn’t want, or to provide information about ourselves and our habits to others that we don’t really want to be known. These practices are grouped together under the phrase ‘Dark Patterns” and Emma Keaveny has made it a point to learn about and warn about them. We discuss several varieties of Dark Patterns and debate where on the spectrum they fall, whether they be nuisances, poor design or an outright breach of ethics.
Also, where were you when Amazon’s E3 services went down on February 28, 2017? Did it affect you? It affected some of us, and at the time we recorded this episode it was a very fresh memory, so we had plenty to say about it.Listen now
April 13, 2017
How well do we know the work that we do as testers? Do we understand what it is we do? Really understand it? Jon Bach thinks we can do better at figuring out what it is that we do in our roles as testers and in the roles that support and offer service to people in our organizations. Much of what we do is implicit, and carries responsibilities, expectations and even contracts for what we do and how we act. In today’s episode, Jon helps us break down both traditional and not so traditional roles that we may find ourselves in, and ways that we can leverage both explicit and implicit knowledge of what we do, and maybe what we can stop doing.
Also, in an unconventional news segment this go around, friend of the show Anna Royzman tells us about Test Masters Academy and a fresh take on testing conferences geared towards testing leaders (the Testing Leadership Conference is May 1-3, 2017 in New York City) and emerging topics and technologies at the New Testing Conference coming this fall to New York City). It’s a wild ride!Listen now
March 29, 2017
Have you been to a testing conference? Wanted to go? Wondered which ones you should attend? Matt Heusser, Jessica Ingrassellino, and Michael Larsen have been to more than a few as participants and presenters. We discuss our favorites, the pros and cons of various conferences, and what makes each of them worthy destinations to consider.
Also, putting a different spin on the News Segment this time around, Michael shares his enthusiasm for and about “The Privacy Paradox”.Listen now
March 15, 2017
The truth is, no one will care as much or be as interested in your developing testing career as you are. There are studies that say that Software Testing is one of the Happiest Jobs there is. Does that sound weird, or does that sound spot on? In this episode of “The Testing Show” we welcome back Alex Schladebeck and welcome for the first time QualiTest’s Elle Gee to discuss software testing careers and how they differ or are similar depending on the organization in question. Regulars Perze Ababa and Justin Rohrman also riff along with Matt Heusser on the unique challenges in developing and sustaining a career in software testing.
Also, in our news segment, what happens when Automation and a software glitch makes it impossible to do a task we often take for granted? 900 Shell stations in Malaysia discovered exactly that, and we certainly have opinions about that, too.Listen now
March 1, 2017
This is Part Two of our discussion with Alex Schladebeck and Joel Montvelisky. We tackle regression testing and share a few stories from the trenches (and a ghostly Michael even makes a contribution to this topic), discuss the idea that perhaps continuous testing is a concept that’s time really has come, and look to see if we can possibly break out of the “hardening” process at the end of sprints in favor of more testing up front, so that discoveries can actually be addressed sooner rather than pushed off to later.Listen now
February 15, 2017
It seems that 2017 is shaping up to be the year of the two-parter, as we are back with another two part episode. This is Part One, in which the Testing Show regulars chat with Alex Schladebeck and Joel Montvelisky about the way that testing is practiced globally. Joel has some insights on this in that he steers the State of Testing Questionnaire that runs in January and February each year, and gathers statistics about how testers actually work. We look at some issues that were discovered with the survey, such as how many organizations claim to do automation versus how many actually are making a solid go at it, as well as where those organizations choose to, or choose not to, apply their efforts. Also, in the news, what happens when TSA’s computers go out on one of the busiest travel days of the year (the day after New Years)? The Testing Show panel and their guest weigh in, and they have plenty to say, both on the outage and the process in general.Listen now
February 2, 2017
We continue our conversation with Angie Jones about ways that automation can be put first in stories (yes, really) and ways that she has been able to get team buy in and cooperation to make that process effective. Also, we have a mailbag question that we answer in depth, or as much as we can… is it possible to be paid as much as a developer or an SDET if you are just a manual tester? The answer is “it depends”, but we go into a lot more about why that is the case.Listen now
January 19, 2017
The Testing Show: Automation and Defining “Done” (Part 1)
Have you wondered how your team could better utilize its automation resources? Does your definition of “Done” include new automation efforts for stories that are in flight? How about when changes to functionality (or new additions) cause your old tests to stop working? Do we play continuous catch up, or is there a better way to applying automation efforts?
Angie Jones of Lexus Nexus joins us to talk about better ways to have those automation discussions, who should be responsible for what, and how everyone on the team can contribute to automation efforts (hint, you don’t need to be a coder to help make great automation, but it certainly helps).
Also, this week we delve into Spotify taking over hard drives with continuous writes that could shave years off of their operation life, and are Uber’s autonomous vehicles even close to ready for prime time?
This is part one of a two part series. Come back in two weeks when we continue our conversation with Angie.Listen now
January 5, 2017
It’s a new year, and it’s that classic time for people to make New Year’s Resolutions, as well as quickly run out of steam trying to actually succeed at them. We discuss ways in which we have set goals, or not set them, how we have been stymied in the past, or how we have pushed on regardless of failing, and the fact that failing is often the key element that helps us progress and ultimately succeed.
Also, in the news, we look back on the fifth anniversary of the death of Christopher Hitchens, how a typo may well have been the root cause of “The Russian Hack” regarding the U.S. Presidential election, and will all exploratory testers be replaced in five years by AI, neural networks and machine learning? We have opinions on all of those.Listen now
December 21, 2016
As we come to the end of 2016, we consider ways that software testing can go beyond just testing products, and looking at ways that we can use our super powers for good in the world. Abby Bangser works with ThoughtWorks and ThoughtWorks makes this a core part of their mission with ThoughtWorks University, a combination of training and integration of all roles, including software testing, as they learn how to work with ThoughtWorks model. Additionally, they take on a variety of projects that focus on social and economic justice, bringing groups of people from all over the world to Pune, India to research and work on a specific problem to help those in the immediate area and beyond.
Also, are you getting a lot of Skype spam lately? You are definitely not alone. We talk about what’s causing it and how to fix it.Listen now
December 7, 2016
For centuries, the Liberal Arts education was the gold standard that all education endeavors were based. The idea of a ‘Renaissance Person” was someone who had skills and abilities in a variety of fields, grew out of the classic Liberal Arts education. Some say that it’s a bygone piece of history, but many feel that it is a vital part of working and interacting with people, and in many ways, it’s perhaps the most vital of underpinnings for success as a software tester. We welcome back Jess Ingrassellino to talk with us about the value of a classic Liberal Arts education ,how it can be applied effectively to a software testing career, and how those who are so focused on automating as the be all and end all might be missing a few things.
Also, we take a look at the growth of online testing conferences, the UK National Health Service Email bomb and Virtual Studio for Mac… wait, what?!!Listen now
November 23, 2016
Accessibility and Inclusive Design are two approaches to help make software available to the broadest possible group of people. Today, we welcome Alicia Jarvis, a Toronto based Accessibility advocate, to discuss her own Accessibility advocacy, her experiences in software testing around accessibility, and how we need to look beyond a checklist for compliance, and think about Accessibility as a core part of our design approach from the beginning. Also: Samsung seems to be having issues with exploding batteries, both with the Note 7 and the Galaxy J5.Listen now
November 9, 2016
This week, we are joined by Jess Ingrassellino and Garry Heon to talk about where testing is going, and what the future of testing holds, going beyond Agile and dev-ops, or at least seeing where and how testers today will better be able to work and thrive in this brave new world. In the process of talking about that, we joked about the idea of a “full stack tester” to go with the increasing demand of “full stack developers”. Is there such a thing as a full stack tester? We weren’t sure, but if there was, we figured we could relate to the idea, and we’d be interested in seeing that idea develop, so to speak.
Also, we discuss the ramifications of what happens when your Web Cam takes part in one of the biggest DDoS attacks ever (hint, it’s easier and more likely than you might believe).Listen now
October 26, 2016
Do you have to be a career tester to perform the testing role? If you are facilitating, coaching or leading others, are you testing? Does it really matter who does the role, as long as somebody does it? The Testing Show is back in the studio and chatting with Qualitest’s Yaron Kottler on exactly these weighty questions. Needless to say, we discussed these ideas of “what makes a tester a tester” and then some. Also, the panel shares their frustrations with the recent Apple updates of iOS10.1 and macOS Sierra.Listen now
October 17, 2016
What happens when software development takes a cue from disciplines like law enforcement, counter intelligence and military operations? What do we do when we need to look at complex systems to find clues about issues that we didn’t even know existed, but the data shows it plainly? How can we harness the gut feelings of testers in a more scientific manner, and “make sense by sense making”? Confused? Dave Snowden wants to help with that.
Dave Snowden is the creator of Cynefin Framework, and it has been used with a broad array of applications, including government, immigration, counter-intelligence and software development. Cynefin is making inroads into the world of software testing, and Anna Royzman is possibly the person in the testing community most familiar with the Cynefin Framework. We are happy to have a conversation about Cynefin with both Dave and Anna, and its implications on software testing.
[Note: Due to challenges with Trans-Atlantic communications, the audio breaks up in various places. We have done our best to work around this, but there are places where audio will be spotty.]Listen now
September 28, 2016
This time around, The Testing Show is coming to you “Live” from the Conference for the Association for Software Testing, held in Vancouver, B.C., Canada. Matthew Heusser, Justin Rohrman, and Perze Ababa met up with Michael Bolton to discuss “Testopsies”, a focused examination and task analysis, and applying it to the opportunities for learning and refocusing of efforts often bundled under the label of “testing”.Listen now
September 14, 2016
Noah Sussman knows a bit about bringing Dev-Ops to fruition at a variety of organizations. To that end, we asked him to come join us and tell us a bit about what Dev-Ops is, and what it isn’t. We also discuss the ways that testers can develop their skills and become more technical (hint: it’s not as difficult as many may think, but it will require work and interaction with others to really be successful at it).
Also, how does Bing Maps manage to put Melbourne, Australia in the Ocean somewhere near Japan?Listen now
August 31, 2016
It’s another “On the Road” episode of The Testing Show, with Matt Heusser attending Agile2016 in Atlanta, Georgia. While there, he gathered an impromptu forum to discuss the way we work and what we often have to do so we can get to the work we actually want to be doing. Emma Armstrong, Dan Ashby, Claire Moss and Tim Ottinger join in to dissect the continuum that is “Real Work vs. Bureaucratic Silliness”.Listen now
August 17, 2016
If you were going to be at liberty to drop into any software testing job you wanted, anywhere, in any software related industry of your choosing, what would be part of your “jump kit”? The Testing Show sits down with Curtis Pettit (of Huge) and asks exactly that. We geek out on favorite tools, and quickly discover that we all have some perennial favorites, but we discuss some lesser known exotics as well, really just scratching the surface of possible tools.
Also, have we reached a point where, when systems go down for Airlines and Credit Card companies, that we are helpless to go back and do business as we used to do, at least if we are in so called “technically advanced” areas? Perhaps the rugged backcountry may have a thing or two still to teach us all.Listen now
August 3, 2016
This week, we are joined by Dan Billing, a software security penetration test specialist at New Voice Media in the U.K.. Dan describes his path from everyday software tester to security expert, and the variety of approaches and methods, as well as tools, that come into play if you want to take a crack at being a software tester with a specialty towards security testing.
Also, can thirty years of fMRI results really be invalid, and what are you doing to take on the “30 Days of Software Testing” challenge?
July 21, 2016
Today, we are joined by Alan Page of Microsoft to discuss the Unified Engineering model, what that means, how it is working at Microsoft, and how that might effect software testing and software testers going forward. Also, what happens when the Air Force has a database crash and can’t recover their data, and is the Testing community really anti automation?Listen now
July 6, 2016
What does it take to differentiate yourself as a tester? How can you demonstrate the unique values and attributes you can bring to the role of tester? How can you push back against the race to the bottom where “everyone can do the job”? Is that really true? These questions and more we posed to Andy Tinkham, and shared ideas as to how we can bring much more to the table that we often think we can.
Also, can software be specified in such a way that it can actually be made error free? Justin had a chance to look at that very idea at the DeepSpec Workshop at Princeton University, and he shared his findings with us.Listen now
June 22, 2016
Recorded live from Orcas Island, Washington, Matt, Justin and Perze attended the Reinventing Testers training run by James and Jon Bach. James sat down and talked with The Testing Show about reinventing testing skills, developing them, and the importance of words.Listen now
June 8, 2016
We all know that what we measure is something we can improve, right? We can measure anything and everything, and way too often, organizations attempt to do exactly that. The net result is we measure stuff that is not important to try to inform us of things that absolutely are. Mike Lyles joins us for a spirited talk about measurement and metrics. We can’t escape metrics completely, but we can be a lot smarter about the metrics we do use.
Also, how would you feel if your software update destroyed the product you were working on? What if it was a multi-million dollar satellite? Yep, that happened, and The Testing Show panel gets into it!Listen now
May 25, 2016
From the idea of automated trucking to the notion that testing will all be automated “at some point in time”, we thought it would make sense to bring in someone who has been part of this challenge for many years. Paul Grizzaffi joins us to give us his take on the promise of automation, the realities of tooling that go into those processes, and what the future might hold for the testing role as well as the possibility of “automated everything”.Listen now
May 11, 2016
As part of a follow on to the “Making Testing Strategic” discussion that happened at QA or the Highway, Jared Small joins us to talk about ways that software testing can add value to the software development process, and ways that we can extend the strategy conversation and help make sure that we can be both helpful and impactful to the organization.
Additionally, we talk about the idea that Scrum can get us 250% better quality (by some definition) and the persuasion of Trump, though we promise, this not a political show.Listen now
April 28, 2016
This week, Matt takes The Testing Show on the road, or more specifically, the Highway. At QA or the Highway held in Columbus, OH, in March 2016, Matt was a panelist for a discussion on Making QA Strategic.
This is a live recording from that event. From testing and its place within an organization, How does testing fit into an overall IT strategy?
Josh Assad, Kevin Malley, Jared Small, Diana Wendruff, Erik Davis and Matthew Heusser tackle that primary question of Should software testing have a seat at the strategic table?Listen now
April 13, 2016
In this episode, The Testing Show talks about auto makers stepping back from the robots and giving human beings a reconsideration. Do humans suffer a skill loss when automation is too heavily relied upon?
Maybe adaptability is important after all. We are also joined by Kate Falanga of Huge, Inc. to discuss Test Management, the changing role of test mentorship in the testing team, and if there is a value to having a dedicated person to be a guide, mentor and potential BS diverter, and what happens when that person goes away?Listen now
March 30, 2016
In this episode, recorded February 10, 2016, The Testing Show talks Super Bowl aftermath, analytics in sports and how accurate they are (or not), expectations and wild guesses, and the benefits of having a beginner’s mind to a situation and how that may give a person a better chance at seeing how things will turn out (it also shows pretty clearly who on the panel actually pays attention to football). We talk a bit about legacy systems and what happens when critical systems go down (the IRS being a prime example), and the fact that organizations with legacy apps are reorganizing around Scrum and Agile, not so much for new software development, but to help maintain and continue development on legacy systems. Can we do better? We think “yes”!Listen now
February 5, 2016
In this episode, The Testing Show crew takes a trip to New York City to participate in James Bach’s presentation to the NYC Testers Meetup. We discuss a bit about the GitHub site outage, and the ramifications of inevitable downtime. This leads into the main topic, which is “what do we do when we don’t have enough testers?” Is testing really a bottleneck, or is it set up in a way that delays are inevitable? What can we as organizations, and as testers, do to mitigate these issues, and what means do we have to change the process?Listen now
January 26, 2016
In this episode, The Testing Show crew is joined by Yaron Kottler, QualiTest’s US CEO. We discuss the changes sat Yahoo and the elimination of most dedicated software testers, how this change is happening in a variety of companies, and what these changes actually mean for the dedicated testing role, and what may happen in the future. We discuss the idea of software testing as a trusted advisor to an organization, and the benefits of wham that role works, as well as the frustrations and costs when that role does not work.Listen now
January 22, 2016
In this episode The Testing Show tackles the NEST Thermostat, early release of inmates in Washington state due to a computer error, and what can we do when our password site gets hacked? These examples help set up the main topic, which is “how can we develop the needed skills so that quality testing can occur in our organizations?” We discuss test design, bug advocacy, long term auditions, and think about how robots can help you see the way software testers pivot (or not).Listen now