How to set up a UAT
User Acceptance Testing (UAT) is one of the most important tests companies need to perform before launching a website or product. Especially if they are developing websites or digital products for clients in their daily business like agencies do.
Not doing it, can cost thousands of dollars if you want to fix a bug right before going live. It is estimated that software bugs cost the worldwide economy 1.1 trillion US$ in 2016 (and it’s way higher in 2021).
Properly doing website user acceptance testing costs only a fraction of fixing bugs in a production system.
We created this guide based on what we have learned talking to some of our almost 1,000 customers. It shows you how an agency, named SuperHQ-Agency, saves money by successfully implementing User Acceptance Testing and hopefully you can use some of these learnings too.
You will learn how to set one up, as well as how to improve it and save a lot of human resources (aka money in your pocket) thanks to easier and more efficient web application testing methods.
So here we go:
In a nutshell: it saves you money.
Take SuperHQ-Agency, for example.
They’ve been hired by a big, well-known company to develop a website for them. SuperHQ-Agency wants to make this big client successful and to do so, they’ll have to think about getting the experience of their customers right.
That’s where user acceptance testing comes in; SuperHQ-Agency will put the website, they’ve developed, through rigorous testing. This testing is necessary before handing it over to their big client, making sure that everyone will be satisfied… the company’s customers included.
Which makes sense, because any website or digital product will be used by customers of the agency’s clients. But if they aren’t able to use it in the way it works for them, then they search for alternatives and bring their money to a competitor instead. #FAIL
Thus SuperHQ has implemented the so-called Shift Left Testing approach. “Test earlier and often.” User acceptance testing must not only happen at the end of the project but throughout it. The earlier you start your testing, the less money you lose.
Another user acceptance testing example, IBM estimates that if a bug costs $100 to fix in Gathering Requirements phase, it would be $1,500 in QA testing phase and $10,000 once in Production.
This is why user acceptance testing is so important for SuperHQ and for your agency.
UAT should be placed at the end of the product development process after the development team has done quality assurance. For SuperHQ-Agency, excitement is high as they have finally concluded the development of their client’s desired website.
QA has also been completed to weed out any preliminary bugs, so now they’re ready to perform user acceptance testing to find out how well this new website of theirs works in actual real-world environments.
You get most out of UAT if you follow these steps.
It’s not just presenting this website project to the testers! Here’s the breakdown of steps for a successful user acceptance test:
As mentioned earlier, successful testing needs some prerequisites. One of them is using separated technical environments (for example servers with your website/software installed on it) for development, testing (UAT) and production. Otherwise, nobody can guarantee that there aren’t any changes happening while testing is in full motion.
Testers also need the appropriate hardware—such as laptops & smartphones—to test your web project accordingly.
To understand the requirements defined by the customer, all business requirement documentation must be used to define the purpose, scope, and functionality of this project. Use this customer understanding of the project requirements to develop your UAT plan.
First, you have to define the main parameters of the user acceptance test:
After this step, you can begin planning test scenarios and test cases.
As mentioned before, you shouldn’t just place your testers in front of your website project or digital product but rather develop specific test cases for your testers to accomplish, as well as the assisting material while they are testing.
You should develop these test scenarios and cases as you would your onboarding process for your end customers. This will help your testers test your project in a real-world scenario.
Test cases should be defined in a way that they know what to test and can be repeated accordingly.
Here is an example sheet of how one sample test case can look like:
You will need test data for your test cases. Set up a process that allows you to collect and prepare test data effectively. Keep in mind that your test data might include confidential information and this data must be secured (remember that GDPR in European countries might limit your possibilities of using test data with personal information).
In preparation for the user acceptance testing, it should be clear how testers can create issues, which information (and data) they have to provide in an issue/ticket, and how the issue will be fixed.
Define various labels (bugs, feature requests, usability, etc.) and states for your issues to organize them easily. Remember: the triage problem can bury you!
Write down how the communication between your developers, testing team and other stakeholders involved should take place while testing.
Doing this prevents your team from the nightmare of receiving Word documents, emails, spreadsheets, megabyte-sized screenshots, and endless discussions and emotions via email and other communication channels.
You can waste a ton of valuable resources when you’re using the wrong issue tracking system. Inefficiencies in the way you handle bug tracking and fixing can turn profitable projects into money-losing pit holes.
So choose your issue tracking system wisely. Maybe you already have JIRA software in place, Asana or a similar tool. That’s good. You should still invest some time in implementing your defined testing processes into your issue tracking tools.
Usersnap is a visual bug tracking tool which gives your testers the ability to show issues, not just tell your developers about them.
This tool creates a screenshot and helps visualize any issues arising during testing. It can be easily integrated by copying a Javascript code into your website or digital product. Then it’s set up and ready to go.
With this extension of your current testing environment, you will save a lot of your resources as it removes the back-and-forth between developers and testers who are communicating with each other about the bug.
Usersnap can be integrated within minutes with well-known issue trackers like JIRA, Asana, Basecamp, Trello, Redmine… Keep your existing issue tracker and just boost it!
When it comes to launching new website projects or new digital products, there are a lot of tests involved, such as:
Don’t forget to do them before your User Acceptance Testing.
Once you’ve finished the preparations for the tests, then you’re ready to run the tests.
During the acceptance test, your QA team or testers complete the defined test cases from the UAT plan. As soon as they’re finished with all test cases, you can do a feedback survey to get an impression of their experience during the testing process.
Most people want things to be easy. When Usersnap Classic is used in the acceptance test process, it helps make QA easier and smoother.
Why? Because you need a simple way for your testers to communicate and send an issue. With no need for explanations or training, your tester to submit a new bug report shortens the testing process, saving valuable resources from your developer team.
Usersnap Classic is implemented in minutes with a code snippet for any digital product or website and it offers a small feedback widget to capture (video or text) feedback from your testers or your client’s testers.
Testers create screenshots of the current issue they are experiencing, and then they can add comments or draw on the screenshot with any additional extension (like a Chrome extension, for instance).
Usersnap will automatically add important metadata like browser type, browser version, screen resolution, device, URL of the page and location of the user. Your developers will have more time for testing as they can leave out the time-consuming back-and-forth that happens when asking this information from users.
“A really great feature of Usersnap is that it automatically captures the used browser, URL, and screen size for each Snapshot”
Bobby King, The White Label Agency
The error reports from the console log of the browser, where JavaScript errors are logged, are automatically sent with the bug report.
Want to see Usersnap Classic in action – watch this short video
The email of the tester will be added to the submission form and a message box for further explanations. Testers can also label issues.
As soon as the visual bug report is generated in the Usersnap issue tracker, it can be forwarded to 20+ integrated tools. Usersnap also allows you to manage issues and ask your testers questions, thus keeping your main issue-tracking system clean from unnecessary bug reports.
This optimized testing and quality assurance method can be used in User Acceptance Tests, design testing—conducted by designers to confirm the initial design concept—and usability testing.
In case your testers are experiencing major issues while proceeding with the UAT, you should stop the test and fix the issues before continuing.
The objective of acceptance testing is to validate that all business requirements are implemented and are working correctly.
Remember to hand over written documentation of your successful tests to your client. If your client was active in the User Acceptance Testing, make sure you have a confirmed and signed UAT test document at the end.
After a successful User Acceptance Test, your testing process should include two additional tests that are essential for a sustainable web project.
Load Testing and performance Testing check how fast your websites or web applications respond and whether they are tolerating many concurrent requests (load test). Several tools are available for these testing mechanisms.
Security testing is a hot topic and often does not get enough attention. Hacks and data leaks can harm not only your brand but your financial resources too, as getting sued after your websites or web applications were found to be vulnerable will undoubtedly be a painful expense. When it comes to security testing, do your best to be thorough and try not to skimp resources.
This guide helps you set up User Acceptance Testing as an agency or similar organization. Defining a testing process will increase the quality of your outcomes and reduce the amount of negative feedback from your clients. It will make your customers happier and is a fundamental basis for a long-term relationship.
Remember SuperHQ-Agency from earlier? They’re enjoying all the benefits of Usersnap Classic, and their big, well-known client couldn’t be happier with the results of their user acceptance-tested website. Needless to say, they’ll be partnering up again for future projects.
Learn from SuperHQ-Agency and discover how Usersnap Classic can help you enhance your Acceptance Testing and free up valuable time for your development team!
If you want to give it a try, you can either click the button on the bottom right (yes, just try it) or get started with Usersnap and deliver what users want. You can collect your first 20 feedback items for free, and then you can upgrade to continue acting on the insights.
Ever wonder how some companies make product updates feel like the highlight of your day? …
Picture this: You’re in the middle of a hectic workday, balancing strategic decisions with daily…
Ever wish customer feedback came with subtitles? With the right feedback analytics tools, you can…
Survey design is the backbone of effective data collection, enabling businesses, product managers and researchers…
Wondering how to master Jira’s vast capabilities for strategic project/product success? Epics are the key…
In this article, we walk you through the ultimate in-app feedback how to strategy, including…