Two functions on one interface. PeACE performance testing and evaluation platform makes it possible to perform both activities together.
The automation-supported PeACE (Performance Test & Monitoring Platform) tool developed for performance testing and evaluation meets the performance testing needs of all companies with complex IT systems. The platform with complex functions (after a quick learning phase) can also be generally used in an inhomogeneous corporate environment.
Main Tasks of Automated Performance Tests
- Performance test scope analysis
- Obtaining test data
- Writing test code for business/technical functions
- Definition of environments, controllers, test data generator rules, data collection
- Design test cycles to control test executions
- Testing test software and configurations
- Defining and executing tests
- Online result monitoring
- Creating reports
The results are easy to access in a well-prepared test project, and the working processes can be effectively supported through the graphical user interfaces.
After the initial success, you need realistic goals and good plans to achieve measureable progress, the continuous expansion and improvement of the test suite will bring tangible results day-by-day. You can build a working and suitable test suite in a short time.
Combining the ever increasing and reusable test components will make automated testing of complex business processes possible.
Solution to the Challenge of Writing Performance Test Code
Almost no two performance measurement projects are the same, each one is different. Effective testing of business processes requires fast execution and special expertise, because the components under test operate with different technologies. PeACE can generalize different performance measurement projects using templates and modularizations. With its help, the end user can parameterize and run various performance tests without any developer knowledge.
When developing our solution we focused on creating a test suite that doesn’t require extensive knowledge about the technological details, and makes conceptualising a test task as easy as possible.
As our partners have already seen, the roles can be separated, there is no need for a high level of technical knowledge, and the method for creating tests can be easily learned even without IT qualifications.
Solution to the Challenge of Test Execution
There are many test executions, the configuration, environment, test data, test scope and data collection can be different. In order to achieve high throughput, it is important that the test execution requires minimal preparation and that the result gives the developers a quick answer. Using PeACE, users can choose from different test executions, thus ensuring flexible configuration and easy parameterization.
With our ACE toolkit, the testers don’t have to drown in the technical details of the applications, and their role is limited to creating the test plan and the logical operations of the test cases.
This way they only have to know the business functions and processes of the applications to be tested, the tool provides a unified interface for creating tests for any application.
The actual business processes are often realised through the interaction between applications or by performing the partial processes in a certain order. By using a unified testing platform, you can perform integrated tests to verify every step of the business processes spanning different systems.
Solution to the Challenge of Evaluation & Monitoring
Users like easy-to-understand, parameterizable charts. PeACE enables online monitoring of performance measurement, reconfiguration of dashboards and simple KPIs. With its help, diagrams and various test executions can be easily parameterized. PeACE supports simple and quick reporting of frequent executions.
To follow the changes in the application to be tested, the work required for maintaining the existing tests and for creating new tests, usually changes in correlation with the size of the suite (besides the number of changes).
To support the maintenance tasks transparency, readability, searchability and the comparability of the different versions must be ensured.
The ACE toolkit, as a real enterprise technology, includes the services and capabilities to support the maintenance tasks. Test data and test code is managed separately, the test components are reusable and embeddable, the state of the test code is version-tracked and traceable by user.
The test code management is supported by built-in impact analysis supporting functions, and different labelling, filtering and search functions.
PeACE Operation in Practice
- Online dashboard
- User-defined dynamic parameterization
- Test execution
- Environmental control
SLA support can be tailored to the requirements of the client, based on the service levels we can guarantee the solution of our clients’ problems within a few hours.
Our direct troubleshooting service guarantees the correct operation, we don’t outsource the problems of our clients, we solve them.
Services Supporting The Product Use
We support the use of our performance testing and evaluation platform with a number of additional services that make it easier for all our customers to use the tool.
“ProofIT works with us in the automated testing field with a highly trained expert staff, innovative solutions, they are flexible and possess the required technical expertise.”
Deputy Executive Manager @ IdomSoft
Frequently Asked Questions
What do you mean when talking about having well prepared test project and selecting a fitting goal?
As with any project, performance testing can only work properly and deliver dependable and predictable results, if the proper prerequisites are guaranteed and the work is carefully prepared. Preparing the performance testing usually includes meeting the following conditions:
- correctly selected toolkit (just like PeACE),
- staff prepared for the use of the tool,
- prepared environment (test laboratory and application test instance),
- test cases, test scenarios are designed with verification conditions,
- knowledge about the use or creation of test tasks,
- (the knowledge of the business rules of application logic can be helpful).
Selecting the correct goals contributes to the success of a well prepared project, we recommend taking into account the following:
- Select those processes and functions for automation that are frequently tested. For the quickest return on the invested work replace as many of the existing tasks as possible.
- The execution of a process or function also includes its preparation. When selecting the tasks, take into account how you can ensure that the prerequisites are met (navigation, test data, application state).
- The coverage goals are an integral part of rating the test suite (how many and what kind of tests are required for reaching the desired results).
Here are a few more things to take into account when planning:
- Don’t forget that the automated test must include an appropriate number of testing conditions, otherwise only the process automation will be valid, and not the test results.
- We design the test suites for the version of the application that is current when creating the test suite. Avoid the testing of development instances, work on a separate test instance, with controlled version tracking. Follow the changes of the test instance with the planned maintenance processes.
- Carefully determine the conditions of the automatic evaluation, “false negative” and “false positive” values are misleading, and can severely compromise the success of the testing.
- You have to regularly run and evaluate the test suite to keep it up-to-date and operational. The project must also include the running and verification of the tests. Only a correct test instance can provide real validation, sadly test can also contain bugs, these must be found and corrected.
This list could go on and on, but this will be enough for this Q and A format. We are happy to answer any further questions, and we hope we can welcome you as one of our clients soon.
What kind of skills do one need to learn the test automation without any preliminary IT training or experience?
If we were looking for employees, we would post a job advertisement like this:
“We are looking for performance testing workers. The ideal applicant is a good learner, able to work individually, can solve problems quickly, happy to work in a team, performs their tasks precisely and carefully, and likes to solve logic problems. A higher education qualification is an advantage.”
IT qualification is naturally advantageous, but it’s not a required. Our clients have successfully assembled performance testing teams from non-IT personnel.
Why is reusability important?
All applications are built on easy to identify patterns, and their parts contain a lot of similarities. Well thought out tests created for the testing of the application follow the identified patterns.
With an appropriate level of granularity, there is no need to implement the recurring test codes again and again, you can use them in different cases, so these become reusable.
You can build new test logic from existing components that are built from already well tested and properly working parts.
Reusability improves effectiveness, helps to ensure maintainability and transparency, and produces an easier to read test code.
What is the advantage of separating the roles?
The verification of the correct operation based on the business rules and specifications is a complex task. The business, testing and test methodology knowledge necessary for creating well working automated tests and to create the test code the personnel must acquire the knowledge and practice connected to the tools, even the correct evaluation of the executed tests and the utilization of the results requires knowledge and experience.
For effective and successful performance testing all the required knowledge shouldn’t be the sole responsibility of a single person, the system must allow for separating the tasks when working as a team and it must be able to assign different roles.
Business knowledge is usually possessed by the most expensive and rarest of personnel, the business experts. In many cases they are also responsible for testing the applications, so the extent of the testing is limited by how much time and effort these persons can direct to the task.
Test specification must of course include business knowledge, but the creation of the performance tests can be carried out by persons specialised for this task.
Therefore the most effective way to perform work split between separate roles based on the different working phases, to record the business plans, to prepare, design, create, implement and evaluate the tests is the teamwork with divided roles.
How can I gradually expand the test automation project to become acquainted with the benefits of new technologies?
As with all new methods, we recommend a smaller sample project (pilot) to learn more about the possibilities of performance testing. This allows the participants to gain the required confidence, before the various work phases become second nature.
We recommend the continuous measurement and evaluation of the progress, and detecting and eliminating any possible problems. We recommend taking into account the following general considerations when planning the sample project:
- learning the toolkit,
- reading and understanding the available documentation,
- creating a test plan,
- practicing the work processes, finalising the role assignment,
- creating implementation patterns (typical solutions for typical problems),
- creating and verifying the measurement method,
- evaluating the experiences, providing feedback.
Why is it important to hide the technical details of testing?
Technologies created for performance testing often offer solutions with coding access, with the promise that nothing is impossible, if you can access all technical capabilities of the solution.
Undoubtedly, this is one way to create performance tests. However in our experience, the subsequent maintenance of the test code is really difficult, the alignment of the test is slow and requires a lot of resources, and reimplementing the business logic into the tests carries with it a significant danger of “over-complicated coding”.
We, on the other hand, believe that testing is not the same as coding, this was also one of our main guiding principles when creating our product. Testing should not require technological knowledge, and the tested application should not have to be reimplemented.
This way performance testing remains on the test logic level, to create a test you only need a superficial knowledge of the technical details. A test suite built on these ideas will remain maintainable even with a large case number, can be operated for a long time, helps to create reusable components, and is easier to verify and modify.
Why is more and more work necessary to maintain the test suite?
As the tested application is continuously changed, expanded, transformed, the test suite created for its verification must also be fine-tuned to follow the changes. Business applications with many user functions and business processes have a long product cycle, where they receive a vast number of changes.
The number of elements in a test suite, used to test a wide range of functions of the application can increase to thousands or even to tens of thousands. This large amount of code can create a large number of maintenance tasks depending on the frequency of the changes, where based on the application’s lifecycle the tasks focus on the fine-tuning of the existing elements, and not on the performance testing of new functions.
Therefore when selecting a performance testing toolkit for your performance testing needs, you must take into account its capacity to support these maintenance tasks, not only its capability to create new tests.
What is the advantage of integrateability?
To maintain manageability, the corporations create their own specifications and rules from which they are reluctant, or completely unwilling to deviate, as this ensures their safety and operability.
Therefore specialised, hard to integrate applications would be expensive to maintain, and they could even violate the existing rules.
Integrateability ensures the smooth integration of new capabilities into the various enterprise platforms and environments, and that they can be connected to the existing workflows.
“We worked with ProofIT Ltd. as a sales partner. We believe that the ACE test automation system is good choice for businesses, our joint successes are the guarantee.”
Executive Director @ Fornax SI
Clients who have chosen PeACE performance testing & evaluation platform
Contact us with confidence!
Enter your name and email address and our colleagues will contact you, or call us on the phone number +44 20 3608 4425.