36
Performance Automation Cybersecurity QA Trends & Perspectives 2019 TestArmy QA Trendbook www.testarmy.com

TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

1 | TestArmy QA Trendbook — 2019 Trends

Performance

Automation

Cybersecurity

QA

Trends & Perspectives

2019

TestArmy QA Trendbook

www.testarmy.com

Page 2: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 2TestArmy QA Trendbook — 2019 Trends

About the report

The Token of Trust

Digital Transformation - a vessel of change in software quality assurance

Business-Driven Quality eXcellence - our answer to new challenges

Perspectives in Digital Assurance:

• Never-ending story of speed and quality - DevOps

• Automation trends

• Cybersecurity insights and trends

• Internet of Things - quality in a hyper-connected world

Complex TAG Offer

7 scopes of change in QA

TestArmy Group in numbers - our statistics

CyberForces - your partner in #cybersec & #infosec

04

05

07

10

14

29

30

33

36

Contents page

Page 3: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

3 | TestArmy QA Trendbook — 2019 Trends

Intro

3 | TestArmy QA Trendbook — 2019 Trends

Page 4: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 4TestArmy QA Trendbook — 2019 Trends

About the report

It’s been a great year for TestArmy. We’ve carried out over a hundred projects, developed a spin-off brand dedicated to cybersecurity - CyberForces - and worked with some of the best QA and Cybersecurity specialists.

It was a year of growth, both in revenue (+46%) and our team (over 20%). Our industry is not steady yet. Over the last 12 months we’ve seen some major changes in software development. With digital transformation going on, hackers working in more and more sophisticated ways, systems becoming more integrated and quality-driven fast-released solutions as a must be, companies have to adapt and adjust. Don’t worry, we’re here to help!

We’ve gathered our knowledge in the following book. It contains trends, predictions and possible ways of evolution in the fields of Quality Assurance and Cybersecurity. It includes such topics as new roles of QA specialist, Artificial Intelligence & Machine Learning, Business-driven Quality Excellence, Test Automation, Performance, Cyber Resilience, Internet of Things, Agile/DevOps workflow methodologies.

It would be impossible to fully discuss every one of the topics, as each would require a book of its own, hence we’re available for discussion and would love for you to contact us. In the following paragraphs, we’ve provided some useful tips and insights on what to keep on your radar and how we, as TestArmy, can help you achieve your goals in a modern, customer-driven, digital business world. Enjoy!

Damian Szczurek, CEO & Co-founder, TestArmy Group

Tester with years of experience and a mindset of an entrepreneur. He co-founded TestArmy in order to deliver top quality and seamless digital experience for users worldwide. Damian was a test engineer, then owned a small company with outsourced testers and currently he’s a CEO of top 3 test provider in Central Eastern Europe.

Page 5: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

5 | TestArmy QA Trendbook — 2019 Trends

The Token of Trust

We want to thank you so much for trusting us and sharing our enthusiasm for cooperation and turning the digital world in the right direction. We were able to scale and grow with your support, which probably means we’re doing our job right.

Your great reviews on Clutch.co (4.7/5 with 11 reviews) let us hold a place among their (along with The Manifest) list of top B2B companies on the software testing market. As we’re very proud that our professionalism, experience, skill and knowledge got appreciated, we’d like to quote some of the reviews that were particularly heart-warming.

No major bugs have slipped through TestArmy’s program into production. Their comprehensive defect tracking and constant communication have empowered them to investigate all possible technical issues with both iOS and Android apps. Their transparency sets them apart in the industry.

Sam Lepak, Head of Digital Marketing, Yachtlife

They’ll independently make suggestions on how we can change our approach and get better results. Their developer is fully integrated with the in-house development team, making it easy to coordinate work and stay on schedule. Thanks to their work, there haven’t been any major issues with the live product thus far.

Hattie Burt, Head of Projects, Resolver

After each test, a full report of the platform's vulnerabilities and strengths is given. TestArmy excels at setting clear dates for testing and retesting and is great at communicating their results. The team is knowledgeable and thoughtful, delivering the best possible service.

Piotr Sliwinski, CTO, Explain Everything

Wojciech Mróz, Co-founder & Board Member TestArmy Group

Entrepreneur and investor. The most important of his many businesses are TestArmy, CyberForces dedicated to cybersecurity and Testuj.pl, a software testing and tester training company. As a part of the consulting group alpha-capital.pl, Wojtek has helped over 300 small and medium firms to develop and scale, by creating a growth strategy or raising funds from the private and public sector.

Page 6: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

6 | TestArmy QA Trendbook — 2019 Trends

Big Picture - catching global QA changes

6 | TestArmy QA Trendbook — 2019 Trends

Page 7: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 7TestArmy QA Trendbook — 2019 Trends

Big Picture - catching global QA changes

Digital Transformation - a vessel of change in

software quality assurance

Digital transformation pushes organizations towards a profound evolution on both business and cultural level. Unlike previous industrial breakthroughs, this one is customer-centric, as the only true bosses in any organization are clients and users. Be it B2B, B2C or B2B2C, if the end-user needs and requirements aren’t met, the whole staff, including a CEO, can get fired.

In our increasingly interconnected reality full of emerging, exciting technologies, the ability to innovate becomes a critical factor for any kind of business. Being competitive means prioritizing customer satisfaction and user experience by delivering services and constantly increasing their quality in a complex and rapidly changing environment. Failing to achieve that, in most cases means increased and uncontrolled churn or simply being outperformed.

Quality Assurance transformation

Originally software testing as a part of a customer satisfaction process was meant to help to build a product with as few defects as possible. It was mostly done manually based on documentations such as test scenarios and test cases. Software testers basically served as gatekeepers, preventing a faulty product from going to the market or at least pinpointing minor and major issues.

QA in Agile

In order to quickly verify the business value of services, organizations need to release frequently. To be able to validate those, every release needs to be relatively stable. Finding defects simply isn’t enough. The major challenge nowadays is to prevent defects from occurring. That’s not all, as quality assurance experts also serve as business analysts, helping with crystallizing the value proposition, giving valuable input into development and growth. This is how a shift-left approach involves a quality assurance expert in each and every critical stage of the program.

DevOps - a Holy Grail of software development

In many cases, DevOps is an answer to a need for frequent releases in a fast-changing environment. With many controversies and varying opinions about that topic, it basically means cross-functional teams creating a hive mind. Quality Assurance is the heart of DevOps, building and maintaining a quality culture across a whole organization. Connecting and operating on many processes QA also serves as a source of metrics used as a base for constant improvement.

DevOps is not automation but it doesn’t exist without it

A huge part of such an approach requires a very high and sophisticated level of testing automation. Manual tester’s work based on documentation is a natural enemy of frequent release cycles. That is not to say manual testing is obsolete, it should just be limited by covering as many functionalities with automation and absolutely excluding dull and repetitive manual activities.

Digital Transformation

Page 8: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

8 | TestArmy QA Trendbook — 2019 Trends

Less than 20% of our customers are capable of releasing a new build on a weekly basis. When asked what was the percentage of their QA being automated the answer was 25% and in almost every case they know and understand the utter importance of improvement in that field.

There are many challenges organizations face when trying to implement automation in QA, from lack of resources such as test data and environment management, through insufficient skill sets to inability to choose the right tools.

Increasingly complex QA environment

When asked what factors posed the greatest difficulty in quality assurance, 71% of survey respondents cited numerous devices, operating systems and 66% pointed to highly-interconnected systems. There’s no getting away from it - testing is getting increasingly complex and the pressure of ensuring seamless interconnectivity is a big challenge for organizations. Half of the respondents stated that high complexity caused by increased technological combinations was a major challenge. Half of the respondents also felt that they had insufficient time to test new apps and services.

Right QA strategy embraces the promises and escapes the perils of digital transformation

To fully leverage the changes and opportunities of technologies and their constantly increasing impact on our society, organizations need to make the right choices as soon as possible. Such a profound transformation includes processes, competencies and models on each and every level of a business and organization functioning. One of the most important factors in that change is finding an effective and optimized approach to quality assurance.

Krzysztof Murzyn, Sales & Marketing Director

Responsible for business growth and product strategy. A successful digital transformation expert and consultant with management background and skills. Over 15 years of proven sales track record. Possess broad knowledge for e-commerce solution and platforms. Experienced in digital marketing and sales strategy. Oriented towards pragmatic business solutions with a solid sales background.

Continuous testing model

Digital Transformation

Page 9: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

9 | TestArmy QA Trendbook — 2019 Trends

BDQX

9 | TestArmy QA Trendbook — 2019 Trends

Page 10: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 10TestArmy QA Trendbook — 2019 Trends

BDQX

Business-Driven Quality eXcellence - our answer to

new challenges

Digital era has forced a variety of organizations to transform their products and services. They want to become more flexible and faster in introducing changes and new features of their products to accommodate to this new reality. The change impacts both the way products are designed, developed and released as well as how companies react to their customers’ feedback.

TestArmy, throughout over 7+ years and 500+ projects of experience, observes how that transformation comes along and where and when organisations are looking for a strong partnership to help them develop, maintain and improve high quality, regardless of their development cycle approach.

On the other hand, many of our clients continue to use waterfall approach and they are as successful with the outcomes as those who moved to work in an Agile/DevOps environments. We understand this choice as long as it stays aligned with their business goals and strategy and helps them bring seamless digital experience, thus we adapt our delivery to stay a reliable partner.

Pursuit of quality

Trying to find one good definition of quality, that would serve for everybody’s perception of what quality actually is, might be hard to achieve, if possible at all. Those various understandings come from different backgrounds, priorities and perspectives on how to provide service with the best possible quality. Hence assuring quality means different things, depending on the context.

Coming back to look at the digital transformation - response time is crucial. Customer nowadays not only becomes a receiver of our solutions but to a certain extent - a driver of our business. To be able to quickly

deliver, adjust and respond, organisations need to start thinking about their businesses as delivering experiences rather than pure products and services. They’d surely like to keep this experience consistent at the highest possible satisfaction level throughout the journey. In that context, quality would mean that your solution is predictable, reliable and easy-to-use for its purpose.

Is it still the case that whenever Q=constant we’re on a good path? Ultimately the business perspective with aims to provide users and customers with specific outcomes (results) is vital once it comes to defining the role of Quality Assurance as part of the business model.

Staying profitable in a long term is just not enough nowadays. More and more it is about winning the customers to become your advocates and extending their average lifetime. As a result, customer lifetime value becomes a crucial KPI.

Quality approach based on customers needs, internal policies and vision is integrated and holistic. Especially that the product life cycle has changed and once you’re on the wave of scale you have to win them all or you will lose your chance.

BDQX

Page 11: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

11 | TestArmy QA Trendbook — 2019 Trends

Achieving quality excellence

Here at TestArmy, we believe that when delivering a product or solution, the approach towards quality needs to be business-driven. Sure, it’s important to double-check that all the bits and pieces are technically correct, that they will survive a heavy load of users or requests and nobody can access sensible data. But what is the critical impact on the business with potential issues in these areas? Well that varies, depending on the business you are running, the solution you are delivering and the end-user base you are serving.

Businesses are beginning to test every aspect of their digital presence in order to ensure that their brand image and service offerings remain consistently qualitative. Whereas traditional testing was focused on making products with as few faults as possible, for digital business reporting there is a wider focus on customer experience and satisfaction. Testing departments looking at these areas of business are also expected to provide intelligence for business development and growth, not just report on past performance.

Early adopters(13.5%)

Early majority(34%)

Late majority(34%)

Laggards(16%)

Traditional technology adoption versus big-bang disruption

Big-bang segmentsRoger’s market segments

Vastmajority

Source: Big bang disruption, Accenture.com

BDQX

Page 12: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 12TestArmy QA Trendbook — 2019 Trends

TestArmy is here to help with BDQX

To accommodate that need, a modern, continuous testing approach is a key to success:

A holistic, broad approach towards quality as opposed to narrow testing, meaning starting as early as design phases and staying focused on quality also post-release

With above in mind, applying continuous testing with broad use of automation for tedious tasks that do not require creative thinking

Customer experience as the main goal to be satisfied - anticipated, measured and adjusted constantly.

QA performed by TestArmy follows that guidelines and eventually improves Enterprise Digital Transformation in a modern manner. Having a Business-Driven Quality eXcellence approach (BDQX) we are committed to:

Combining behavior-driven, exploratory and user scenario-based testing to understand end user interactions

Using testing to provide insight into assurance levels at every step of the customer journey

Moving from traditional testing phases to more continuous testing and quality to meet shorter deadlines

Adopting lean thinking to reduce time to market.

Łukasz Pietrucha, QA Director

QA specialist with more than 13 years of experience. His career path involves such professions as a QA engineer, Technical Project Manager, Scrum Master and even a translator. He’s a certified ISTQB trainer and consultant. Currently, he’s a QA Director in TestArmy and leads 50+ employees QA team, defines the product and builds strategic roadmaps.

1

1

2

2

3

3

4

BDQX

Page 13: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

We provide team and process augmentation for secure and functional software and digital products.

WE AIM FOR:

Digital assurance Cybersecurity Business-Driven quality

WE DELIVER QUALITY SUPPORT FOR:

THE GROUP:

TestArmy Group

Your partner in driving change in quality to deliver a seamless digital experience.

"Quality approach based on customers needs, internal policies and vision is integrated and holistic."

Łukasz Pietrucha, QA Director

Page 14: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

14 | TestArmy QA Trendbook — 2019 Trends

Perspectives in Digital Assurance

14 | TestArmy QA Trendbook — 2019 Trends

Page 15: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 15TestArmy QA Trendbook — 2019 Trends

Perspectives in Digital Assurance

Never-ending story of speed and quality - DevOps

Your customers know the problem but in most cases, they don’t know the right solution to that problem. You have to figure it out on your own. In order to grow, scale and stay ahead of the competition software companies innovate on business value and exquisite customer experience they deliver with their product.

“If I had asked people what they wanted, they would have said faster horses.” Henry Ford

Instead of being based on guessing, product strategy is data-driven with changes and new features or versions of them becoming experiments. Those experiments validate if the product performs better with the users and improves business metrics.

When a software development life cycle is divided into phases - plan, design, code, test, and release, the final result goes to market at the end of the cycle. If the cycle takes long there aren’t many chances for experimenting, let alone improving anything on the way. Also, when a project is divided into phases, each one involving different stakeholders, information and workflow bottlenecks are sometimes bound to occur.

Development and QA workflow bottleneck

The developers code a new change in one week and pass it to testers, who need another week to check if it works. After a week (during which the devs coded another change) testers found defects that require two weeks for developers to fix. So for the next week testers are going to be checking out a new change and in the meanwhile, devs are going to be halfway with bug fixing.

“Don’t get stuck in an infinite bug fixing loop. Allow yourself to make mistakes. learn from them and improve to grow.”

Łukasz Pietrucha, QA Director

Development and Operations information and workflow bottlenecks

The developers code new changes very fast and pass them to operations, who aren’t able to implement new builds to the existing infrastructure at a given timeline. Also, due to a division between development and operations when downtime occurs, it might take a long time to find out what’s causing it.

All hands on deck...

In the DevOps environment, software development is divided into short iterations, making the work more flexible and allowing changes to be made much more often. All stakeholders participate in the project:

Business leaders provide the knowledge and insight about KPIs and business critical functionalities of the software.

Project managers analyze and allocate resources, like people, tools and software. They also know how to create and assign tasks to developers.

Developers code the build. Within iterative software development, they can write automated unit tests to increase the code quality and limit the amount of testing that the build requires. Operations give input on how to best implement the build into existing infrastructure.

QA specialist focuses on accomplishing satisfying user experience within a time frame.

DevOps

Page 16: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

16 | TestArmy QA Trendbook — 2019 Trends

...working in unison

All the people mentioned above share information and cooperate. This way, in the end, they are able to understand each other and work in unison.

Business leaders see how the software is being designed and how resources are being allocated depending on the requirement. They are also aware which ideas are easier to build, implement, and integrate.

Development team has their say in the strategic planning of the product, not only in building it. Seeing the purpose and the value of their work as a whole they will feel more ownership over the projects. By working closely with a Quality Assurance specialist they will also be able to learn how to write their code to be easier to control and maintain so that if a defect is reported it will be faster for them to find and fix. Cooperating with operations they can deploy their applications and monitor the application and system health. Based on their work they will also have more control over a potential outage.

Operations, based on business requirements, have their say in planning and designing right at the beginning, giving input on the impact of the change, to existing infrastructure and potential maintenance issues.

Quality Assurance specialists can refer to business-critical needs to set the scope of ensuring quality and prioritize the efforts. They fill the gap between operations and development ensuring that the application runs smoothly after each build implementation. Detail-oriented mindset and experience allow QA specialists to prevent the defects from appearing rather than finding them. Quality assurance ensures that quality is taken up as a responsibility by both operations and development, thus helping to deliver the critical objectives of DevOps.

“DevOps setup requires QA to wear a bunch of different hats on a daily basis. Ops-QA becomes as much (if not more) important as Business-centered QA”

Łukasz Pietrucha, QA Directory

DevOps benefits everyone

With the adoption of DevOps, organizations are able to achieve frequent releases, delivering and measuring business value at the same time ensuring that a final product offers an excellent customer experience.

A complete iteration gets the whole team a feeling of achieving a small goal together. The satisfaction of everyone working on the project is increased, giving them a sense of fulfillment.

Brainstorms and frequent changes to the application or a system involve a lot of experimenting. Such an environment stimulates creativity and in turn, might lead to a situation in which the least expected person can come up with a brilliant idea about the next improvement, be it a new feature or a different approach to the process.

Gabriel Kamiński, Ardent Supporter of Testing & Agile/DevOps

A (not so) young (anymore) Padawan in the Business-Driven Quality eXcellence order. Enjoys binge-reading about different organizations’ approaches to QA on the road to going Agile or adopting DevOps. Personally, a huge fan of putting together Alan Watts’ and Jordan Peterson’s wisdom.

DevOps

Page 17: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

17 | TestArmy QA Trendbook — 2019 Trends

Automation trends

As our clients' interest in and awareness of test automation grow, it becomes a huge priority for TestArmy. We follow the latest trends and constantly develop new ways approaches and strategies. Below you'll find a list of insights that are particularly important to us, as we'll incorporate them into our field of expertise and our portfolio.

3 Stages of perfecting automation:

The major objectives of Agile and DevOps organisational cultures are to achieve a faster time to market and at the same

time improve code and product quality.

Continuous Integration is used to unify the effort of each and all of the development teams. It benefits the developers the most, giving them much more frequent and precise feedback about the code and allowing quick fixes.

To avoid a release hell and make each release easier, organizations embrace Continuous Integration pipelines in their workflows. The main idea here is that all the changes made by developers are merged into a shared repository. Each build is then validated with running automated tests against it, making sure new commits combine with each other and don’t break the whole application.

Each new feature, a change or a bug fix has to be covered with automation scripting. To make it happen, developers should aim for very small and flexible builds. Continuous Integration server then monitors the repository of those commits and runs the tests automatically.

As a result, much fewer defects slip through to production, because regressions are captured early enough, the same applies to all the integration issues. CI pipeline is also of huge benefit to the developers and

QA professionals. Developers receive continuous and immediate feedback and are able to fix a broken build before proceeding to another task. QA on the other hand. improves the quality culture in an organization, instead of performing dull and repetitive tasks.

Continuous Integration and Continuous Delivery, combined, help with building stable versions of the software to be validated more often. It helps the business opening the door to verify the value and functionalities with acceptance tests.

CD is an extension of Continuous Integration and involves packaging the software for deployment in a production-like environment. The final result here is a change in the application that is ready to be pushed to production based on a business decision.

To be able to do that Continuous Integration pipeline needs to be well established, with the test suite covering enough of the codebase. Developer teams may also use feature flags to be able to mark and control incomplete features so that they won’t affect the user later in production.

Automation Trends

Page 18: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

18 | TestArmy QA Trendbook — 2019 Trends

In the end, with CI/CD pipeline allows for much quicker preparation of the final version to go live. Newly released changes can be quickly verified with customer feedback loops. Also, in case of unexpected issues, the system can come back to the last stable version.

To achieve mastery with data-driven product development and feature A/B testing, organizations need to develop a Continuous Deployment. Experimenting with different functionalities and usability factors can only be achieved with automatically producing the software.

With Continuous Deployment variations of changes and features are handed to the users with a click of a button.

In that setup, a quality of the release is directly defined by precision and thoroughness of the test suite. It requires organizations to bring their A-game when it comes to quality culture.

As a result, users and customers see a stream of constant improvements, increasing the quality every day, instead of a month or a week. Achieving such a release frequency brings end-user satisfaction to a totally different level. Organizations can experiment with features and changes, optimizing the experience they deliver.

Approach to automation

Open Source Tools will be more important

For better performance and the execution of automation, Open Source Tools will be the core of the software testing industry. They are free to use, almost fully customizable and really flexible in designing your iterations the right way. It’s already happening, as for example Selenium and Katalon are compatible with GIT or Jira and this will continue to develop.

Codeless Test Automation

For large projects or agile-oriented ones, creating a test environment and writing scripts for complex solutions takes a huge amount of time and resources. For automation testing aimed at reducing both, it’s a death sentence. A solution to this problem seems to be codeless testing. As its name says, it’s a way of creating automation tests without a single piece of code. The idea is that when a tester performs a test manually, the tool records it, click by click, and then recreates it automatically. In the near future, it’ll be a great tool for automation testers to fast track their jobs. In a long distant future, tools will be smart enough to eliminate test script coding and will allow testers to focus only on specific cases and maintaining quality culture.

"As a QA engineer, I see huge benefits of shifting left, which means working towards defect prevention instead of detection. That strategy requires tight integration between QA specialists and developers in order to create the most effective setup with automation. I also look forward to seeing how IA and ML can help teams optimize quality strategies even more."

Jacek Okrojek

1

2

Automation Trends

Page 19: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 19TestArmy QA Trendbook — 2019 Trends

Artificial Intelligence & Machine Learning:

The picture that you should get while reading the title is a data-based, self-developing and optimizing algorithm. It collects the information, processes it using an interdisciplinary approach and recognizes patterns on levels that would be impossible to grasp

by a human being. Having said a lot about automation before, here is how AI and ML can improve the testing process:

Intelligent test automation

AI and ML tools will help with generating test cases, scripts, test data, reports and maintain currently used stories. With data they gathered, they’ll be able to create new user stories, predict system behavior and prioritize what, where and when to test.

AI test analysis

Wouldn't it be great to have a tool that allows analyzing not only code coverage of your tests, but also your test coverage? It would, for example, enable predicting an exact number of tests you need to run to verify a change in code made by a developer. It can help you in identifying the test cases, that need to be executed automatically. It would find high-risk areas and prioritize regression test cases. 2019 is the year of solving the great puzzle of ROI from quality assurance efforts.

Automation tool self-healing

In the process of testing, AI-based algorithms gather loads of data and use it to create something they understand as “normal app behavior”. Due to bugs they find, changes made in code and data that is not test output logs (for example HTML data, screenshots) this definition of “normal” may start to misrepresent. By leveraging machine learning the tools will know the difference between a small change to an element, a new feature or a broken front end.

1

2

3

Automation Trends

Page 20: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

20 | TestArmy QA Trendbook — 2019 Trends

Growing fields of performance thanks to automation:

With numerous technologies being constantly developed, lots of innovations and huge amounts of data there are certain fields,

where test automation is already on and becoming more and more significant.

Internet of Things

IoT technology is gaining attraction, new solutions appear and there are more and more connected devices. They should all be tested for usability, compatibility, reliability, data integrity, performance and most important security, because as per HP reports, around 70% of IoT-ish systems are vulnerable to security-related issues. This is a huge field for automation testing.

API and Services

Separating server and the client is something we see a lot in Web and mobile applications design. APIs and Services are reused in more than one app or component, therefore testing them is more effective than testing client’s app. Having the right tool, process and solution is now more important than ever. In the big picture, testing them correctly makes the whole digital world run smoothly. Test automation is highly recommended in this particular area as it can bridge the gap between past and present testing technologies.

Big data

With terabytes of data we upload and transfer, it’s crucial to be able to manage it. Therefore a special approach to performance and functional testing is needed. At first, testing should focus on data quality, because it should be the only content of the tested database. The next part of tests is checking its conformity, accuracy, consistency etc. Then the data processing should be tested, for example using commodity cluster.

Mobile automation testing

Automation role in testing mobile apps will increase. It’s really important due to numerous devices and operating systems supporting these apps. Compare it with the fact, that there must be no discrepancies across the platforms and you’ll know why the automation is necessary. Apps functionality, speed, interactivity and user-friendliness must be tested, and automation is the future. New tools will arrive and currently used (for example Kobiton) will develop new features.

1

2

3

4

Automation Trends

Page 21: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 21TestArmy QA Trendbook — 2019 Trends

Considering all of the above, we’re slowly entering the golden age of test automation, where being a good tester does not mean to have programming skills or to spend hundreds of hours using the app. Testing will be focused on understanding the processes, creating best test scenarios and scripts, knowing where and how to use automation tools to make your job easier and more pleasant. Organizations and individuals must be aware of these trends and keep up with them, as it creates the possibility to stay ahead of the competition and be always fresh, incorporating all of the newest solutions.

Jacek Okrojek, Lead Test Automation Engineer

Test automation engineer and test manager with many years of experience in testing high availability systems. He worked in the area of functional, integration, system and acceptance tests. Author of solutions that automate the software testing process, appreciating the importance of exploratory testing. Enthusiast of dynamic methods of software development and testing.

Automation Trends

Page 22: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

22 | TestArmy QA Trendbook — 2019 Trends

Cybersecurity insights & trends

Every year in the cybersecurity sector is similar, although each and every day is completely different. On a micro scale, you can daily see enormous amounts of new data on subjects such as vulnerability research, malware infections, innovative hacking techniques, enhanced defensive capabilities, which can easily make you confused if you don’t step back to look at it from the high-level perspective. Because then, you notice that on a yearly cadence, there aren’t that many things changing or which should keep us up at night compared to the previous year.

That’s why it’s important to read security predictions with a grain of salt because you shouldn’t be vigorously reacting to published forecasts and allowing it to confuse you.

Safety and cyber resilience of your organisation is achieved by consistent repetitive activities executed as a part of your thoroughly designed strategic roadmap, not by switching contexts to address the latest news from the security industry. It’s necessary to tweak your roadmap and acknowledge new threats, however, it shouldn’t come at the cost of consistent and well-thought tactics.

2019 game-changers (or not)

Artificial Intelligence isn’t going to change a thing in the way we operate in the cybersecurity field in 2019, Blockchain isn’t going to fix all the data privacy issues in 2019 and modern Advanced Persistent Threats aren’t going to revolutionize the way most companies respond to attacks.

In this article, I’m outlining some of the most important aspects that I believe should be reiterated each and every year, as well as providing a few recommendations on how to prepare for the slightly changing security landscape. Nothing is going to be groundbreaking,

nothing is going to change the game, but definitely it’s still good to observe the field and look at the whole perspective to ensure we’re not getting left behind. If the industry is going in some direction or is leaving a particular field then it’s wise to consider following as they might be onto something. There is no one-and-only valid perspective, silver bullet or a complete checklist to keep your people, company and applications safe, which is why it’s critical to learn from as many sources as possible.

However, analyse everything with a solid dose of common sense, because as an industry we spend ungodly amounts of resources on things to years later realize that it hasn’t meaningfully contributed to the bigger picture.

We’ve seen it before...

Many things that we’re going to experience in 2019 had their origins in 2018, so first let’s take a look at a few things that caught our attention last year:

• massive data leakages from misconfigured cloud environments

• multiple critical hardware-related vulnerabilities

Cybersecurity

Page 23: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 23TestArmy QA Trendbook — 2019 Trends

• increased interest in Secure SDLC and DevSecOps as a mean to respond to a shortage of security professionals in the job market

• increased adoption of technologies such as containerization

• massive privacy violations on platforms such as Facebook

• massive security breaches such as those affecting Equifax (143 million personal records), Yahoo (1 billion compromised accounts) and Uber (57 million users affected)

...so we can forecast...

Based on the current state of cybersecurity industry as well as the events that took place in 2018, I expect the following trends in 2019:

• higher investment in security automation to ensure higher coverage of security assurance in Agile environments

• heavier investment in the development of healthy corporate security culture. This includes education of executives who can then act as servant leaders and driving force in propagating the DevSecOps culture

• adoption of 5G networks means more devices connected to the Internet of Things, which will likely increase the volume of high-scale attacks performed by cybercriminals and the creation of massive IoT botnets

• ransomware isn’t going anywhere, but the attacks will likely focus on servers and IoT

• phishing attacks will rely more and more on trusted cloud platforms, affecting the reputation and trust of global service providers such as Google Drive

• security misconfigurations during migration to the cloud will result in a series of global data leakages

• wherever there is innovation, there is a need for skilled security professionals to secure the innovation and enable the business to focus on the growth. Having said that, we should expect companies responding to the lack of security workforce by investing in the training of their current staff to move them into security-oriented roles

• customers concerned about security breaches will increase their expectations towards the security

posture of their vendors. We can expect an emerging trend of customers relying on vendors who’ve proven to have functional security culture, as more corporations realize the costs of security exposures created by insecure supply chains

• in 2019 it’s reasonable to expect multiple big lawsuits filed under GDPR

• misinformation campaigns are going to get even more aggressive, given the volume of successful disinformation campaigns in the past few years

• because of the high profile state-sponsored attacks, more and more countries will realize the need to seriously invest in cybersecurity structures to defend the nation

• we may also start discussions on how we can tweak our perspective on online privacy, given the internet social dynamics and the willingness of new generations to publicly share in-depth data about their lifestyle

Cybersecurity

Page 24: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

24 | TestArmy QA Trendbook — 2019 Trends

… and be prepared

Security leaders should look ahead, but they should remain results-oriented. My advice to all security leaders for 2019 would be to not get confused by the sheer volume of forecasts spreading classic FUD (fear, uncertainty and doubt) and keep the discipline of doing the things that used to work for decades.

My list of TOP recommendations for anyone wanting to seriously level up their security game in 2019 and years after would be to:

• secure your endpoint devices with antivirus and HIDS software and utilize Mobile Device Management to secure the mobile devices of your employees

• implement mandatory Two Factor Authentication for all your systems

• build network monitoring systems to thoroughly understand what’s happening inside your networks

• create a strategic roadmap for creating a DevSecOps culture at your organisation. You won’t ever be able to hire enough security professionals to secure your network, so you’ll better off ensuring that each and every employee pays attention to safety during their day to day work, moving the needle a little bit into the right direction

• invest in security awareness training for your employees, but don’t forget about executives education. VIPs are often a target of sophisticated attacks, because they hold keys to the data kingdom and are in position of authority allowing them to skip security training

• invest heavily in security automation and shifting security to the left, to make it as smooth as possible for engineers to create secure products

• audit, test and monitor your cloud environments because cloud doesn’t fix all of your security problems. It slightly changes the responsibility model between you and the cloud provider, but you still have plenty of work to be done

• ensure that all new technologies used by your employees are properly hardened, so you aren’t left behind with hundreds of unsecured docker containers

• start building or outsource your Security Operations Center, because you need to have someone actually responding to the threats raised by automated systems

Dawid Bałut, CEO TestArmy CyberForces

A pentester and Bug Hunter with extensive experience who joined the security world more than a decade ago. For 5 years he was examining security systems of digital giants such as Facebook, Amazon or Apple. For the next 6 years, he has worked as a Security Architect for a corporation from Silicon Valley. His current mission is to share his knowledge of Western business efficiency and deliver top quality security solutions to European companies. On the path to this quest he came upon TestArmy and a CyberForces subbrand was born, with him as a CEO. Now he guides teams of cybersecurity specialists in implementing complex cyber projects.

Cybersecurity

Page 25: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 25TestArmy QA Trendbook — 2019 Trends

Internet of Things - quality in a hyper-connected world

The future of the IoT market is unspeakably bright. Businesses, houses and governments see how beneficial installing IoT systems are, especially in reducing costs and saving “the most valuable asset” - our time.

This opens a lot of opportunities for modern business to design their own solutions, built mainly upon smart devices in a variety of different fields - be it medicine, transportation, constructions, agriculture or financial markets. To give an example: the manufacturers can supervise all production processes remotely from a mobile device.

At this time IoT is one of the most-researched emerging markets globally, with a specific focus on how Cloud Services and APIs will enable a faster proliferation of applications and the marketplaces that offer them.

APIs will enable IoT projects to succeed faster and with greater accuracy by enabling more real-time integration points between systems. High-speed wireless networks (like 5G) are a key growth catalyst for IoT. That’s why Samsung, Qualcomm, LG, Huawei, and Intel all are vying to establish product leadership with patents. These top five patent holders together control over 13,300 IoT patents today.

The enabling technologies are well within your grasp and there is real business value to be gained from connecting people, parts, and processes. The challenge now is not merely to imagine what IoT can do, but to make hard decisions about what your company wants it to do, and what investments it will take to get there.

There are still a lot of improvements and discoveries to be made in this technology and developers have come up with many IoT application ideas already. But one thing is for sure - IoT security apps are the key to the futuristic world.

Key challenges when approaching IOT QA

Devices and systems involved in facilitating a connection to the Internet of Things must not only be tested according to regulatory requirements, but also tested and certified to ensure that they are electrically and functionally safe, secure and reliable. In addition,

Spen

din

g in

bill

ion

s U

.S. d

olla

rs

Spending on Internet of Things worldwide by vertical in 2015 and 2020 (in billions U.S. dollars)

45

2015

Discretemanufacturing

Transportationand logistics

Utilities B2C Healthcare Process Energy andnatural

resources

Retail Government Insurance Other

4040 40 40

10 10

75 5

43

12 12 12

25

15 15

35

30

25

20

15

10

5

0

2

5

2

5

8

30

2020

Source: IoT spending by vertical worldwide, Statista.com

Source: The Top 10 IoT Segments in 2018, IoT Analytics

Internet of Things

Page 26: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

26 | TestArmy QA Trendbook — 2019 Trends

they should protect the privacy of users while providing the expected user experience.

Security

IoT devices generate an unprecedented amount of data, which often includes sensitive personal data. Security and risk management leaders focusing on IoT will need to harness the information gathered for responsible use and distinguish between consumer and business risk

Connectivity

The success of an IoT system depends on how well the devices and hub are connected. Even a loss of connection for a fraction of a second can lead to inaccurate data, which will, in turn, make the system unusable.

It is widely known that a delay in website response may often cause people to lose interest and abandon their shopping cart. Sadly, the problem only gets worse when it comes to IoT. Increased latency directly affect battery life for constrained devices as they have to wait longer for the response. Under normal conditions, devices could cope up with slight delays. However, in some cases, a delayed decision could severely reduce the effectiveness of the entire solution. E.g. in an industrial IoT solution, the control of a gas valve must be done with little or negligible delays. Failure to delay such action may result in catastrophic consequences. Similarly, a critical engine warning should be promptly displayed to the driver to get his attention. Any delay in notification of parameters such as high pressure may result in irrecoverable losses. The overall response duration of the IoT platform consists of two parts, communication latency and the processing latency within the cloud platform. Since communication latency is mostly external and fixed due to the choice of communication media (i.e. WiFi/LoRaWAN), the processing latency becomes the most important parameter for testing perspective.

Hardware-software mesh

IoT is an architecture, which is closely coupled among various hardware and software components. It is not only the software applications that makes the system. The hardware ones such as sensors, communication gateways etc. also play a vital role.

Just functionality testing does not help in completely certifying the system. There is always a dependency on each other in terms of the environment, data transfer etc. So, it becomes a tedious job as compared to testing a generic system [only software/hardware component].

Replication of environments

When testing a website it’s easy for testers to run the pages through the mill. Open the page on the popular browsers, run it on laptops, tablets and smartphones and you’ve pretty much tested how it will be used by 90% of users. However, with IoT devices, replicating a user’s environment is far harder. Will the device be used at home or at work? Will the internet speed be fast or slow? How many unknown devices are also connected to this network? Will the device need to leave and rejoin the network?

So how should I ensure my IoT quality?

Because of complex architecture and unique characteristics of IoT systems and to ensure that the usability, performance and security of IoT applications is up-to-date, the following types of tests are recommended:

Security and privacy testing (security)This includes security aspects like data protection, device identity authentication, encryption/decryption and trust in cloud computing

Performance and real-time testing (performance)This covers complex aspects like timing analysis, load testing, real-time stream analytics and time-bound outputs, under the extremes of data volume, velocity, variety and veracity.

End-user application testing (usability)It is testing all functional and non-functional use cases of an IoT application, which also includes UX and usability testing.

Internet of Things

Page 27: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 27TestArmy QA Trendbook — 2019 Trends

Try rolling out a pilot first

When you are done with all the elementary tests, pilot test your system rather than experimenting it with dummy data. Implement a live version of your software in real time and allow several users to connect and utilize your software and give feedback.

This will yield the flaws in your software in a practical environment and will provide you with a chance to get rid of bugs when you launch a fully-functional version of your IoT system.

Only testing in Lab makes sure the product/system works fine. But, this may backfire badly when exposed to real-time conditions/steps/scenarios.

Łukasz Pietrucha, QA Director

QA specialist with more than 13 years of experience. His career path involves such professions as a QA engineer, Technical Project Manager, Scrum Master and even a translator. He’s a certified ISTQB trainer and consultant. Currently, he’s a QA Director in TestArmy and leads 50+ employees QA team, defines the product and builds strategic roadmaps.

Classic Test Approach

IoT Test Approach

You need to treat „Test by Customer”as a key step in your plan & be readyto provide a quick fix.

UnitTesting

ComponentTesting

Integration &Acceptance Testing

ByCustomer

Timeline

Source:Testing for Internet of Things (IOT) - How is it different?, TechArcis

Internet of Things

Page 28: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

28 | TestArmy QA Trendbook — 2019 Trends

We believe that with rapidly changing business conditions, continuous pursuit of quality excellence is a key to success.

TestArmy Group provides holistic, business-driven and results-oriented QA services

We support organisations by helping them to achieve a higher level of quality and seamless digital experience

once it comes to their products and services.

BusinessDriven

Quality Excellence

Cyber Security

Customer Experience

Consulting

Fuctional Testing

Automation

Training and workshops

Pentesting

Cybersecurity programs

Secure software manufacturing

VIP Security Service

Accesibility

Performance

User Experience

Page 29: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 29TestArmy QA Trendbook — 2019 Trends

Self-service economy is a growing trend and will be in the following years. We experience more and more successful applications of ML and AI, putting digital industries even one step ahead. It is already and will be used e.g. for defect prevention, thus QA no longer serves an instrument of measurement but rather predicts some results.

We live in an area of total mobility and rapid information exchange. Industries are experimenting more and more with the application of IoT. Think about how many so-called SMART devices you have used today? For QA industry it means focusing more on usability, reliability, performance. Technology evolves and so will the development part.

The application of bots is prevalent across sectors, including consulting & service domains. The idea is to automate the recurring & structurally repetitive activities so your employees can be freed up to perform more complex tasks.

Whether it is connected devices, AI, VR or AR, there will be open nodes that will need a secure interface. Security will dominate corporate decisions, high-level discussions and development strategies.

Blockchain concept is widely being applied not only for cryptocurrencies but also serves as leverage to existing businesses, transforming the way they operate globally. QA/QE needs to stay at the heart of its deployment cycle to ensure business value is delivered.

Digital twins refer to the digital representation of physical objects. They drive the business impact of IoT by offering a powerful way to monitor and control assets and processes.

With scalability in mind, ever-growing number of companies moves their data processing into the cloud, aiming for faster and more frequent deployment. Among QA it requires not only broad technical skills but also shifting the mindset towards DevOps and CD (Continuous Development) principles.

7 scopes of change in Digital Assurance

Machine Learning (ML) & Artificial Intelligence (AI)

Internet Of Things (IoT)

Bots

Security

Digital Twin

Cloud

Blockchain

Page 30: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

30 | TestArmy QA Trendbook — 2019 Trends

7 Years on the market

TestArmy QA Trendbook — 2019 Trends

Page 31: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 31TestArmy QA Trendbook — 2019 Trends

TestArmy Group S.A.

We provide the full spectrum of services and workshops related to quality assurance and system and application testing. By

dividing ourselves into 3 specialized units, we are fully prepared to help in every aspect of QA and cybersecurity.

TestArmy Group’s statistics

CyberForces

CyberForces mission is to help clients build holistic security systems, programs and applications, as well as to provide a thorough insight into the security of companies and applications. We believe in security as the most important factor of business and willingly share our knowledge during courses, meetups and conferences. We perform penetration tests, security audits, social engineering tests and adversarial attack simulations. We also help to develop secure software and take care of VIP cyber security awareness.

TestArmy

TestArmy is an elite and well-organized testing special forces unit, experienced in quality assurance. Our field of expertise is QA, functional test, performance tests and testing automation.

We have helped many industries, by testing everything from banking apps to smart toothbrushes. We have been keeping IT products flawless for over 10 years, by taking care of every stage of the software development process.

Training Department

We build a community of testers. We’re involved in many IT events, host lots of webinars, QA sessions and a nationwide two-day testers conference.

Since 2015 we’ve been training people that want to start their job as a tester or raise their qualifications by acquiring certificates.

We’ve trained over 2500 testing passionates. After completing our training over 90% of participants passes international ISTQB exam at first approach.

We offer:

• ISTQB and IREB certificate training

• automation, efficiency and programming languages training

• training dedicated to companies

Page 32: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

32 | TestArmy QA Trendbook — 2019 Trends

TestArmy Group in numbers

2018 was a very busy year. We’ve grown and expanded. We’re happy to announce that by now:

TestArmy’s clients are placed all over the globe:

Selling our services outside of CEE has generated over 111% higher revenue than in the previous year.

We’ve served 137 clients

from CEE from all over the world projects were carried out

95 42 500+

Page 33: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 33TestArmy QA Trendbook — 2019 Trends

Our clients’ companies are set on many branches of industry, that goes as follows:

We’ve performed many services such as augmenting our QA teams with our clients’ employees, functional testing

of their software, doing UX audits and providing dedicated training and workshops, based on their internal needs:

Other17.2%

None8.6%

Real Estate2.3%

E-learning4.7%

Retail5.5%

Information Tech...20.3%

Computer Software10.9%

Internet10.9%

Financial Services7.8%

Marketing & Advertising7.8%

Internet of Things

Financial services & fintech

Retail

Public

Software houses

Online services & e-learning

Medical

Page 34: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

34 | TestArmy QA Trendbook — 2019 Trends

Even though many of our services are outsourced, we are more than happy to meet our clients in their headquarters.

We love to share our knowledge. We’ve been at over 15 local conferences and hosted one of our own - Test Camp. During two days of lectures and workshops we’ve had 18 speakers and 400 software testers and test engineers as

listeners and participants.

WroclawPoland

StockholmSweden

ParisFrance

BerlinGermany

BrusselsBelgium

HelsinkiFinland

JohannesburgRepublic of South Africa

DublinIreland

LondonUK

CopenhagenDenmark

NY / SFUS

TampereFinland

Our profitability has grown and we’ve generated over 45% larger income in 2018.

2016

+160%*

+100%*

+45%*

2017

Rev

enu

e

Annual revenue growth

2018

*Compared to previous year

Page 35: TestArmy QA Trendbook€¦ · TestArmy QA Trendbook fl 2019 Trends | 2 About the report The Token of Trust Digital Transformation - a vessel of change in software quality assurance

| 35TestArmy QA Trendbook — 2019 Trends

TestArmy CyberForces is an elite unit designated to fight cybercrime. We have over a decade of

experience in securing our clients’ systems and protecting them against hackers.

WE SPECIALIZE IN ALL CYBERSECURITY ACTIVITIES:

"Safety and cyber resilience of your organisation is achieved by consistent repetitive activities executed as a part of your thoroughly designed strategic roadmap. There is no one-and-only valid perspective, silver bullet or a complete checklist to keep your people, company and applications safe, which is why it’s critical to learn from as many sources as possible.".

Dawid Bałut, CEO TestArmy CyberForces

penetration tests

security audits

red teaming

social engineering

tests

secure software

manufacturing

Security Program Building

VIP Cyber Security

Awareness

VISIT CYBERFORCES.COM