IBM Systems Magazine, Mainframe - July/August 2016 - 15

delivery of high-quality changes
to an organization's systems
of record and enables it to be
synchronized with front-end
systems of engagement.

Figure 1: ADI Application Test Coverage

Importance of Testing
Techniques like DevOps have
been created to meet the new
software development challenges
that have arisen. However, many
organizations adopting DevOps
for their systems of record still
struggle to meet needs. What
could be happening? It comes
down to the complexity of
the task. If the goal is simple,
find a more efficient solution
(e.g., to bang in nails, use a
nail gun instead of a hammer).
But software development is
complex, with many processes
and variables similar to running
a race car where the pit crew and
driver constantly monitor the
telemetry and make adjustments
to improve the lap time.
It's this continual monitoring
and improvement where most
DevOps implementations struggle.
Testing can be used as an
example to fully understand how
this manifests itself in practice.
More changes are being
pushed through faster. In
addition, the adoption of
agile processes and shift left
testing-performed earlier in
the process-is adding more
tests to that load. Many tools
and techniques can speed up
testing, such as test automation,
test management and service
virtualization. What most
organizations don't know is how
well they're testing applications,
how efficient testing is and
whether the changes they
make actually improve test
coverage (and therefore
application quality).
So, what happens if we
monitor and improve this
process? We can actually see

Figure 2: ADI Coverage Dashboard

the effect using IBM Application
Delivery Intelligence (ADI), a
tool that captures and tracks
code and test coverage data from
automated and manual testing.
In this scenario, the testing
tools and development process
could be anything, but first, we
monitor and optimize the testing
performed (see Figure 1, above).
A program must be tested
once it's changed. The tester can
use the historical data collected
by ADI to identify any tests
available to cover this module
and the optimal set of tests to
run to give the best coverage.
This simple act reduces the
time to identify which test to
run, lowers the risk of error
because of unfamiliarity with

L
Most
organizations
don't know how
well they're
testing, how
efficient testing
is and whether
the changes they
make actually
improve test
coverage

the application and reduces
the number of tests run while
maintaining coverage. Test
coverage can also tell when the
actual lines of code that make
up a change have been checked
so that the process may be
stopped once the change has
been covered.
The individual tester is not
the only one who sees efficiency
improvements. By monitoring
the test coverage trends, quality
assurance managers can verify
coverage levels and anomalous
drops in coverage, and track
systemwide testing performance
(see Figure 2, above). Auditors
and compliance officers can
easily be shown that changes
have been tested thoroughly, and

ibmsystemsmag.com JULY/AUGUST 2016 // 15


http://www.ibmsystemsmag.com

Table of Contents for the Digital Edition of IBM Systems Magazine, Mainframe - July/August 2016

Table of Contents
Editor's Desk: Security from every angle
IBM Perspective: Creating a secure foundation for hybrid cloud
Techbits: 'W' is for 'Watson'
Partner PoV: Get everyone in your organization on board with DevOps
It Today: Use analytics to improve DevOps effectiveness
Trends: Analytics can be your best defense against corporate fraud
R&D: IBM's data privacy and consent management technology provides greater control
Case Study: Head of the Class: Pacific Life gets ahead of retirement with Mainframe Academy training program
Cover Story: Defending Digital Domains: The z Systems mainframe proves to be a formidable defense system against cyberthieves
Feature: Securable z Systems: IBM offers platform-specific security solutions to address business needs and demands
Tech Showcase: A comprehensive backup and recovery solution is needed with always-available date
Sponsored Advertising Content: HotTECH Products
Tech Corner: Overview: The latest CICS and IMS updates place z Systems at the center of the API economy
Tech Corner: IMS: IBM IMS helps support innovation to stay competitive
Tech Corner: CICS: Getting started with architecting Java Enterprise Edition in CICS Transaction Server
Solutions: SUPERMON for Tubes, zHISR 2.7
Stop Run: IBMer finds his balance with hiking and mountaineering
Reference Point - Global Events, Education, Resources for Mainframe
2016 Mainframe Solutions Edition Product Index
IBM Systems Magazine, Mainframe - July/August 2016 - Intro
IBM Systems Magazine, Mainframe - July/August 2016 - Cover1
IBM Systems Magazine, Mainframe - July/August 2016 - Cover2
IBM Systems Magazine, Mainframe - July/August 2016 - 1
IBM Systems Magazine, Mainframe - July/August 2016 - Table of Contents
IBM Systems Magazine, Mainframe - July/August 2016 - 3
IBM Systems Magazine, Mainframe - July/August 2016 - 4
IBM Systems Magazine, Mainframe - July/August 2016 - 5
IBM Systems Magazine, Mainframe - July/August 2016 - Editor's Desk: Security from every angle
IBM Systems Magazine, Mainframe - July/August 2016 - 7
IBM Systems Magazine, Mainframe - July/August 2016 - IBM Perspective: Creating a secure foundation for hybrid cloud
IBM Systems Magazine, Mainframe - July/August 2016 - 9
IBM Systems Magazine, Mainframe - July/August 2016 - Techbits: 'W' is for 'Watson'
IBM Systems Magazine, Mainframe - July/August 2016 - 11
IBM Systems Magazine, Mainframe - July/August 2016 - Partner PoV: Get everyone in your organization on board with DevOps
IBM Systems Magazine, Mainframe - July/August 2016 - 13
IBM Systems Magazine, Mainframe - July/August 2016 - It Today: Use analytics to improve DevOps effectiveness
IBM Systems Magazine, Mainframe - July/August 2016 - 15
IBM Systems Magazine, Mainframe - July/August 2016 - 16
IBM Systems Magazine, Mainframe - July/August 2016 - 17
IBM Systems Magazine, Mainframe - July/August 2016 - Trends: Analytics can be your best defense against corporate fraud
IBM Systems Magazine, Mainframe - July/August 2016 - 19
IBM Systems Magazine, Mainframe - July/August 2016 - R&D: IBM's data privacy and consent management technology provides greater control
IBM Systems Magazine, Mainframe - July/August 2016 - 21
IBM Systems Magazine, Mainframe - July/August 2016 - 22
IBM Systems Magazine, Mainframe - July/August 2016 - 23
IBM Systems Magazine, Mainframe - July/August 2016 - Case Study: Head of the Class: Pacific Life gets ahead of retirement with Mainframe Academy training program
IBM Systems Magazine, Mainframe - July/August 2016 - 25
IBM Systems Magazine, Mainframe - July/August 2016 - 26
IBM Systems Magazine, Mainframe - July/August 2016 - 27
IBM Systems Magazine, Mainframe - July/August 2016 - Cover Story: Defending Digital Domains: The z Systems mainframe proves to be a formidable defense system against cyberthieves
IBM Systems Magazine, Mainframe - July/August 2016 - 29
IBM Systems Magazine, Mainframe - July/August 2016 - 30
IBM Systems Magazine, Mainframe - July/August 2016 - 31
IBM Systems Magazine, Mainframe - July/August 2016 - 32
IBM Systems Magazine, Mainframe - July/August 2016 - 33
IBM Systems Magazine, Mainframe - July/August 2016 - Feature: Securable z Systems: IBM offers platform-specific security solutions to address business needs and demands
IBM Systems Magazine, Mainframe - July/August 2016 - 35
IBM Systems Magazine, Mainframe - July/August 2016 - 36
IBM Systems Magazine, Mainframe - July/August 2016 - 37
IBM Systems Magazine, Mainframe - July/August 2016 - 38
IBM Systems Magazine, Mainframe - July/August 2016 - Tech Showcase: A comprehensive backup and recovery solution is needed with always-available date
IBM Systems Magazine, Mainframe - July/August 2016 - 40
IBM Systems Magazine, Mainframe - July/August 2016 - 41
IBM Systems Magazine, Mainframe - July/August 2016 - 42
IBM Systems Magazine, Mainframe - July/August 2016 - 43
IBM Systems Magazine, Mainframe - July/August 2016 - Sponsored Advertising Content: HotTECH Products
IBM Systems Magazine, Mainframe - July/August 2016 - 45
IBM Systems Magazine, Mainframe - July/August 2016 - 46
IBM Systems Magazine, Mainframe - July/August 2016 - 47
IBM Systems Magazine, Mainframe - July/August 2016 - 48
IBM Systems Magazine, Mainframe - July/August 2016 - 49
IBM Systems Magazine, Mainframe - July/August 2016 - Tech Corner: Overview: The latest CICS and IMS updates place z Systems at the center of the API economy
IBM Systems Magazine, Mainframe - July/August 2016 - 51
IBM Systems Magazine, Mainframe - July/August 2016 - 52
IBM Systems Magazine, Mainframe - July/August 2016 - 53
IBM Systems Magazine, Mainframe - July/August 2016 - Tech Corner: IMS: IBM IMS helps support innovation to stay competitive
IBM Systems Magazine, Mainframe - July/August 2016 - 55
IBM Systems Magazine, Mainframe - July/August 2016 - 56
IBM Systems Magazine, Mainframe - July/August 2016 - 57
IBM Systems Magazine, Mainframe - July/August 2016 - Tech Corner: CICS: Getting started with architecting Java Enterprise Edition in CICS Transaction Server
IBM Systems Magazine, Mainframe - July/August 2016 - 59
IBM Systems Magazine, Mainframe - July/August 2016 - 60
IBM Systems Magazine, Mainframe - July/August 2016 - 61
IBM Systems Magazine, Mainframe - July/August 2016 - 62
IBM Systems Magazine, Mainframe - July/August 2016 - Solutions: SUPERMON for Tubes, zHISR 2.7
IBM Systems Magazine, Mainframe - July/August 2016 - Stop Run: IBMer finds his balance with hiking and mountaineering
IBM Systems Magazine, Mainframe - July/August 2016 - Cover3
IBM Systems Magazine, Mainframe - July/August 2016 - Cover4
IBM Systems Magazine, Mainframe - July/August 2016 - Reference Point - Global Events, Education, Resources for Mainframe
IBM Systems Magazine, Mainframe - July/August 2016 - 2016 Mainframe Solutions Edition Product Index
IBM Systems Magazine, Mainframe - July/August 2016 - SE2
IBM Systems Magazine, Mainframe - July/August 2016 - SE3
IBM Systems Magazine, Mainframe - July/August 2016 - SE4
IBM Systems Magazine, Mainframe - July/August 2016 - SE5
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/relevantz_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2019mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20181112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2018mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20171112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_sesupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_linuxsupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20161112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/MainframeSecurity
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20151112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910_se
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910
http://www.ibmsystemsmagmainframedigital.com/MFSkills
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506_supp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20141112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_gt_201405
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/BigData
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20131112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20121112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/buyersguide2013
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/ibmsystems_mainframe_2012bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20111112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20101112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910_bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20091112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090506
http://www.nxtbook.com/nxtbooks/ibmsystemsmag/mainframe_20090304
http://www.nxtbook.com/nxtbooks/mspcomm/ibmsystems_mainframe_200901
http://www.nxtbookMEDIA.com