IBM Systems Magazine, Mainframe - March/April 2018 - 53

final event. The ERROR: lines are
provided for both the final event
and the related event to further
describe the event. The ACTION:
lines are only provided for the
final event so that you investigate
the problem described for that
event. After the issue is fixed,
invoke Runtime Diagnostics again
to verify its resolution.
Runtime Diagnostics doesn't
merely correlate contention
events. All other event types
except OPERLOG messages and
JES2 events are correlated. For
example, Runtime Diagnostics
documentation has always
stated that when both a
HIGHCPU event and LOOP
event list the same job name,
the task in the job is likely to be
looping. However, those events
could have been separated by
other events in the output. Now,
events for the same job or same
task within a job are combined
into one correlated event.

Complex Deadlocks
In z/OS V2.3, Runtime
Diagnostics not only finds
deadlocks on the system for
which it was invoked, but also
across systems, and between
GRS enqueues and latches. As
Runtime Diagnostics is invoking
itself on other systems to follow
blockers, it collects the GRS
enqueue and latch information
from those systems and returns
it to the originating system,
which combines the data. After
all blockers are followed, the
combined data is analyzed for
deadlocks across all the GRS
enqueues and latches used on
those systems. Note that this
combined data doesn't contain
data from all systems in the
SYSPLEX, only from the systems
to which blockers were followed.
Also, there's no minimum
contention time required for
deadlock detection (i.e., the

waiters don't need to be waiting
for a minimum length of time for
the deadlock event to be created).
Figure 3 (below) shows a
deadlock between four address
spaces, one of which is on SYS1
and three of which are on SYS2.
Three enqueues and one latch

are involved in the deadlock. The
order of the resources is based
on how the data was collected.
Notice that the blocker of one
resource is the waiter of the
next and the blocker of the last
resource is always the waiter of
the first resource.

Figure 2: Runtime Diagnostics Correlated Event
EVENT 01: HIGH:CORRELATED
SYSTEM: SYS1
2017/11/18 16:09:54
FINAL EVENT FOR EVENT 01: HIGH:LOOP
SYSTEM: SYS2
ASID: 0368 JOBNAME: B3
TCB: 004FF048
STEPNAME: STEP1
PROCSTEP:
JOBID: JOB00041
USERID: TESTER01 JOBSTART: 2017/11/18 12:34:22
ERROR : ADDRESS SPACE MIGHT BE IN A TCB-ENABLED LOOP.
ACTION: USE YOUR SOFTWARE MONITORS TO INVESTIGATE THE ASID.
-----------------------------------------------------RELATED EVENT FOR EVENT 01: HIGH:ENQ
SYSTEM: SYS1
QNAME: ENQUEUE1 SCOPE: SYSTEMS
RNAME: MYRNAME1
ASID JOB NAME TCB/WEB
SYSTEM
WAIT TIME
TOP WAITER : 005A W1
004E2A70 SYS1
00:06:35
TOP BLOCKER: 0365 B2
004E2A90 SYS2
ERROR : ADDRESS SPACES MIGHT BE IN ENQ CONTENTION ON SYS1.
-----------------------------------------------------RELATED EVENT FOR EVENT 01: HIGH:LATCH
SYSTEM: SYS2
LATCH SET NAME: SYSTEST.LATCH_TESTSET
LATCH NUMBER: 4
CASID: 0368 CJOBNAME: B3
ASID JOB NAME TCB/WEB
SYSTEM
WAIT TIME
WAITER
: 0365 B2
004E2A90 SYS2
00:02:53
TOP BLOCKER: 0368 B3
004FF048 SYS2
OTHER WAITERS FOR THIS RESOURCE:
TOP WAITER: 0245 W2
004EF980 SYS2
00:03:27
ERROR : ADDRESS SPACES MIGHT BE IN LATCH CONTENTION ON SYS2.

Figure 3: Deadlock Between Systems and Resource Types
EVENT 01: HIGH:DEADLOCK
SYSTEM: SYS1
2017/11/18 16:09:54
RESOURCE: ENQ
QNAME: ENQUEUE8 SCOPE: SYSPLEX
RNAME: MYRNAME8
ASID JOB NAME TCB/WEB
SYSTEM
WAIT TIME
WAITER
: 001A AS1
004E2A10 SYS1
00:01:22
BLOCKER
: 002A AS2
004E2A20 SYS2
RESOURCE: LATCH
LATCH SET NAME: SYSTEST.LATCH_TEST
LATCH NUMBER: 1
CASID: 005A CJOBNAME: AS3
ASID JOB NAME TCB/WEB
SYSTEM
WAIT TIME
WAITER
: 002C AS2
004E2A20 SYS2
00:10:53
BLOCKER
: 003C AS3
004E2A30 SYS2
RESOURCE: ENQ
QNAME: ENQUEUE4 SCOPE: SYSPLEX
RNAME: MYRNAME4
ASID JOB NAME TCB/WEB
SYSTEM
WAIT TIME
WAITER
: 003C AS3
004E2A30 SYS2
03:22:53
BLOCKER
: 002C AS4
004E2A40 SYS2
RESOURCE: ENQ
QNAME: ENQUEUE6 SCOPE: SYSPLEX
RNAME: MYRNAME6
ASID JOB NAME TCB/WEB
SYSTEM
WAIT TIME
WAITER
: 002C AS4
004E2A40 SYS2
00:06:35
BLOCKER
: 001A AS1
004E2A10 SYS1
ERROR : ADDRESS SPACES WERE DEADLOCKED AT THE TIME OF THE ANALYZE
ERROR : REQUEST.
ACTION: USE YOUR SOFTWARE MONITORS TO INVESTIGATE BLOCKERS TO
ACTION: DETERMINE IF THE DEADLOCK STILL EXISTS AND TAKE APPROPRIATE
ACTION: ACTION TO ELIMINATE THE DEADLOCK.

ibmsystemsmag.com MARCH/APRIL 2018 // 53


http://www.ibmsystemsmag.com

Table of Contents for the Digital Edition of IBM Systems Magazine, Mainframe - March/April 2018

Table of Contents
Editor's Desk: Secure Sharing in the Cloud
Partner POV: Winds of Change: Now is the time for digital transformation on IBM Z
IT Today: Solutions and Support: 5 reasons IBM Z makes technical and financial sense for clients
Focus on Storage: New Revolution: Storage technology shifts to accommodate cloud and cognitive demands
Case Study: A Proof of Concept: ICU IT Services expands its market base by embracing Linux on IBM Z and IBM LinuxONE
Cover Story: Building on the Future: IBM Cloud Private with IBM Z helps clients reap the benefits of cloud
Feature: Securing the Cloud: New and established IBM offerings to meet enterprise data protection needs
TECH Showcase: The Clock's Ticking: IBM framework helps clients prepare for the EU's General Data Protection Regulation
Hot Topics: Go With the Flow: z/OS v2.3 Migration book is transformed to a z/OSMF workflow
Administrator: Problem Pointer: Runtime Diagnostics with z/OS V2.3 offers new ways to discover issues
Solutions: DMX Change Data Capture, Syncsort; Enterprise 3.0, Micro Focus
Stop Run: Reg Harbeck
Reference Point - Global Events, Education, Resources for Power Systems
2018 Mainframe Solutions Edition Product Index
IBM Systems Magazine, Mainframe - March/April 2018 - Intro
IBM Systems Magazine, Mainframe - March/April 2018 - Cover1
IBM Systems Magazine, Mainframe - March/April 2018 - Cover2
IBM Systems Magazine, Mainframe - March/April 2018 - 1
IBM Systems Magazine, Mainframe - March/April 2018 - Table of Contents
IBM Systems Magazine, Mainframe - March/April 2018 - 3
IBM Systems Magazine, Mainframe - March/April 2018 - Editor's Desk: Secure Sharing in the Cloud
IBM Systems Magazine, Mainframe - March/April 2018 - 5
IBM Systems Magazine, Mainframe - March/April 2018 - Partner POV: Winds of Change: Now is the time for digital transformation on IBM Z
IBM Systems Magazine, Mainframe - March/April 2018 - 7
IBM Systems Magazine, Mainframe - March/April 2018 - IT Today: Solutions and Support: 5 reasons IBM Z makes technical and financial sense for clients
IBM Systems Magazine, Mainframe - March/April 2018 - 9
IBM Systems Magazine, Mainframe - March/April 2018 - 10
IBM Systems Magazine, Mainframe - March/April 2018 - 11
IBM Systems Magazine, Mainframe - March/April 2018 - Focus on Storage: New Revolution: Storage technology shifts to accommodate cloud and cognitive demands
IBM Systems Magazine, Mainframe - March/April 2018 - 13
IBM Systems Magazine, Mainframe - March/April 2018 - 14
IBM Systems Magazine, Mainframe - March/April 2018 - 15
IBM Systems Magazine, Mainframe - March/April 2018 - Case Study: A Proof of Concept: ICU IT Services expands its market base by embracing Linux on IBM Z and IBM LinuxONE
IBM Systems Magazine, Mainframe - March/April 2018 - 17
IBM Systems Magazine, Mainframe - March/April 2018 - 18
IBM Systems Magazine, Mainframe - March/April 2018 - 19
IBM Systems Magazine, Mainframe - March/April 2018 - Cover Story: Building on the Future: IBM Cloud Private with IBM Z helps clients reap the benefits of cloud
IBM Systems Magazine, Mainframe - March/April 2018 - 21
IBM Systems Magazine, Mainframe - March/April 2018 - 22
IBM Systems Magazine, Mainframe - March/April 2018 - 23
IBM Systems Magazine, Mainframe - March/April 2018 - 24
IBM Systems Magazine, Mainframe - March/April 2018 - 25
IBM Systems Magazine, Mainframe - March/April 2018 - Feature: Securing the Cloud: New and established IBM offerings to meet enterprise data protection needs
IBM Systems Magazine, Mainframe - March/April 2018 - 27
IBM Systems Magazine, Mainframe - March/April 2018 - 28
IBM Systems Magazine, Mainframe - March/April 2018 - 29
IBM Systems Magazine, Mainframe - March/April 2018 - 30
IBM Systems Magazine, Mainframe - March/April 2018 - 31
IBM Systems Magazine, Mainframe - March/April 2018 - 32
IBM Systems Magazine, Mainframe - March/April 2018 - TECH Showcase: The Clock's Ticking: IBM framework helps clients prepare for the EU's General Data Protection Regulation
IBM Systems Magazine, Mainframe - March/April 2018 - 34
IBM Systems Magazine, Mainframe - March/April 2018 - 35
IBM Systems Magazine, Mainframe - March/April 2018 - 36
IBM Systems Magazine, Mainframe - March/April 2018 - 37
IBM Systems Magazine, Mainframe - March/April 2018 - 38
IBM Systems Magazine, Mainframe - March/April 2018 - 39
IBM Systems Magazine, Mainframe - March/April 2018 - 40
IBM Systems Magazine, Mainframe - March/April 2018 - 41
IBM Systems Magazine, Mainframe - March/April 2018 - 42
IBM Systems Magazine, Mainframe - March/April 2018 - 43
IBM Systems Magazine, Mainframe - March/April 2018 - Hot Topics: Go With the Flow: z/OS v2.3 Migration book is transformed to a z/OSMF workflow
IBM Systems Magazine, Mainframe - March/April 2018 - 45
IBM Systems Magazine, Mainframe - March/April 2018 - 46
IBM Systems Magazine, Mainframe - March/April 2018 - 47
IBM Systems Magazine, Mainframe - March/April 2018 - 48
IBM Systems Magazine, Mainframe - March/April 2018 - 49
IBM Systems Magazine, Mainframe - March/April 2018 - 50
IBM Systems Magazine, Mainframe - March/April 2018 - Administrator: Problem Pointer: Runtime Diagnostics with z/OS V2.3 offers new ways to discover issues
IBM Systems Magazine, Mainframe - March/April 2018 - 52
IBM Systems Magazine, Mainframe - March/April 2018 - 53
IBM Systems Magazine, Mainframe - March/April 2018 - 54
IBM Systems Magazine, Mainframe - March/April 2018 - Solutions: DMX Change Data Capture, Syncsort; Enterprise 3.0, Micro Focus
IBM Systems Magazine, Mainframe - March/April 2018 - Stop Run: Reg Harbeck
IBM Systems Magazine, Mainframe - March/April 2018 - Cover3
IBM Systems Magazine, Mainframe - March/April 2018 - Cover4
IBM Systems Magazine, Mainframe - March/April 2018 - Reference Point - Global Events, Education, Resources for Power Systems
IBM Systems Magazine, Mainframe - March/April 2018 - 2018 Mainframe Solutions Edition Product Index
IBM Systems Magazine, Mainframe - March/April 2018 - SE2
IBM Systems Magazine, Mainframe - March/April 2018 - SE3
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20191112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/relevantz_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2019mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20181112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2018mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20171112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_sesupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_linuxsupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20161112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/MainframeSecurity
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20151112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910_se
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910
http://www.ibmsystemsmagmainframedigital.com/MFSkills
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506_supp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20141112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_gt_201405
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/BigData
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20131112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20121112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/buyersguide2013
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/ibmsystems_mainframe_2012bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20111112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20101112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910_bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20091112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090506
http://www.nxtbook.com/nxtbooks/ibmsystemsmag/mainframe_20090304
http://www.nxtbook.com/nxtbooks/mspcomm/ibmsystems_mainframe_200901
http://www.nxtbookMEDIA.com