IBM Systems Magazine, Mainframe - November/December 2016 - L22


TRENDS

IDEAL PLATFORM
Co-locating analytics on Linux on z Systems adds value

L

inux* on z Systems* is well regarded as an ideal consolidation platform for
database workloads. Databases traditionally have been hosted on bare metal
servers, and with proliferation of commodity x86 servers, it's not uncommon to
find hundreds, if not thousands, of distributed servers running database workloads
in a data center. This has resulted in complexity with explosive software license
charges and significant operational costs for administration, floor space and energy.
Avijit Chatterjee
is an analytics
evangelist in the
IBM Competitive
Projects Office.

Some companies have
addressed their server proliferation challenges by sweeping their
data center floor of distributed
servers and consolidating them
on Linux on z Systems. Laboratory studies conducted by the
IBM Competitive Project Office
have shown that this exercise
often cuts total cost of ownership
in half because of tremendous
software license savings achieved
from drastic reduction in cores.
While these databases could be
running either online transaction
processing (OLTP) or analytical
workloads, more often than not,
they are systems of record (SoRs)
running OLTP; the analytical systems are special-purpose appliances in most customer shops.
This article presents two studies
that demonstrate tremendous
value in co-locating the analytics
workload with the systems of
record on Linux on z Systems.

An Important Role

Analytics drives competitive
differentiation for many
companies. Therefore, it is hot
on CEOs' radar. As a result,
new chief data officer and chief

analytics officer positions have
been added in the C-suite of
most companies.
Digital business is all about
speed, which drives the need
for real-time analytics directly
on top of the OLTP data. This
type of analytics is also called
operational analytics. There's
also deep analytics that
consists of queries run against
historical and unified data from
an enterprise stored in data
warehouses and marts.
Operational analytics consist of short running queries,
whereas deep analytics are long
running, for they often involve a
full table scan of extremely large
fact tables consisting of billions
of rows of measures that are then
sliced and diced using a dimension table consisting of attributes
such as product, demographics,
time, etc.
We conducted two studies
using best-of-breed in-memory
technologies Spark and DB2*
BLU for the operational and deep
analytics scenarios, respectively.
The first study involves
an operational analytics
scenario, where a supervisor

of a brokerage firm wants to
examine the performance of
brokers in terms of total trade
amount handled in real time.
The brokerage OLTP database
in this case is hosted on Linux
on z Systems. Spark SQL was
used to run the aggregate query
to measure the performance
of the brokers. The database
is over 100 GB in size, and the
trade table across which the
aggregate query is computed has
over 360 million rows of trading
transactions.
We ran an apples-to-apples
test running Spark on the same
number of cores on z Systems as
an x86 server and obtained up to
3x higher throughput co-locating
Spark with the OLTP database
on the same platform. Spark
provides a universal OS for endto-end analytics and, though we
tested with SparkSQL, we expect
similar throughput benefits
for co-location for other Spark
modules, such as MLib, GraphX
and Streaming.
The second study is for deep
analytics on a 2.5 TB data mart,
containing data from a retail
store with multiple channels (in

22 // NOVEMBER 2016 Linux on z Systems

Linux_on_z_1116.indd 22

9/29/16 1:15 PM



Table of Contents for the Digital Edition of IBM Systems Magazine, Mainframe - November/December 2016

Editor's Desk: Mastering their craft
IBM Perspective: Expanding mainframe ecosystem creates opportunities for Gen Z
Partner PoV: Workplace Diversity: Attract the best talent by encouraging more options for women
IT Today: Financial Feasibility: IBM Global Financing designs customized solutions for technology investments
Currents: Giving Data Structure: Find the right database management systems to maximize information
Case Study: Investing in a Difference: Primerica Life Insurance Co. improves processing and performance
Cover Story: Sparking Student Interest: IBM Master the Mainframe World Championship exposes top students to analytics and data storage
Feature: The Modern Mainframer: The IBM z platform attracts recent grads to its orbit
Women in Tech: Taking a Seat at the IT Table: Women meet challenges, savor successes in the IT field
Tech Corner: Get in the Cloud: z/OS solutions can connect to the cloud through REST interfaces
Solutions: API Integration Platform 3.0, OpenLegacy; Ivory Service Architect V5.1, GT Software
Stop Run: Code Your Own Way: High school girls take charge of their futures
Reference Point - Global Events, Education, Resources for Mainframe
Linux on z Systems E-book
2016 Mainframe Solutions Edition Product Index
IBM Systems Magazine, Mainframe - November/December 2016 - Intro
IBM Systems Magazine, Mainframe - November/December 2016 - Cover1
IBM Systems Magazine, Mainframe - November/December 2016 - Cover2
IBM Systems Magazine, Mainframe - November/December 2016 - 1
IBM Systems Magazine, Mainframe - November/December 2016 - 2
IBM Systems Magazine, Mainframe - November/December 2016 - 3
IBM Systems Magazine, Mainframe - November/December 2016 - 4
IBM Systems Magazine, Mainframe - November/December 2016 - 5
IBM Systems Magazine, Mainframe - November/December 2016 - Editor's Desk: Mastering their craft
IBM Systems Magazine, Mainframe - November/December 2016 - 7
IBM Systems Magazine, Mainframe - November/December 2016 - IBM Perspective: Expanding mainframe ecosystem creates opportunities for Gen Z
IBM Systems Magazine, Mainframe - November/December 2016 - Partner PoV: Workplace Diversity: Attract the best talent by encouraging more options for women
IBM Systems Magazine, Mainframe - November/December 2016 - 10
IBM Systems Magazine, Mainframe - November/December 2016 - IT Today: Financial Feasibility: IBM Global Financing designs customized solutions for technology investments
IBM Systems Magazine, Mainframe - November/December 2016 - 12
IBM Systems Magazine, Mainframe - November/December 2016 - 13
IBM Systems Magazine, Mainframe - November/December 2016 - Currents: Giving Data Structure: Find the right database management systems to maximize information
IBM Systems Magazine, Mainframe - November/December 2016 - 15
IBM Systems Magazine, Mainframe - November/December 2016 - 16
IBM Systems Magazine, Mainframe - November/December 2016 - 17
IBM Systems Magazine, Mainframe - November/December 2016 - Case Study: Investing in a Difference: Primerica Life Insurance Co. improves processing and performance
IBM Systems Magazine, Mainframe - November/December 2016 - 19
IBM Systems Magazine, Mainframe - November/December 2016 - 20
IBM Systems Magazine, Mainframe - November/December 2016 - 21
IBM Systems Magazine, Mainframe - November/December 2016 - 22
IBM Systems Magazine, Mainframe - November/December 2016 - 23
IBM Systems Magazine, Mainframe - November/December 2016 - Cover Story: Sparking Student Interest: IBM Master the Mainframe World Championship exposes top students to analytics and data storage
IBM Systems Magazine, Mainframe - November/December 2016 - 25
IBM Systems Magazine, Mainframe - November/December 2016 - 26
IBM Systems Magazine, Mainframe - November/December 2016 - 27
IBM Systems Magazine, Mainframe - November/December 2016 - Feature: The Modern Mainframer: The IBM z platform attracts recent grads to its orbit
IBM Systems Magazine, Mainframe - November/December 2016 - 29
IBM Systems Magazine, Mainframe - November/December 2016 - 30
IBM Systems Magazine, Mainframe - November/December 2016 - 31
IBM Systems Magazine, Mainframe - November/December 2016 - 32
IBM Systems Magazine, Mainframe - November/December 2016 - Women in Tech: Taking a Seat at the IT Table: Women meet challenges, savor successes in the IT field
IBM Systems Magazine, Mainframe - November/December 2016 - 34
IBM Systems Magazine, Mainframe - November/December 2016 - 35
IBM Systems Magazine, Mainframe - November/December 2016 - 36
IBM Systems Magazine, Mainframe - November/December 2016 - 37
IBM Systems Magazine, Mainframe - November/December 2016 - 38
IBM Systems Magazine, Mainframe - November/December 2016 - 39
IBM Systems Magazine, Mainframe - November/December 2016 - 40
IBM Systems Magazine, Mainframe - November/December 2016 - 41
IBM Systems Magazine, Mainframe - November/December 2016 - 42
IBM Systems Magazine, Mainframe - November/December 2016 - 43
IBM Systems Magazine, Mainframe - November/December 2016 - Tech Corner: Get in the Cloud: z/OS solutions can connect to the cloud through REST interfaces
IBM Systems Magazine, Mainframe - November/December 2016 - 45
IBM Systems Magazine, Mainframe - November/December 2016 - 46
IBM Systems Magazine, Mainframe - November/December 2016 - Solutions: API Integration Platform 3.0, OpenLegacy; Ivory Service Architect V5.1, GT Software
IBM Systems Magazine, Mainframe - November/December 2016 - Stop Run: Code Your Own Way: High school girls take charge of their futures
IBM Systems Magazine, Mainframe - November/December 2016 - Cover3
IBM Systems Magazine, Mainframe - November/December 2016 - Cover4
IBM Systems Magazine, Mainframe - November/December 2016 - Reference Point - Global Events, Education, Resources for Mainframe
IBM Systems Magazine, Mainframe - November/December 2016 - RF2
IBM Systems Magazine, Mainframe - November/December 2016 - Linux on z Systems E-book
IBM Systems Magazine, Mainframe - November/December 2016 - L2
IBM Systems Magazine, Mainframe - November/December 2016 - L3
IBM Systems Magazine, Mainframe - November/December 2016 - L4
IBM Systems Magazine, Mainframe - November/December 2016 - L5
IBM Systems Magazine, Mainframe - November/December 2016 - L6
IBM Systems Magazine, Mainframe - November/December 2016 - L7
IBM Systems Magazine, Mainframe - November/December 2016 - L8
IBM Systems Magazine, Mainframe - November/December 2016 - L9
IBM Systems Magazine, Mainframe - November/December 2016 - L10
IBM Systems Magazine, Mainframe - November/December 2016 - L11
IBM Systems Magazine, Mainframe - November/December 2016 - L12
IBM Systems Magazine, Mainframe - November/December 2016 - L13
IBM Systems Magazine, Mainframe - November/December 2016 - L14
IBM Systems Magazine, Mainframe - November/December 2016 - L15
IBM Systems Magazine, Mainframe - November/December 2016 - L16
IBM Systems Magazine, Mainframe - November/December 2016 - L17
IBM Systems Magazine, Mainframe - November/December 2016 - L18
IBM Systems Magazine, Mainframe - November/December 2016 - L19
IBM Systems Magazine, Mainframe - November/December 2016 - L20
IBM Systems Magazine, Mainframe - November/December 2016 - L21
IBM Systems Magazine, Mainframe - November/December 2016 - L22
IBM Systems Magazine, Mainframe - November/December 2016 - L23
IBM Systems Magazine, Mainframe - November/December 2016 - 2016 Mainframe Solutions Edition Product Index
IBM Systems Magazine, Mainframe - November/December 2016 - SE2
IBM Systems Magazine, Mainframe - November/December 2016 - SE3
IBM Systems Magazine, Mainframe - November/December 2016 - SE4
IBM Systems Magazine, Mainframe - November/December 2016 - SE5
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20191112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/relevantz_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2019mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20181112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2018mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20171112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_sesupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_linuxsupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20161112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/MainframeSecurity
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20151112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910_se
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910
http://www.ibmsystemsmagmainframedigital.com/MFSkills
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506_supp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20141112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_gt_201405
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/BigData
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20131112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20121112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/buyersguide2013
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/ibmsystems_mainframe_2012bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20111112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20101112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910_bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20091112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090506
http://www.nxtbook.com/nxtbooks/ibmsystemsmag/mainframe_20090304
http://www.nxtbook.com/nxtbooks/mspcomm/ibmsystems_mainframe_200901
http://www.nxtbookMEDIA.com