IBM Systems Magazine, Mainframe - March/April 2017 - 23


the historical and real-time data. In
order to react intelligently in real
time, we use machine learning on
the historical data to understand
the expected traffic behavior for
each city location and time period.
That way, we know how to react
based on context, such as location
in the city (busy city intersection or
suburban outskirts) and whether
it's a rush-hour period or not.
ISM: How will this help the
Madrid Council?
PTS: We're helping them become
more efficient in the control rooms
where they currently employ a
lot of people looking at traffic
screens and manually managing
traffic. We cluster the traffic into
so-called good and bad traffic.
This way, when traffic in a certain
location moves from good to bad,
we can raise an alert that might
trigger notification of the Madrid
bus company, alert passengers on
highways via information panels
or call for emergency vehicles.
Our work can help those in the
control rooms react faster. The possibility of automating the response
with little or no human intervention also exists. For example,
one could imagine an automatic
system for adjusting traffic-light
behavior according to the current
traffic conditions.
We have new speed and intensity
readings [showing the amount of
vehicles] coming in around every
five minutes. If we're looking just
at the city of Madrid, the rate of
data coming in is moderate. But
you can imagine this extended to
many other cities or areas around
the world.
It's important that the machine
learning for different locations and
time periods is done ahead of time.
When new data comes in, we've
already calculated thresholds that
tell us if we're switching from good
traffic to bad traffic. And as that
comes in, the machine-learning

"IoT is leading
the way to
new types of
data being
collected in
unprecedented
quantities."
-Paula Ta-Shma, research staff member,
IBM Research-Haifa

models may need to change over time, so we have a
technique that tells us when our clustering gets out of
whack and we need to run it again.
We're also using a dashboard that monitors traffic
at different locations in Madrid with the capability
to display alerts in locations where the speed or the
intensity of traffic goes beyond a certain threshold.
That threshold is calculated using machine learning.
It's different for each location and for rush-hour periods versus nighttime periods, and so on.
ISM: How do OpenStack Swift and Apache
Spark come into play?
PTS: OpenStack Swift is a scalable, low-cost way
to store data. This is crucial for IoT data, which is
quickly becoming the "biggest" big data ever. That's
because so many things are connecting to the internet
and generating data. We're also making it more
efficient to analyze data on OpenStack Swift for our
machine-learning computations.
Apache Spark is a cluster-computing framework
that enables analytics to be done on the data. So,
OpenStack Swift provides the storage, and Apache
Spark provides the compute power for the analytics.
It's doing the machine learning and computation on
the data.
ISM: So, you combined Swift and Spark to
work almost as a single entity?
PTS: We're also using other open-source tools we
helped play nicely together. Apache Kafka and Pinterest Secor are used as a message hub and a way to get
the data into Swift. Apache Parquet, a special-data
format, is good for analytics in general and for IoT
data in particular. We use Elasticsearch to make the
analytics more efficient, and IBM Node-RED hooks
together systems and sensors to improve the management of the IoT.

It's a complex challenge. Clients
don't just want to run the solution
on their laptops. They want it
to be deployed in the cloud and
scalable so they can start with a
small amount of data or number
of users and grow elastically. One
of the exciting outcomes of our
work is our collaboration with
another IBM team, led by Naeem
Altaf, to port the whole Madrid
traffic use case to run on the IBM
Bluemix* platform.
ISM: How can this technology
be used?
PTS: In COSMOS, for example,
we did some work on occupancy
detection and the ability to save
energy by turning appliances off
when people have left their home
or office. You can potentially do
similar work with other types of
sensors collecting data.
For example, by putting sensors
along pipes and performing
anomaly detection, you can detect
and send a warning if a pipe leaks.
You can even build actuators into
your solutions so that when a pipe
is leaking, the mains automatically
shut off to prevent further damage
to your home. If a company has
an oil pipeline traveling across
the country, you could use similar
technology to help avoid an
environmental disaster.
ISM: Where do you see the
IoT heading in the future?
PTS: IoT is leading the way to
new types of data being collected
in unprecedented quantities.
For example, in healthcare, you
may use this technology to get
more insight into the reasons
behind illnesses.
For traffic, we could gain new
insight into the conditions and
locations under which accidents
occur. Having this additional data
can provide new opportunities and
approaches we may never have
considered before.

ibmsystemsmag.com MARCH/APRIL 2017 // 23

pg 22-23.indd 3

2/7/17 1:27 PM


http://www.ibmsystemsmag.com

Table of Contents for the Digital Edition of IBM Systems Magazine, Mainframe - March/April 2017

Table of Contents
Editor's Desk: Ahead of the Times
Techbits: Cognitive Customer Engagement
Partner PoV: Keep Data Out of Danger: Use the right tools to implement your large-object strategy
Currents: A Layered Approach: Using microservices on z Systems with CICS improves flexibility and reliability
IT Today: Choosing the Right Cloud: What to consider when using a managed service provider
R&D: Move Along: IBM Research and partners help traffic run smoothly in Madrid
Trends: How to Improve Your Sales Skills: Tips for techies on showing the value of their services
Feature: Strength in Collaboration: Linux on z Systems accelerates new and traditional workloads
Feature: Community Computing: The Open Mainframe Project expands educational opportunities for Linux on z Systems users
TECH Showcase: Shift-Left Testing Improves Success: Automated testing in the DevOps cycle improves quality and reduces risk
Tech Corner: Database Development: IBM DB2 V12 enhances and integrates data for cloud, mobile and analytics
Solutions: SMART TS XL V8.0, IN-COM Data Systems; Tubes, Macro 4; CleverView for TCP/IP on Linux V2.5, AES
Stop Run: A Global View: Computer science and astrophysics prove a natural fit
Reference Point - Global Events, Education, Resources for Mainframe
2017 Mainframe Solutions Edition
IBM Systems Magazine, Mainframe - March/April 2017 - Intro
IBM Systems Magazine, Mainframe - March/April 2017 - Cover1
IBM Systems Magazine, Mainframe - March/April 2017 - Cover2
IBM Systems Magazine, Mainframe - March/April 2017 - 1
IBM Systems Magazine, Mainframe - March/April 2017 - Table of Contents
IBM Systems Magazine, Mainframe - March/April 2017 - 3
IBM Systems Magazine, Mainframe - March/April 2017 - 4
IBM Systems Magazine, Mainframe - March/April 2017 - 5
IBM Systems Magazine, Mainframe - March/April 2017 - Editor's Desk: Ahead of the Times
IBM Systems Magazine, Mainframe - March/April 2017 - 7
IBM Systems Magazine, Mainframe - March/April 2017 - Techbits: Cognitive Customer Engagement
IBM Systems Magazine, Mainframe - March/April 2017 - 9
IBM Systems Magazine, Mainframe - March/April 2017 - 10
IBM Systems Magazine, Mainframe - March/April 2017 - 11
IBM Systems Magazine, Mainframe - March/April 2017 - Partner PoV: Keep Data Out of Danger: Use the right tools to implement your large-object strategy
IBM Systems Magazine, Mainframe - March/April 2017 - 13
IBM Systems Magazine, Mainframe - March/April 2017 - Currents: A Layered Approach: Using microservices on z Systems with CICS improves flexibility and reliability
IBM Systems Magazine, Mainframe - March/April 2017 - 15
IBM Systems Magazine, Mainframe - March/April 2017 - 16
IBM Systems Magazine, Mainframe - March/April 2017 - 17
IBM Systems Magazine, Mainframe - March/April 2017 - IT Today: Choosing the Right Cloud: What to consider when using a managed service provider
IBM Systems Magazine, Mainframe - March/April 2017 - 19
IBM Systems Magazine, Mainframe - March/April 2017 - 20
IBM Systems Magazine, Mainframe - March/April 2017 - 21
IBM Systems Magazine, Mainframe - March/April 2017 - R&D: Move Along: IBM Research and partners help traffic run smoothly in Madrid
IBM Systems Magazine, Mainframe - March/April 2017 - 23
IBM Systems Magazine, Mainframe - March/April 2017 - Trends: How to Improve Your Sales Skills: Tips for techies on showing the value of their services
IBM Systems Magazine, Mainframe - March/April 2017 - 25
IBM Systems Magazine, Mainframe - March/April 2017 - 26
IBM Systems Magazine, Mainframe - March/April 2017 - 27
IBM Systems Magazine, Mainframe - March/April 2017 - Feature: Strength in Collaboration: Linux on z Systems accelerates new and traditional workloads
IBM Systems Magazine, Mainframe - March/April 2017 - 29
IBM Systems Magazine, Mainframe - March/April 2017 - 30
IBM Systems Magazine, Mainframe - March/April 2017 - 31
IBM Systems Magazine, Mainframe - March/April 2017 - 32
IBM Systems Magazine, Mainframe - March/April 2017 - 33
IBM Systems Magazine, Mainframe - March/April 2017 - Feature: Community Computing: The Open Mainframe Project expands educational opportunities for Linux on z Systems users
IBM Systems Magazine, Mainframe - March/April 2017 - 35
IBM Systems Magazine, Mainframe - March/April 2017 - 36
IBM Systems Magazine, Mainframe - March/April 2017 - 37
IBM Systems Magazine, Mainframe - March/April 2017 - 38
IBM Systems Magazine, Mainframe - March/April 2017 - 39
IBM Systems Magazine, Mainframe - March/April 2017 - 40
IBM Systems Magazine, Mainframe - March/April 2017 - 41
IBM Systems Magazine, Mainframe - March/April 2017 - 42
IBM Systems Magazine, Mainframe - March/April 2017 - 43
IBM Systems Magazine, Mainframe - March/April 2017 - 44
IBM Systems Magazine, Mainframe - March/April 2017 - TECH Showcase: Shift-Left Testing Improves Success: Automated testing in the DevOps cycle improves quality and reduces risk
IBM Systems Magazine, Mainframe - March/April 2017 - 46
IBM Systems Magazine, Mainframe - March/April 2017 - 47
IBM Systems Magazine, Mainframe - March/April 2017 - 48
IBM Systems Magazine, Mainframe - March/April 2017 - 49
IBM Systems Magazine, Mainframe - March/April 2017 - Tech Corner: Database Development: IBM DB2 V12 enhances and integrates data for cloud, mobile and analytics
IBM Systems Magazine, Mainframe - March/April 2017 - 51
IBM Systems Magazine, Mainframe - March/April 2017 - 52
IBM Systems Magazine, Mainframe - March/April 2017 - 53
IBM Systems Magazine, Mainframe - March/April 2017 - 54
IBM Systems Magazine, Mainframe - March/April 2017 - Solutions: SMART TS XL V8.0, IN-COM Data Systems; Tubes, Macro 4; CleverView for TCP/IP on Linux V2.5, AES
IBM Systems Magazine, Mainframe - March/April 2017 - Stop Run: A Global View: Computer science and astrophysics prove a natural fit
IBM Systems Magazine, Mainframe - March/April 2017 - Cover3
IBM Systems Magazine, Mainframe - March/April 2017 - Cover4
IBM Systems Magazine, Mainframe - March/April 2017 - Reference Point - Global Events, Education, Resources for Mainframe
IBM Systems Magazine, Mainframe - March/April 2017 - 2017 Mainframe Solutions Edition
IBM Systems Magazine, Mainframe - March/April 2017 - SE2
IBM Systems Magazine, Mainframe - March/April 2017 - SE3
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20191112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/relevantz_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2019mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20190102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20181112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20180102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/2018mfse
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20171112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_sesupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20170102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_linuxsupp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20161112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/MainframeSecurity
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20160102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20151112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910_se
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150910
http://www.ibmsystemsmagmainframedigital.com/MFSkills
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506_supp
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20150102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20141112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_gt_201405
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/BigData
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20140102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20131112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910_v2
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20130102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20121112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/buyersguide2013
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20120102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/ibmsystems_mainframe_2012bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20111112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20110102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20101112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100910_bg
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100506
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100304
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20100102
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20091112
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090910
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090708
http://www.ibmsystemsmagmainframedigital.com/nxtbooks/ibmsystemsmag/mainframe_20090506
http://www.nxtbook.com/nxtbooks/ibmsystemsmag/mainframe_20090304
http://www.nxtbook.com/nxtbooks/mspcomm/ibmsystems_mainframe_200901
http://www.nxtbookMEDIA.com