Introducing SOA to Batch Processing

nid

4249

vid

6588

type

naspa_articles

status

1

created

1190916356

changed

1190916452

comment

2

promote

0

sticky

0

revision_timestamp

1190916452

title

Introducing SOA to Batch Processing

body

<p>&nbsp;</p> <p>The impact of services-oriented architecture (SOA) is just beginning to be felt in the batch world-and the challenges are clearly present. Batch legacy applications have been around for years, capably running the business. Now, initiatives like SOA are forcing new integration and interoperability requirements on batch processes that had comfortably been categorized as &quot;untouchable.&quot; These processes have to interoperate with online and Web batch applications.</p> <p>&quot;The problem with integrating legacy batch processes is that they didn&#39;t need standard interfaces to other applications back in the days when they were written,&quot; said Sal Del Conte, an independent consultant for data center business process improvement. &quot;Data centers today are challenged with being able to move data along by communicating between applications, and at the same time they&#39;re faced with SOA, which has been endorsed by IBM and other vendors....There has to be a way for applications regardless of platform to communicate with each other in an easy manner so you can make changes to a given batch application or system and not negatively impact other applications.&quot;</p><strong>Taking a &quot;Big Picture&quot; Look at Batch</strong> <p>By having standard interfaces between batch applications and systems, sites have the flexibility to revise their batch processes. The goal for most data centers is to position themselves to take a &quot;big picture&quot; look at both their batch legacy applications and their non-mainframe batch distributed applications.</p> <p>&quot;Sites want the ability to reengineer their batch applications and systems, while eliminating all of the redundancies at the same time,&quot; said Del Conte. &quot;You can find good examples of this in large financial services and insurance companies, where many of the applications in their legacy-based systems are performing exactly the same function.... With SOA, the goal is to have common, callable modules performing common functions.&quot;</p><strong>Step by Step Batch Process Revision</strong> <p>Moving batch processes to a flexible SOA environment is daunting. It is a process best pursued in progressively small steps. &quot;You can take one step at a time with your batch environment by starting with applying a methodology to reengineer and optimize your JCL,&quot; said Del Conte. &quot;A second step might be to look at the batch code within a given silo application, like a General Ledger. You can ask yourself, &quot;What is the batch code doing? How can I change the code to make it run more effectively?&#39;&quot;</p> <p>A third step is to purchase a package that monitors the processes, and that furnishes analytics that allow you to make buffering and caching changes. Once all of these areas are addressed, sites are then in a position to look at the end to end heterogeneous environment of their batch processing, and what it is going to take to efficiently move data from one platform to another.</p> <p>Tools like <a href="/freelinking/WebSphere">WebSphere</a> give sites the capability to look at system interfaces and to cross-reference data between disparate hardware and software platforms. The analysis provides visibility of where and how data is used across processes. Sites can then go back into systems to standardize data and data flows.</p> <p>&quot;Once your data is standardized, you can test and parallel run the revised applications,&quot; said Del Conte. &quot;You are then in a position to optimize the operations and the resources of the data center with the flexibility of SOA-enabled batch applications. The flexibility allows for application recombinations and ease of provisioning. Enterprise deployment for new batch business applications becomes less risky.&quot;</p><strong>Managing the Risk</strong> <p>Risk management is a central concern when it comes to reengineering batch processes to fit the SOA environment. By standardizing applications first, and by using data analysis tools such as <a href="/freelinking/WebSphere">WebSphere</a> to document the data inputs and outputs to each batch process, potential risk is greatly reduced because the potential for error and the level of confusion are lower, and the level of control is greater.</p> <p>&quot;When you move batch processing to SOA, you have new capabilities of workload management and for the alteration of workflows to respond to changing business conditions,&quot; said Del Conte. &quot;The system can determine where to run a new application, what resources might not be available, and what resources to commit in order to maximize workloads. SOA and standard interfaces between batch processes allow this to happen.&quot; This flexibility makes positive contributions to failover, since non-functioning components in the network can be readily detected and reallocated elsewhere.</p><strong>Coping with Fear Factors</strong> <p>Although there are clear pathways to SOA for batch processing, there are also substantial fear factors for IT at both the executive and staff levels.</p> <p>Hesitance at the executive IT level starts with how to explain the value proposition of committing internal and potentially external resources to modernizing batch processes that have worked well for years. Upper business management isn&#39;t going to understand the technicalities of SOA, and &quot;plain English&quot; ways have to be found to communicate the value to the business of revamping batch processes.</p> <p>&quot;The mere promise of reduced risk won&#39;t do it, because corporate executives will tend to view it like an insurance policy and just say that they&#39;ll accept the risk,&quot; said Sal Del Conte. &quot;Instead, an IT executive has to be able to explain the benefits of SOA-enabled batch as a way to improve customer service, the efficiencies of business operation, on-demand computing and order fulfillment.&quot;</p> <p>Another way to demonstrate the benefit of SOA-enabled batch is to demonstrate results. This can be done by isolating a subset of batch processes, standardizing interfaces and reengineering them for optimum efficiency, and demonstrating the results in tangible business results for upper management. Once the results are seen, management is more likely to sign on for additional batch revision work that will further help the business. </p> <p>&quot;Selling a new technology approach can be very challenging, especially when the value is very apparent to an IT executive from an IT standpoint but difficult to convey from the point of view of the end business,&quot; said Del Conte. &quot;Nevertheless, this is what has to be done to build support for the project in the business.&quot;</p> <p>IT managers must also cope with the trepidation of their own staffs-who already have large workloads, and would not like to deal with processes that are &quot;already working.&quot;</p> <p>There are additional fear factors at the IT staff level, because many of these batch processes were written over 30 years ago. There literally is no one left on the staff who knows precisely how these batch processes work, or how they were put together-and nobody wants to be the one to introduce error.</p> <p>&quot;My number one recommendation in this situation is for IT staff to begin with a batch system that it is familiar with,&quot; said Del Conte. &quot;This allows IT to get comfortable and to build confidence with revising batch. When they implement the finished product, they will see the business value. They may not understand everything that happens within a given batch system, but modern toolsets allow them to see the inputs and the outputs to these systems, and to at least standardize the interfaces between batch systems and processes. By adding standardized interfaces to batch, IT places itself and the end business in a position to Webinize or replace these modules of batch code in an SOA process when and where it is needed.&quot;</p> <em>NaSPA member Mary E. Shacklett is President of Transworld Data. She is listed in Who&#39;s Who Worldwide and in Who&#39;s Who in the Computer Industry</em> <br class="clear" />

teaser

<p>&nbsp;</p> <p>The impact of services-oriented architecture (SOA) is just beginning to be felt in the batch world-and the challenges are clearly present. Batch legacy applications have been around for years, capably running the business. Now, initiatives like SOA are forcing new integration and interoperability requirements on batch processes that had comfortably been categorized as &quot;untouchable.&quot; These processes have to interoperate with online and Web batch applications.</p>

log

format

7

uid

2184

name

jkasza

picture

data

a:27:{s:5:"roles";a:1:{i:0;s:1:"2";}s:13:"AMISDB_MBRPFX";s:1:" ";s:13:"AMISDB_MBRFNM";s:5:"Jenny";s:12:"AMISDB_MBRMI";s:1:" ";s:13:"AMISDB_MBRLNM";s:5:"Kasza";s:13:"AMISDB_MBRSFX";s:1:" ";s:12:"AMISDB_EMAIL";s:16:"editor@naspa.com";s:12:"AMISDB_mtype";s:5:"STAFF";s:15:"AMISDB_orgmbrdt";s:10:"08/08/2006";s:15:"AMISDB_trmstart";s:10:"08/08/2006";s:13:"AMISDB_trmend";s:10:"07/31/2010";s:15:"AMISDB_COMPBILL";s:3:"TEI";s:15:"AMISDB_ADDRBILL";s:18:"7044 S 13TH STREET";s:15:"AMISDB_CITYBILL";s:9:"OAK CREEK";s:16:"AMISDB_STATEBILL";s:2:"WI";s:15:"AMISDB_CTRYBILL";s:3:"USA";s:15:"AMISDB_COMPMAIL";s:3:"TEI";s:15:"AMISDB_ADDRMAIL";s:18:"7044 S 13TH STREET";s:15:"AMISDB_CITYMAIL";s:9:"OAK CREEK";s:16:"AMISDB_STATEMAIL";s:2:"WI";s:15:"AMISDB_CTRYMAIL";s:3:"USA";s:8:"og_email";s:1:"1";s:14:"tinymce_status";s:4:"true";s:14:"picture_delete";s:0:"";s:14:"picture_upload";s:0:"";s:7:"contact";i:1;s:5:"block";a:5:{s:4:"book";a:1:{i:0;i:1;}s:4:"menu";a:1:{i:2560;i:1;}s:15:"taxonomy_ticker";a:1:{i:0;i:1;}s:4:"user";a:1:{i:3;i:1;}s:10:"statistics";a:1:{i:0;i:0;}}}

tags

Array
(
    [5] => Array
        (
            [1729] => stdClass Object
                (
                    [tid] => 1729
                    [vid] => 5
                    [name] => Batch
                    [description] => 
                    [weight] => 0
                )

            [1280] => stdClass Object
                (
                    [tid] => 1280
                    [vid] => 5
                    [name] => SOA
                    [description] => 
                    [weight] => 0
                )

        )

)

primary_term

last_comment_timestamp

1190916356

last_comment_name

NULL

comment_count

0

taxonomy

Array
(
    [1729] => stdClass Object
        (
            [tid] => 1729
            [vid] => 5
            [name] => Batch
            [description] => 
            [weight] => 0
        )

    [1280] => stdClass Object
        (
            [tid] => 1280
            [vid] => 5
            [name] => SOA
            [description] => 
            [weight] => 0
        )

    [501] => stdClass Object
        (
            [tid] => 501
            [vid] => 18
            [name] => Shacklett, Mary E.
            [description] => <p><em>NaSPA member Mary E. Shacklett is President of Transworld Data. She is listed in Who&#39;s Who Worldwide and in Who&#39;s Who in the Computer Industry.</em></p>
            [weight] => 0
        )

    [1592] => stdClass Object
        (
            [tid] => 1592
            [vid] => 14
            [name] => Technical Support - August 2007
            [description] => 
            [weight] => 0
        )

)

files

Array
(
)

field_author

Array
(
    [0] => Array
        (
            [value] => Mary Shacklett
            [view] => Mary Shacklett
        )

)

field_description

Array
(
    [0] => Array
        (
            [value] => This article tackles the subject of combining Service Oriented Architecture (SOA) with the world of batch processing. It points out the benefits and also looks at the fears and hesitance on the part of IT staff. 
            [format] => 1
        )

)

field_article_pdf

Array
(
)

field_item_type

Array
(
    [0] => Array
        (
            [value] => Article
        )

)

field_article_cost

Array
(
    [0] => Array
        (
            [value] => 400
        )

)

field_temppdf

Array
(
    [0] => Array
        (
            [value] => 
        )

)

iid

links_related

Array
(
)

moderate

0

readmore

1

content

Array
(
    [body] => Array
        (
            [#value] => 
<p>&nbsp;</p>

<p>The impact of services-oriented architecture (SOA) is just beginning
to be felt in the batch world-and the challenges are clearly present. Batch
legacy applications have been around for years, capably running the
business.  Now, initiatives like SOA are
forcing new integration and interoperability requirements on batch processes
that had comfortably been categorized as 
&quot;untouchable.&quot; These processes have to interoperate with online and Web
batch applications.</p>



<p>&quot;The problem with integrating legacy batch processes is that
they didn&#39;t need standard interfaces to other applications back in the days
when they were written,&quot; said Sal Del Conte, an independent consultant for data
center business process improvement. &quot;Data centers today are challenged with
being able to move data along by communicating between applications, and at the
same time they&#39;re faced with SOA, which has been endorsed by IBM and other
vendors....There has to be a way for applications regardless of platform to
communicate with each other in an easy manner so you can make changes to a
given batch application or system and not negatively impact other
applications.&quot;</p><strong>Taking a &quot;Big
Picture&quot; Look at Batch</strong>



<p>By having standard interfaces between batch applications and
systems, sites have the flexibility to revise their batch processes. The goal
for most data centers is to position themselves to take a &quot;big picture&quot; look at
both their batch legacy applications and their non-mainframe batch distributed
applications.</p>



<p>&quot;Sites want the ability to reengineer their batch
applications and systems, while eliminating all of the redundancies at the same
time,&quot; said Del Conte. &quot;You can find good examples of this in large financial
services and insurance companies, where many of the applications in their
legacy-based systems are performing exactly the same function.... With SOA, the
goal is to have common, callable modules performing common functions.&quot;</p><strong>Step by Step Batch
Process Revision</strong>



<p>Moving batch processes to a flexible SOA environment is
daunting. It is a process best pursued in progressively small steps. &quot;You can
take one step at a time with your batch environment by starting with applying a
methodology to reengineer and optimize your JCL,&quot; said Del Conte. &quot;A second
step might be to look at the batch code within a given silo application, like a
General Ledger. You can ask yourself, &quot;What is the batch code doing? How can I
change the code to make it run more effectively?&#39;&quot;</p>



<p>A third step is to purchase a package that monitors the
processes, and that furnishes analytics that allow you to make  buffering and caching changes. Once all of
these areas are addressed, sites are then in a position to look at the end to
end heterogeneous environment of their batch processing, and what it is going
to take to efficiently move data from one platform to another.</p>



<p>Tools like <a href="/freelinking/WebSphere">WebSphere</a> give sites the capability to look at system
interfaces and to cross-reference data between disparate hardware and software platforms.
The analysis provides visibility of where and how data is used across
processes. Sites can then go back into systems to standardize data and data
flows.</p>



<p>&quot;Once your data is standardized, you can test and parallel
run the revised applications,&quot; said Del Conte. &quot;You are then in a position to
optimize the operations and the resources of the data center with the flexibility
of SOA-enabled batch applications. The flexibility allows for application recombinations
and ease of provisioning. Enterprise
deployment for new batch business applications becomes less risky.&quot;</p><strong>Managing the Risk</strong>



<p>Risk management is a central concern when it comes to
reengineering batch processes to fit the SOA environment.  By standardizing applications first, and by
using data analysis tools such as <a href="/freelinking/WebSphere">WebSphere</a> to document the data inputs and outputs
to each batch process, potential risk is greatly reduced because the potential
for error and the level of confusion are lower, and the level of control is
greater.</p>



<p>&quot;When you move batch processing to SOA, you have new capabilities
of workload management and for the alteration of workflows to respond to changing
business conditions,&quot; said Del Conte. &quot;The system can determine where to run a
new application, what resources might not be available, and what resources to commit
in order to maximize workloads. SOA and standard interfaces between batch
processes allow this to happen.&quot;  This
flexibility makes positive contributions to failover, since non-functioning
components in the network can be readily detected and reallocated elsewhere.</p><strong>Coping with Fear
Factors</strong>



<p>Although there are clear pathways to SOA for batch
processing, there are also substantial fear factors for IT at both the
executive and staff levels.</p>



<p>Hesitance at the executive IT level starts with how to
explain the value proposition of committing internal and potentially external
resources to modernizing batch processes that have worked well for years. Upper
business management isn&#39;t going to understand the technicalities of SOA, and
&quot;plain English&quot; ways have to be found to communicate the value to the business
of revamping batch processes.</p>



<p>&quot;The mere promise of reduced risk won&#39;t do it, because
corporate executives will tend to view it like an insurance policy and just say
that they&#39;ll accept the risk,&quot; said Sal Del Conte. &quot;Instead, an IT executive
has to be able to explain the benefits of SOA-enabled batch as a way to improve
customer service, the efficiencies of business operation, on-demand computing
and order fulfillment.&quot;</p>



<p>Another way to demonstrate the benefit of SOA-enabled batch
is to demonstrate results. This can be done by isolating a subset of batch
processes, standardizing interfaces and reengineering them for optimum
efficiency, and demonstrating the results in tangible business results for
upper management. Once the results are seen, management is more likely to sign
on for additional batch revision work that will further help the business.  </p>



<p>&quot;Selling a new technology approach can be very challenging,
especially when the value is very apparent to an IT executive from an IT
standpoint but difficult to convey from the point of view of the end business,&quot;
said Del Conte. &quot;Nevertheless, this is what has to be done to build support for
the project in the business.&quot;</p>



<p>IT managers must also cope with the trepidation of their own
staffs-who already have large workloads, and would not like to deal with
processes that are &quot;already working.&quot;</p>



<p>There are additional fear factors at the IT staff level,
because many of these batch processes were written over 30 years ago. There
literally is no one left on the staff who knows precisely how these batch
processes work, or how they were put together-and nobody wants to be the one to
introduce error.</p>



<p>&quot;My number one recommendation in this situation is for IT
staff to begin with a batch system that it is familiar with,&quot; said Del Conte.
&quot;This allows IT to get comfortable and to build confidence with revising batch.
When they implement the finished product, they will see the business value.
They may not understand everything that happens within a given batch system,
but modern toolsets allow them to see the inputs and the outputs to these
systems, and to at least standardize the interfaces between batch systems and
processes. By adding standardized interfaces to batch, IT places itself and the
end business in a position to Webinize or replace these modules of batch code
in an SOA  process when and where it is
needed.&quot;</p>



<em>NaSPA member Mary E. Shacklett is President of
Transworld Data. She is listed in Who&#39;s Who Worldwide and in Who&#39;s Who in the
Computer Industry</em>

<br class="clear" />
            [#weight] => 0
        )

    [adsense_start] => Array
        (
            [#value] => <!-- google_ad_section_start -->
            [#weight] => -1
        )

    [adsense_end] => Array
        (
            [#value] => <!-- google_ad_section_end -->
            [#weight] => 1
        )

    [field_author] => Array
        (
            [#weight] => -4
            [#value] => <div class="field field-type-text field-field-author"><div class="field-items"><div class="field-item"><div class="field-label-inline-first">Author:&nbsp;</div>Mary Shacklett</div></div></div>
            [#access] => 1
        )

    [field_description] => Array
        (
            [#weight] => -2
            [#value] => 
            [#access] => 
        )

    [field_article_pdf] => Array
        (
            [#weight] => -1
            [#value] => 
            [#access] => 
        )

    [field_item_type] => Array
        (
            [#weight] => 9
            [#value] => 
            [#access] => 
        )

    [field_article_cost] => Array
        (
            [#weight] => 10
            [#value] => 
            [#access] => 
        )

    [field_temppdf] => Array
        (
            [#weight] => 10
            [#value] => 
            [#access] => 
        )

    [fivestar_widget] => Array
        (
            [#value] => <form action="/node/4249/render"  accept-charset="UTF-8" method="post" id="fivestar-form-node-4249" class="fivestar-widget">
<div><input type="hidden" name="content_type" id="edit-content-type" value="node"  />
<input type="hidden" name="content_id" id="edit-content-id" value="4249"  />
<div class="form-item">
 <label>Your vote: </label>
 <div class="fivestar-widget container-inline  fivestar-average-text fivestar-user-stars"><input type="hidden" name="auto_submit_path" id="edit-auto-submit-path" value="/fivestar/vote/node/4249"  class="fivestar-path" />
<div class="form-item">
 <label class="option"><input type="radio" name="vote" value="20"   class="form-radio  fivestar-average-text fivestar-user-stars" /> 1</label>
</div>
<div class="form-item">
 <label class="option"><input type="radio" name="vote" value="40"   class="form-radio  fivestar-average-text fivestar-user-stars" /> 2</label>
</div>
<div class="form-item">
 <label class="option"><input type="radio" name="vote" value="60"   class="form-radio  fivestar-average-text fivestar-user-stars" /> 3</label>
</div>
<div class="form-item">
 <label class="option"><input type="radio" name="vote" value="80"   class="form-radio  fivestar-average-text fivestar-user-stars" /> 4</label>
</div>
<div class="form-item">
 <label class="option"><input type="radio" name="vote" value="100"   class="form-radio  fivestar-average-text fivestar-user-stars" /> 5</label>
</div>
</div><div id="fivestar-summary-4249" class="description"><div class="fivestar-summary-empty">No votes yet</div></div>
</div>
<input type="submit" name="op" id="edit-submit" value="Submit rating"  class="form-submit fivestar-submit" />
<input type="hidden" name="form_id" id="edit-fivestar-form-node-4249" value="fivestar_form_node_4249"  />

</div></form>

            [#weight] => 50
        )

    [forward] => Array
        (
            [#value] => <form action="/node/4249/render"  accept-charset="UTF-8" method="post" id="forward-form">
<div><fieldset class=" collapsible collapsed"><legend>Forward this page to a friend</legend><div class="form-item">
 <label for="edit-yemail">Your Email: <span class="form-required" title="This field is required.">*</span></label>
 <input type="text" maxlength="256" name="yemail" id="edit-yemail"  size="58" value="" class="form-text required" />
</div>
<div class="form-item">
 <label for="edit-yname">Your Name: <span class="form-required" title="This field is required.">*</span></label>
 <input type="text" maxlength="256" name="yname" id="edit-yname"  size="58" value="" class="form-text required" />
</div>
<div class="form-item">
 <label for="edit-recipients">Send To: <span class="form-required" title="This field is required.">*</span></label>
 <textarea cols="50" rows="5" name="recipients" id="edit-recipients"  class="form-textarea resizable required"></textarea>
 <div class="description">Enter multiple addresses on separate lines or separate them with commas.</div>
</div>
<div class="form-item">
 <label>Message Subject: </label>
 (Your Name) has forwarded a page to you from NaSPA.com
</div>
<div class="form-item">
 <label>Message Body: </label>
 (Your Name) thought you would like to see this page from the NaSPA web site.
</div>
<div class="form-item">
 <label for="edit-message">Your Personal Message: <span class="form-required" title="This field is required.">*</span></label>
 <textarea cols="50" rows="10" name="message" id="edit-message"  class="form-textarea resizable required"></textarea>
</div>
<input type="hidden" name="nid" id="edit-nid" value="4249"  />
<input type="hidden" name="forward_footer" id="edit-forward-footer" value=" "  />
<input type="submit" name="op" id="edit-submit" value="Send Message"  class="form-submit" />
</fieldset>
<input type="hidden" name="form_id" id="edit-forward-form" value="forward_form"  />

</div></form>

            [#weight] => 10
        )

    [links_related] => Array
        (
            [#value] => 
            [#weight] => 1
        )

    [vote_up_down] => Array
        (
            [#value] => <div class="vote-up-down-widget"><span class="up-inact" title="You must login to vote."></span><span class="down-inact" title="You must login to vote."></span></div>
            [#weight] => -10
        )

)
Syndicate content