Transcript HPSearch for Managing Distributed Services Authors Harshawardhan Gadgil, Geoffrey Fox, Shrideep Pallickara Community Grids Lab Indiana University, Bloomington.

HPSearch for Managing
Distributed Services
Authors
Harshawardhan Gadgil, Geoffrey Fox,
Shrideep Pallickara
Community Grids Lab
Indiana University, Bloomington
Quick Introduction
What is HPSearch ?

HPSearch (http://www.hpsearch.org) is a
scripting based system to help manage data
streams and services in distributed applications.
– We specifically orient HPSearch towards managing a
distributed publish – subscribe infrastructure
(NaradaBrokering).
– Management can be viewed in 2 parts
 Setting up the distributed application
 Querying dynamic system metadata, such as
– For logging purposes
– Monitor metadata to help dynamically rewiring system to
improve performance
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
2
Motivation


SOAP processing essential in distributed applications (SOAP being
the de-Facto standard)
Various Web Service specifications target specific aspects of
communication between distributed services
– WS-Addressing to address resources using transport neutral
mechanisms
– WS-Reliable Messaging for reliable delivery of messages
– WS-Security for message protection
– … and many more !


Quality of service provided by inserting specific elements in the
header of the SOAP message
Handlers are required for processing different kinds of header
elements, since it is difficult to address arbitrary message exchange
patterns using traditional RPC style synchronous, one-way requestresponse communication.
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
3
Motivation
(contd.)

NaradaBrokering (http://www.naradabrokering.org) has
recently been augmented with support for SOAP
processing

NaradaBrokering presents a way of creating processing
elements called handlers and chain different handlers to
process the SOAP message

Support for WS-Eventing, WS-RM, WS-Reliability and
WS-Notification (in July)
– Federation among these specifications
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
4
Some Issues

With bigger and more complex broker networks,
management becomes difficult

We imagine a similar problem of deployment
and management of handlers within each broker

Currently, the Broker Instantiation service and
scripting objects aid in the creation of remote
brokers and deploying broker topology by
adding / deleting links between brokers
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
5
HPSearch in the Picture
HPSearch would
act as the
manager for
deploying handlers
at specific brokers
 Configuring and
deploying remote
services

Blown-up view
of a broker
Broker
Network
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
6
Proposed Architecture
2 pipelines P1 and P2.
 P1 does not satisfy
certain QoS
 HPSearch selects P2.
 Configures Relay
handler to use the
specific handler chain
and deploys the
application
Communication with
other Brokers / Services

May 11, 2005
P1
Relay Handler
Communicates with
the application in
deciding what QoS
is desired
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
P2
Handler
Pipeline
R
Application
7
Example
// Define some service
s = new Application(
“http://host:port/SecureReliableService”);
// Define the relay handler
h = new RelayHandler(“host:port”);
// Set QoS requirements
h.add(“security”, “URI:Security”);
h.add(“reliablility”, “URI:Reliability”);
s.setRelay(h);
// Finally deploy the service
s.deploy();
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
8
Advantages
Existing Applications may be combined
with NaradaBrokering’s existing
infrastructure
 Applications may be deployed remotely
along with handler chains meeting specific
criteria
 Can combine with Broker Discovery to find
the best broker to connect to

May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
9
Questions / Comments

Any Questions / Comments ?
THANKS
for attending the presentation
May 11, 2005
Community Grids Lab Presentation for
CCGrid 2005, WiP Session
10