Transcript Slide 1

Repositories, Workspaces
Workshop
organized by MPI PL, RZG, SARA, FZJ
Date:
20. - 21. September 2010 9:00
~25 participants from Finland, France, Germany ,
Italy, Netherlands, US
Welcome!
1. RZG
2. practical information
3. workshop agenda/intention
Science Campus Garching near Munich
MPA
Foto: Artur Gerngross, Fa. FOTAG
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
3
Fusion Research at the
MPI for Plasma Physics (IPP)
IPP is one of the largest fusion research centers worldwide,
an associate of the European Fusion Program
and the ITER organization
ASDEX Upgrade
Tokamak experiment
W7-X Stellerator experiment
ITER Tokamak experiment
RZG computer hall
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
5
Supercomputing at RZG since 1962 and
HPC application support
1962:IBM 7090
1969:IBM360/91
1999
NEC SX-5/3C
Repositories/Workspaces
Workshop, 20-21.09.2010
1979: Cray-1
2002/2003
IBM p690/1024
Johannes Reetz
seit Sep 2007
IBM BG/P
1996/1998:Cray T3E/816
seit May 2008
IBM p575 Power6
6
Cluster-Hosting
more than 20 Linux-Cluster from 15 Max Planck Institutes
FHI Berlin
36TF (SUN)
(Prof. Scheffler)
384 Knoten á 8 Cores (3072 cores), 4 Racks
MPI für Physik Komplexer Systeme, Dresden
18 TF (SUN)
(Prof. Moessner)
ca 192 Knoten, 2 Racks (1536 cores)
MPI für Chemie Mainz
(Prof. Lelieveld)
ca 48 Knoten, 0.5 Racks
4.5 TF (IBM)
IPP Garching
2 cluster, 1600 cores
16 TF
MPQ
336 cores
MPI für Astrophysik
(Prof. Asplund)
ca 192 Knoten, 2 Racks (1300 cores)
18 TF
MPI für Biochemie
18 TF (HP)
circa 192 Knoten, 2 Racks
MPI für Astronomie Heidelberg
18 TF
circa 192 Knoten, 2 Racks (1008 cores)
MPI für Anthropologie Leipzig und
MPI für Züchtungsforschung Köln
(Prof. Paboo, Prof. Schulze-Lefert)
grosses shared-memory System
weitere Systeme für: MPE,CPFS,EVA, Biochemie
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
7
RZG data services: Backup/Archive, long-term archive
present data in the TSM/HSM storage system
backup data
archive data
simulations
data
experiment and
observational
data
2nd copy
1389 TB (18%)
484 TB (6%)
2205 TB (29%)
890 TB (11%)
2518 TB (33%)
RZG tape robot
Sept. 2010
Capacity 14 – 40 PB (LTO3,4,5)
Total
7486 TB (100%)
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
Stand 13.09.2010
8
RZG data services: long-term archive
data security, availability, reliability
Mirroring archive data mutually between RZG and LRZ
Backup/Archive Data
HPC Simulations data
experiment data
AFS (+ OSD)
TSM Backup/Archive
Servers
GPFS 1 + TSM-HSM
Tape Archive
LRZ
Tape Archive
RZG
Repositories/Workspaces
Workshop, 20-21.09.2010
GPFS 2 + TSM-HSM
Johannes Reetz
9
RZG data services:
growth of data in the long-term archive
Status 13.09.2010:
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
7.5 PB
10
RZG profile
→ Computer Centre of the Max Planck Society and IPP
→ High Performance Computing
→ HPC application support and visualisation
→ Compute-Cluster Hosting for Max Planck Institutes and Projekts
→ Experiment data aquisition
→ European und national Projects (DEISA, ELPA, ISAR, Atlas/Tier2, …..)
→ Data services: file systems, storage systems, backup/archiving,
long-term archiving (50yr lifetime warranty for Max Planck Institutes)
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
11
20.9.2010
Repositories and Replication Title
9.00
9.15
9.45
10.45
11.15
12.15
13.00
14.00
14.30
15.30
16.00
16.15
17.15
18.00
19:30
Johannes Reetz
Peter Wittenburg
Larry Lannom
Coffee break
Alex Wade
Malte Dreyer
Lunch Break
John Kennedy
Kenneth Galluppi
Willem Elbers
Coffee break
Jean-Yves Nief
Daan Broeder (MPI)
End
Joint Dinner
Pizzaria “La Pergola”
21.9.2010
Workspaces and Web Services
9.00
10.00
Peter Wittenburg
Maurice Bouwhuis, Marc vd Sanden,
Daan Broeder (SARA, MPI)
Wrap up and Discussion of previous day
Workspaces in CLARIN NL
10.30
11.00
11.30
Morris Riedel (FZJ)
Coffee break
Johannes Reetz, John Kennedy (RZG)
Workspaces – Concept and functional aspects
12.00
Thomas Zastrow, Erhard Hinrichs (U
Tübingen)
Lunch Break
Mike Papazoglou (U Tilburg)
Peter Wittenburg
End
WebLicht Application and Workspace Requirements
12.45
13.45
14.45
16.00
Repositories/Workspaces
Workshop, 20-21.09.2010
(RZG)
(MPI)
(CNRI)
Welcome and Intention
Architecture Issues and Overview
Abstract CNRI Model
(MS)
(MPDL)
Business Approaches
Generic API Principles
IPP Cantina
Data Repositories within DEISA
Federating climate, water and weather data repositories
Replix project – motivation, goals, results
(RZG)
(NOAA)
(MPI)
(IN2P3)
Generic policy rules and principles
API Data Grids-Repositories
Münchner Str. 4, at U6 station „Garching Zentrum“
http://www.lapergola-garching.de
Workspaces – requirements and operational aspects
Generic Workflow Frameworks for WebServices
Wrap up and Discussion
Johannes Reetz
12
Practical Information
1. WLAN available either via eduroam or free access (ssid: “D2 GAST”).
2. Please write your name, institution (email address) on the list of participants.
3. Transport from IPP to the Munich airport:
please write your name and departure time on the transport request form. We
will try to arrange a transportation with IPP transportation service.
4. We will have lunch at the cantina of the Max-Planck-Institut for Plasmaphysics,
just 150m distance from the seminar room. Lunch to be paid directly.
5. Evening dinner takes place on Monday 7:30pm at the Pizzeria “La Pergola”,
Münchner Str. 4 in Garching (http://www.lapergola-garching.de).
You find the menu (in german only) under http://www.lapergolagarching.de/pespeise.htm
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
13
20.9.2010
Repositories and Replication Title
9.00
9.15
9.45
10.45
11.15
12.15
13.00
14.00
14.30
15.30
16.00
16.15
17.15
18.00
19:30
Johannes Reetz
Peter Wittenburg
Larry Lannom
Coffee break
Alex Wade
Malte Dreyer
Lunch Break
John Kennedy
Kenneth Galluppi
Willem Elbers
Coffee break
Jean-Yves Nief
Daan Broeder (MPI)
End
Joint Dinner
Pizzaria “La Pergola”
21.9.2010
Workspaces and Web Services
9.00
10.00
Peter Wittenburg
Maurice Bouwhuis, Marc vd Sanden,
Daan Broeder (SARA, MPI)
Wrap up and Discussion of previous day
Workspaces in CLARIN NL
10.30
11.00
11.30
Morris Riedel (FZJ)
Coffee break
Johannes Reetz, John Kennedy (RZG)
Workspaces – Concept and functional aspects
12.00
Thomas Zastrow, Erhard Hinrichs (U
Tübingen)
Lunch Break
Mike Papazoglou (U Tilburg)
Peter Wittenburg
End
WebLicht Application and Workspace Requirements
12.45
13.45
14.45
16.00
Repositories/Workspaces
Workshop, 20-21.09.2010
(RZG)
(MPI)
(CNRI)
Welcome and Intention
Architecture Issues and Overview
Abstract CNRI Model
(MS)
(MPDL)
Business Approaches
Generic API Principles
IPP Cantina
Data Repositories within DEISA
Federating climate, water and weather data repositories
Replix project – motivation, goals, results
(RZG)
(NOAA)
(MPI)
(IN2P3)
Generic policy rules and principles
API Data Grids-Repositories
Münchner Str. 4, at U6 station „Garching Zentrum“
http://www.lapergola-garching.de
Workspaces – requirements and operational aspects
Generic Workflow Frameworks for WebServices
Wrap up and Discussion
Johannes Reetz
14
Intention of the Workshop
• How diverse is the landscape of repository systems and are
there mature architectural solutions emerging?
• how can the repositories from diverse landscapes be
federated and are there suitable layers and APIs available?
• how can safe replication be done in such diverse
landscapes?
• is it a useful approach to control activities in federated
repositories by declarative policy rules and if so what are
typical policies?
• what do we need user workspaces for and what
characteristics to they have in a distributed environment?
• what are the requirements with respect to workspaces from
the perspective of distributed processing chains driven by
community applications?
• are there generic frameworks for the execution of
distributed processing chains and the deployment of web
services?
Repositories/Workspaces
Workshop, 20-21.09.2010
Johannes Reetz
15