16
LCG-POB, 17.-18.2.2004, Reinhard Maschuw 1 Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Grid Computing Centre Karlsruhe - GridKa Regional/Tier 1 Centre of LCG at Forschungszentrum Karlsruhe http://www.gridka.de

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

Embed Size (px)

Citation preview

Page 1: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 1

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

Grid Computing Centre Karlsruhe - GridKa

Regional/Tier 1 Centre of LCGat Forschungszentrum Karlsruhe

http://www.gridka.de

Page 2: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 2

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

CMSATLAS

LHCbCERN

Tier 0 Centre at CERN

Working Groups

VirtualOrganizations

Tier 2(Uni-CCs,Lab-CCs)

Lab y

Uni a

Lab i

Uni b

Lab z

Lab x

Uni cUni d

Uni e

Tier 3 (Institute

computers)

Tier 4(Desktop)

The global LHC Computing

Centre

Germany(FZK)

Tier 1

USA(Fermi, BNL)

UK (RAL)

France(IN2P3)

Italy(CNAF)

……….

CERN Tier 1

……….Tier 0

The fifth “LHC experiment”

Page 3: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 3

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

HEP experiments served by GridKa

Atlas (SLAC, USA)

(CERN)(FermiLab ,USA)

(FermiLab ,USA)

• Committed to Grid Computing

• Have real data already today

LHC experiments non-LHC experiments

Page 4: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 4

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

GridKa

Technical Advisory Board

Overview Board

GridKa Project Organization

• Planning

• Development

• Technical realization

• Operation

• Alice

• Atlas

• CMS

• LHCb

• BaBar

• CDF

• D0

• Compass

• Physics Committees

• DESY

• Project Leader

• BMBF

• HEP Experiments

• LCG

• Physics Committees

• FZK Management

• Head FZK Comp. Centre

• Chairman of TAB

• Project Leader

Page 5: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 5

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

German Users of GridKa

22 institutions

44 user groups

350 scientists

Aachen (4)●Bielefeld (2)●Bochum (2)●Bonn (3)●Darmstadt (1)▲Dortmund (1)●Dresden (2)●Erlangen (1)●Frankfurt (1)●Freiburg (2)●Hamburg (1)▲Heidelberg (1)▲(6)●Karlsruhe (2)●Mainz (3)●Mannheim (1)●München (1)●(5)▲Münster (1)●Rostock (1)●Siegen (1)●Wuppertal (2)●

● University▲ other research institution() number of user groups

Page 6: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 6

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

The five European Tier-1 Centres:

CERN (Geneva)

CNAF-INFN (Bologna)

FZK (Karlsruhe)

IN2P3 (Lyon)

RAL (Oxford)

Tier 2 Polen

Tier 2Östereich

Tier 2 Russland

German users of GridKa

• 19 institutions

• 41 user groups

• ~ 350 scientists

Page 7: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 7

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

0

2000

4000

6000

8000

2002 2003 2004 2005 2006 2007 2008 2009

Tbyt

eGridKa planned hardware resources

4000

3000

2000

1000

0

kSI9

5

LCG Phase I Phase II Phase III

CPUDisk

Tape

460 CPUs118 TB disk220 TB tape

Page 8: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 8

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

Requirements for a complete Tier-1/Regional centre

CPUs3500

Disk1.6 PB

Tape4 PB

LAN

Server>150

WAN / Firewall 20 Gbps

Electricity & Cooling 1MW

Services & Development• GridKa management

• data management software

• data access optimization

• fabric management software

• LCG middleware

• Grid accounting software

• security policies

• certificate authority

• Global Grid User Support

• dissemination & training

• international collaboration

• .....Hardware• install, operate, maintain, replace

Page 9: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 9

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

ESUS GOC

Local operations

GGUSInteraction Interaction

Interaction

Support request Support request

Experiment specific problems solved by Experiment Specific User Support (ESUS); Grid related problems sent to GGUS

Grid related problems solved by GGUS or transmitted to GOC; final report to ESUS

Global Grid User Support GridKa = European part of GGUS, one of three worldwide

http://www.ggus.org

Page 10: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 10

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

GridKa – A 24x7 maintenance model

6

0/24

18

12

22

8

Grid (1st level) user support

To cover 365d x 16h per yr:

2 shifts per day

2 persons per shift

(covers illness)

= 1460 person days per yr

1 person year = 210 working days

7 persons required

Page 11: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 11

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

GridKa Human Resources

0

10

20

30

40

50

60

2003 2004 2005 2006 2007 2008 2009

hu

man

res

ou

rces

/ F

TE

plannedhardwareresources

Page 12: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 12

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

Resource planning GridKA

2003 2004 2005 2006 2007 2008 2009

Personnel/FTE 15 15 30 38 39 43 43

Invest / k€ 1700 2000 1650 2350 3250 3950 3700

Phase I Phase II Phase III

Page 13: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 13

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

~ 1.5 Million CPU hours29% LHC71% non- LHC

Usage of GridKa January - September 2003

Page 14: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 14

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

~ 230.000 jobs

Number of user jobs January - September 2003

Page 15: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 15

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

Usage Example: LHCb Data Challenge’03 - ResultsUsage Example: LHCb Data Challenge’03 - Results

GridKa

N. B

rook, G

DB

9th

Sep

tem

ber 0

3

Page 16: Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft LCG-POB, 17.-18.2.2004, Reinhard Maschuw1 Grid Computing Centre Karlsruhe - GridKa Regional/Tier

LCG-POB, 17.-18.2.2004, Reinhard Maschuw 16

Forschungszentrum Karlsruhein der Helmholtz-Gemeinschaft

Summary and Conclusion

GridKa is a dedicated LCG regional centre

Requirements for all regional centres

• Planning of resources: investments, personnel, funding

• Definition of tasks and services

• Definition of relation to Tier 2 centres and others