38
Drive your life. Scale-Out Fileserver Matthias Gessenay [email protected]

Scale-Out Fileserver

Embed Size (px)

Citation preview

Page 1: Scale-Out Fileserver

Drive your life.

Scale-Out Fileserver

Matthias Gessenay [email protected]

Page 2: Scale-Out Fileserver

Agenda n  Das Problem n  Die neuen Möglichkeiten n  Verwendete Techniken n  Integration mit System Center 2012

2

Page 3: Scale-Out Fileserver

DAS „PROBLEM“

3

Page 4: Scale-Out Fileserver

Das “Problem” n  Hochverfügbare Dateiserver = Cluster n  Aber Cluster = eine Instanz n  Also kein Scale-Out n  Vielleicht DFS-R?

o  Locking o  Usw.

4

Page 5: Scale-Out Fileserver

DIE NEUEN MÖGLICHKEITEN

5

Page 6: Scale-Out Fileserver

Beides! n  Cluster Shared Volumes (CSV) sind jetzt auch für Fileserver

freigegeben o  Haben eigenes Locking-System (“orchestrierte I/O Operations”) o  Multi-Subnet o  Brauchen ein NTFS-Drive (oft iSCSI)

n  Ungeschriebene Best Practice: 1 Share pro 1 CSV

6

Page 7: Scale-Out Fileserver

Scale-Out n  Fixer Scale-Out mit Hyper-V möglich

o  Scale-Out Fileserver-Rolle (SOF) läuft als Clusterservice o  Registriert alle IPs o  Benutzt Round Robin o  + 1 Clusternode = +1 Fileserver

n  Dynamischer Scale-Out mit System Center o  Service-Orientiert o  Integration mit SCOM

7

Page 8: Scale-Out Fileserver

VERWENDETE TECHNIKEN

8

Page 9: Scale-Out Fileserver

Cluster Shared Volumes n  Werden unter %SystemDrive%\ClusterStorage als einzelne Volumes

angezeigt n  Locking ist nicht auf LUN, sondern auf File-Level n  Jedes Volume hat einen Node als Coordinator (hält auch die NTFS-

Metadaten) n  Non-Coordinators machen einen Request beim Coordinator-Node n  Windows Cache Manager Integration

9

Page 10: Scale-Out Fileserver

SMB v3 n  Erheblich verbesserte Performance n  Better together mit Hyper-V v3 n  Encryption n  SMB RDMA (Remote Direct Memory Access)

10

Page 11: Scale-Out Fileserver

Hyper-V n  Viele Enterprise-Features jetzt im Server Standard n  Mehr Features als SCVMM -> Replica n  Sehr gute SMB-Anbindung (SMB3)

11

Page 12: Scale-Out Fileserver

title

Anatomy of a Scale-Out File Server

Page 13: Scale-Out Fileserver

Get-­‐ClusterGroup  |  ?  {$_.GroupType  -­‐eq  "ScaleoutFileServer"}  |  FL  Name,  OwnerNode,  State,  GroupType    Name            :  smbsofs33  OwnerNode  :  FSF-­‐260403-­‐07  State          :  Online  GroupType  :  ScaleoutFileServer  Get-­‐ClusterGroup  |  ?  {$_.GroupType  -­‐eq  "ScaleoutFileServer"}  |  Get-­‐ClusterResource    Name                                                    State                                                  OwnerGroup                                        ResourceType  -­‐-­‐-­‐-­‐                                                    -­‐-­‐-­‐-­‐-­‐                                                  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐                                        -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐  Scale-­‐Out  File  Server                  Online                                                smbsofs33                                          Scale  Out  File  Server  smbsofs33                                          Online                                                smbsofs33                                          Distributed  Network  Name

Page 14: Scale-Out Fileserver

>  smbsofs33  Server:    stb-­‐red-­‐dc-­‐01.stbtest.microsoft.com  Address:    10.200.81.201    Non-­‐authoritative  answer:  Name:        smbsofs33.ntdev.corp.microsoft.com  Addresses:    2001:4898:0:fff:0:5efe:10.217.108.49                      2001:4898:0:fff:0:5efe:10.217.108.103                      2001:4898:0:fff:0:5efe:10.217.108.148                      10.217.108.148                      10.217.108.49                      10.217.108.103  

Page 15: Scale-Out Fileserver

>  smbsofs33  Server:    stb-­‐red-­‐dc-­‐01.stbtest.microsoft.com  Address:    10.200.81.201    Non-­‐authoritative  answer:  Name:        smbsofs33.ntdev.corp.microsoft.com  Addresses:    2001:4898:0:fff:0:5efe:10.217.108.49                      2001:4898:0:fff:0:5efe:10.217.108.103                      2001:4898:0:fff:0:5efe:10.217.108.148                      10.217.108.148                      10.217.108.49                      10.217.108.103    >  smbsofs33  Server:    stb-­‐red-­‐dc-­‐01.stbtest.microsoft.com  Address:    10.200.81.201    Non-­‐authoritative  answer:  Name:        smbsofs33.ntdev.corp.microsoft.com  Addresses:    2001:4898:0:fff:0:5efe:10.217.108.103                      2001:4898:0:fff:0:5efe:10.217.108.148                      2001:4898:0:fff:0:5efe:10.217.108.49                      10.217.108.49                      10.217.108.148                      10.217.108.103  

Page 16: Scale-Out Fileserver
Page 17: Scale-Out Fileserver
Page 18: Scale-Out Fileserver

Scale-Out File Server Cluster

Node A

Node B

SQL Server

Node C

Get-­‐SmbWitnessClient  |  FL  ClientName,  FileServerNodeName,  WitnessNodeName  ClientName                  :  SQLServer  FileServerNodeName  :  A  WitnessNodeName        :  B  Move-­‐SmbWitnessClient  –ClientName  SQLServer  –DestinationNode  C  

Page 19: Scale-Out Fileserver

title

SMB Transparent Failover

Page 20: Scale-Out Fileserver

Failovers are not transparent

File Server Cluster

Node A Node B

\\fs1\share \\fs1\share

SQL Server

Page 21: Scale-Out Fileserver

File Server Cluster

SMB Transparent Failover

Node A Node B

\\fs1\sha

re

\\fs1\sha

re

SQL Server

Page 22: Scale-Out Fileserver

New components (1/2)

SMB Server

SMB Client SMB Server

User

Kernel

User

Kernel

Witness Service

Witness Client

Witness Protocol

SMB Redirector

File System

Resume Key Filter

SMB Server

SMB 3.0 Operation replay

State persistence

User

Kernel

Page 23: Scale-Out Fileserver

New components (2/2)

SMB Server

SMB Client SMB Server

User

Kernel

User

Kernel

Witness Service

Witness Client

Witness Protocol

SMB Redirector

File System

Resume Key Filter

SMB Server

SMB 3.0 Operation replay

State persistence

User

Kernel

Page 24: Scale-Out Fileserver

Overview

continuous availability

Page 25: Scale-Out Fileserver

Features (1/3)

Page 26: Scale-Out Fileserver

Features (2/3)

Page 27: Scale-Out Fileserver

Features (3/3)

Page 28: Scale-Out Fileserver

Volume instance attach

Volume Protection • Database is

being loaded from store

• All creates are held until complete (<3s)

Namespace protection • Local handles

are being established

• All rename and create operations are blocked until complete (<60s)

Create Protection • Remote handles

are being resumed

• All new creates are blocked until all handles are resumed or cancelled (<60s)

Handles Cancelled • Unclaimed

handles are cancelled to release file create blackout

Page 29: Scale-Out Fileserver

Overview

Page 30: Scale-Out Fileserver

Registration process

\\fs1\share

\\fs1

\\fs1

File Server Cluster

Node A Node B

\\fs1\share \\fs1\share

SQL Server

Page 31: Scale-Out Fileserver

File Server Cluster

Notification process

Node A Node B

\\fs1\share \\fs1\share

SQL Server

Page 32: Scale-Out Fileserver
Page 33: Scale-Out Fileserver

DEMO

33

Page 34: Scale-Out Fileserver

INTEGRATION MIT SYSTEM CENTER 2012

34

Page 35: Scale-Out Fileserver

Scale-Out ist auch mit System Center möglich n  Über ein Service Model lassen sich n Instanzen definieren n  Diese Instanzen werden dynamisch skaliert, je nach Auslastung n  Z. B. via ProTips vom SCOM

35

Page 36: Scale-Out Fileserver

Szenarien n  Fileserver

o  DFS-Namespace, z. B. mit Storage o  Cluster-Nodes (für CSV)

n  Hyper-V Storage o  Kann sich auf den SOF stützen

36

Page 37: Scale-Out Fileserver

DEMO

37

Page 38: Scale-Out Fileserver

FRAGEN?

38