VIO

VMware Integrated OpenStack

Architecture Design

for

<Customer>

Prepared by

<Consultant>

VMware Professional Services

<consultant>@vmware.com

Version History

Consultant:

Read all highlighted text in yellow. Follow any instructions and update the text with customer-specific information as needed. Replace <Customer> with the actual customer name.

Verify that all highlighted text is updated or deleted before delivering this document to the customer.

Delete all text highlighted in green after you have read it. This text provides guidance for the consultant.

© 2016 VMware, Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. This product is covered by one or more patents listed at http://www.vmware.com/download/patents.html.

VMware is a registered trademark or trademark of VMware, Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.

VMware, Inc.3401 Hillview AvePalo Alto, CA 94304www.vmware.com

Contents

1. Overview 13

1.1 Executive Summary 13

1.2 Engagement Background 13

1.3 Audience 13

1.4 Terminology 14

1.5 Business Requirements 15

1.6 Assumptions, Risks, and Constraints 15

1.7 Interpreting the Design 15

1. VMware Integrated OpenStack Overview 17

2.1 Overview of VMware Integrated OpenStack 17

2.2 VMware Integrated OpenStack Solution 17

2.3 Conceptual Design 18

2.4 Logical Design 19

2.5 Scalability Overview 20

2.5.1 Solution Scale-Up 21

2.5.2 Solution Scale-Out 22

1. VMware Integrated OpenStack Core Infrastructure 23

3.1 Current State Analysis 23

3.1.1 Current Virtualization Platform Logical Model 23

3.1.2 Current Network Model 23

3.2 Greenfield Approach 24

1. ESXi Host Design 25

4.1 ESXi Host Physical Design 25

4.1.1 ESXi Host Hardware Specifications 25

4.1.2 ESXi Host Physical Design Decisions 26

4.2 ESXi Host Logical Design 27

1. vCenter Server Design 28

5.1 vCenter Server Physical Design 28

5.1.1 vCenter Server Sites and Locations 28

5.1.2 Backup and Restore 28

5.1.3 Platform Services Controller Deployment Recommendations 28

5.1.4 vCenter Server Platform Choice 29

5.1.5 vCenter Server Resource Requirements 29

5.1.6 vCenter Server Database Design 30

5.1.7 vCenter Server Physical Design Decisions 30

5.2 vCenter Server Logical Design 31

5.2.1 vCenter Server Identity 31

5.2.2 vCenter Single Sign-On™ 31

5.2.3 vCenter Server Clusters 32

5.2.4 vCenter Server Logical Design Decisions 32

5.2.5 Cluster Design Decisions 33

5.3 vCenter Server Feature Design 37

5.3.1 vSphere HA 37

5.3.2 VMware vSphere Fault Tolerance 41

5.3.3 vSphere Distributed Resource Scheduler 41

5.3.4 vSphere Enhanced vMotion Compatibility 42

5.3.5 Resource Pools 43

5.3.6 vSphere Update Manager Deployment Model 44

5.3.7 vSphere Update Manager Resource Requirements 44

5.3.8 vSphere Update Manager Database Design 44

5.3.9 vSphere Update Manager Physical Design Decisions 45

1. Virtualization Network Layer Design 46

6.1 Network Architecture 46

6.2 Physical Network Design 46

6.2.1 Physical Switches 47

6.2.2 Jumbo Frames 48

6.2.3 VLANs and Network Segmentation 48

6.2.4 Physical Network Design Decisions 49

6.3 Logical Network Design 50

6.3.1 VXLAN Transport Zones and vSphere Distributed Switch Options 50

6.3.2 VXLAN Replication Mode 51

6.3.3 DNS Requirements 51

6.3.4 Naming Conventions 52

6.3.5 Logical Network Design Decisions 52

6.4.1 Management Cluster 54

6.4.2 Edge Cluster 55

6.4.3 Compute Clusters 56

1. Shared Storage Design 58

7.1 High-Level Shared Storage Design Guidelines 58

7.1.1 Storage Platforms 58

7.1.2 Comparing Types of Storage 59

7.2 Shared Storage Physical Design 60

7.2.1 NFS Storage Design 60

7.2.2 Storage Redundancy 61

7.2.3 Shared Storage Design Specifications 62

7.2.4 Shared Storage Physical Design Decisions 62

7.3 Shared Storage Logical Design 64

7.3.1 Storage Tiering 64

7.3.2 Datastore Clusters 65

7.3.3 vSphere Storage DRS 66

7.3.4 Shared Storage Logical Design Decisions 66

1. Virtual SAN Design (Optional) 67

8.1 Hardware Considerations 67

8.1.1 Solid State Disks 67

8.1.2 Magnetic Hard Disk Drives 69

8.1.3 I/O Controllers 71

8.1.4 Host Memory Requirements 73

8.1.5 Host CPU Overhead 74

8.2 Network Design 74

8.2.1 Virtual SAN Network Configuration 75

8.2.2 Type of Virtual Switch 76

8.2.3 Jumbo Frames 77

8.2.4 VLANs 78

8.2.5 Multicast Requirements 78

8.2.6 BCDR and Teaming Considerations 79

8.3 Virtual SAN Datastore Characteristics 80

8.3.1 Disk Group SDD-to-HDD Ratios 81

8.3.2 Failures-to-Tolerate Policy 81

8.3.3 Datastore Sizing 81

8.4 Finalized Cluster and Disk Group Design 84

8.4.1 Size of the Virtual SAN Datastore 84

8.4.2 Number of Hosts Per Cluster 84

8.4.3 Number of Disk Groups Per Host 85

8.5 Virtual SAN Policy Design 87

8.5.1 Virtual SAN Policy Options 87

1. VMware Integrated OpenStack Design 90

9.1 VMware Integrated OpenStack Architecture 90

9.2 Mapping of Availability Zones and Host-Aggregates to vSphere Clusters 91

9.2.1 Design Decisions regarding Availability Zones in VMware Integrated OpenStack 92

9.3 OpenStack Root Disk/Volumes (Cinder) to vSphere Datastore Mapping 93

9.3.1 Using SSD based datastores 95

9.3.2 Design Decisions Regarding Cinder Volumes in OpenStack 97

9.4 Active Directory Integration 98

9.5 Instance or Virtual Machine Deployment in OpenStack 98

9.5.1 Instance Design Decisions 98

1. Management and Monitoring 100

10.1 General Management Design Guidelines 100

10.2 Host Management Considerations 100

10.3 CIM and SNMP 100

10.4 CDP and LLDP 101

10.5 Syslog Logging 101

10.6 Task and Events Retention Policy 101

10.7 Statistics Collection Level 101

10.8 Performance Monitoring 102

10.9 Management and Monitoring Design Decisions 102

1. Security 103

11.1 Securing ESXi Hosts 103

11.2 Securing vCenter Server 103

11.3 Virtual Network Security Considerations 104

11.3.1 Network Firewalls and vCenter Server 105

11.3.2 Securing Virtual Machines with VLANs 106

11.3.3 Securing Virtual Switch Ports 106

11.4 Securing NFS Storage Connectivity 106

11.5 Virtual Machine Security Considerations 106

11.6 Security Design Decisions 107

1. Backup and Restore 108

12.1 ESXi Host Backup and Restore 108

12.1.1 Host Profiles Usage Model 108

12.2 vCenter Server Backup and Restore 108

12.3 vSphere Distributed Switch Backup and Restore 109

12.4 Virtual Machine Backup and Restore 109

12.5 VMware Integrated OpenStack Backup and Restore 109

12.6 Infrastructure Backup and Restore Design Decisions 109

1. VMware Infrastructure Update Procedures 110

13.1 VMware vSphere environment updates 110

13.2 VMware NSX Environment Updates 111

13.3 Non VMware infrastructure updates 111

1. References 113

14.1 Core Documentation 113

14.2 Additional Materials 113

Appendix: <Title> 114

List of Figures

Figure 1. VMware Integrated OpenStack Components Overview 17

Figure 2. Conceptual Design 18

Figure 3. VMware Integrated OpenStack Logical Design 19

Figure 4. VMware Integrated OpenStack Physical Design 20

Figure 5. Virtual Distributed Switch and Transport Zone Design 51

Figure 6. Network Switch Design for Management Hosts 55

Figure 7. Network Switch Design for Edge Hosts 56

Figure 8. Network Switch Design for Compute Hosts 57

Figure 9. Storage Tiering 64

Figure 10. VMware Integrated OpenStack logical diagram 90

Figure 11. Nova Components Overview 91

Figure 12. OpenStack vSphere Driver configuration 94

Figure 13. Nova-Compute Node Datastore Overview 95

Figure 14. vCenter Storage Policy-Based Management Overview 95

List of Tables

Table 1. VMware Integrated OpenStack Service Terminology 14

Table 2. Business Requirements 15

Table 3. Key Point Labels 15

Table 4. Scale-Up of the Management Cluster 21

Table 5. Scale-Up of the Edge Cluster 21

Table 6. Scale-up of the Compute Clusters 21

Table 7. Proposed ESXi Host CPU Logical Design Specifications 24

Table 8. Proposed ESXi Host RAM Logical Design Specifications 24

Table 9. Physical Server Specification for the Management and Edge Cluster Designs 25

Table 10. Physical Server Specification for the Compute Cluster Design 25

Table 11. ESXi Host Physical Design Decisions 26

Table 12. Additional ESXi Host Logical Design Decisions 27

Table 13. vCenter Server Appliance Logical Specifications for Management/Edge/Compute Clusters 29

Table 14. vCenter Server Database Design 30

Table 15. vCenter Server Physical Design Decisions 31

Table 16. vCenter Server Logical Design Decisions 32

Table 17. Cluster Design Decisions 33

Table 18. Management Cluster Design Decisions 34

Table 19. Management Cluster Design Specifications 35

Table 20. Edge Cluster Design Decisions 35

Table 21. Edge Cluster Design Specifications 35

Table 22. Compute Cluster Design Decisions 36

Table 23. Compute Cluster Design Specifications 36

Table 24. vSphere HA Design Decisions 38

Table 25. vSphere HA Admission Control Design Decisions 39

Table 26. vSphere HA Monitor Virtual Machines Design Decisions 41

Table 27. vSphere FT Design Decisions 41

Table 28. DPM Design Decisions 42

Table 29. vSphere DRS Design Decisions 42

Table 30. EVC Design Decisions 43

Table 31. Resource Pools Design Decisions 43

Table 32. vSphere Update Manager Server Specifications 44

Table 33. vSphere Update Manager Database Specifications 45

Table 34. Update Manager Physical Design Decision 45

Table 35. Physical Network Design for Management Cluster Decisions 46

Table 36. Physical Network Design for Compute and Edge Clusters Decisions 47

Table 37. Physical Network Design for Compute and Edge Clusters Decisions 47

Table 38. Physical Network Design Decision 49

Table 39. Logical Network Design Decisions 52

Table 40. Network Shared Storage Supported by ESXi 59

Table 41. vSphere Features Supported by Storage Type 60

Table 42. Storage Type Specification 62

Table 43. Shared Storage Physical Design for Management Cluster Decisions 62

Table 44. Shared Storage Physical Design for the Compute and Edge Clusters Decisions 63

Table 45. Storage Tiering Implementation with Cinder for the Compute Cluster 65

Table 46. Datastore Cluster Capabilities 65

Table 47. Shared Storage Logical Design Decisions 66

Table 48. SSD Performance Classes 68

Table 49. SSD Performance Class Selection 69

Table 50. SSD Performance Class Selection – Design Decisions 69

Table 51. Virtual SAN HDD Environmental Characteristics 69

Table 52. HDD Characteristic Selection 70

Table 53. HDD Selection – Design Decisions 70

Table 54. HDD Characteristic Selection 72

Table 55. I/O Controller Selection – Design Decisions 72

Table 56. Host Memory Selection 73

Table 57. Host Memory Selection – Design Decisions 74

Table 58. Network Speed Selection 75

Table 59. Network Speed Selection – Design Decisions 76

Table 60. Switch Types 76

Table 61. Virtual Switch Selection – Design Decisions 77

Table 62. Jumbo Frames Selection – Design Decisions 77

Table 63. VLAN Selection – Design Decisions 78

Table 64. NIC Teaming and Policy 79

Table 65. NIC Teaming and Policy Selection – Design Decisions 80

Table 66. Virtual SAN Datastore Selection – Design Decisions 84

Table 67. Number of Hosts Per Cluster 85

Table 68. Cluster Size Selection – Design Decisions 85

Table 69. Number of Disk Groups Per Host 86

Table 70. Disk Groups Per Host Selection – Design Decisions 86

Table 71. Virtual SAN Policy Options 87

Table 72. Object Policy Defaults 88

Table 73. Policy Selection – Design Decisions 89

Table 74. Availability Zone Design Decisions 92

Table 75. Block Storage Service Design Decisions 93

Table 76. Cinder Volume Design Decisions 97

Table 77. VIO AD, Users and Quota Design Decisions 98

Table 78. Virtual Machine Design Decisions 99

Table 79. Statistics Collection Guidelines 101

Table 80. Virtual Machine Related Design Decisions 102

Table 81. Security Design Decisions 107

Table 82. Infrastructure Backup and Restore Related Design Decisions 109

Table 83. VMware Appliances, vCenter and ESX Host Update Impacts 110

Table 84. NSX environment update impact 111

Table 85. Non VMware infrastructure update impact 112