Projet

Général

Profil

Openstack » Historique » Version 53

Laurent GUERBY, 19/09/2014 13:49

1 1 Laurent GUERBY
{{>toc}}
2 1 Laurent GUERBY
3 1 Laurent GUERBY
h1. Openstack
4 1 Laurent GUERBY
5 1 Laurent GUERBY
h2. Objectifs
6 1 Laurent GUERBY
7 2 Laurent GUERBY
Monter un cluster openstack a tetaneutral.net en remplacement de ganeti (h1/4/5/6) + libvirt (n7).
8 1 Laurent GUERBY
9 24 Laurent GUERBY
h2. Liens
10 24 Laurent GUERBY
11 1 Laurent GUERBY
* [[Openstack Installation TTNN]]
12 46 Laurent GUERBY
* https://en.wikipedia.org/wiki/OpenStack
13 46 Laurent GUERBY
* http://opensource.com/business/14/5/new-openstack-tutorials
14 45 Laurent GUERBY
* Dave Neary http://fr.slideshare.net/nearyd/neutron-open-vswt et http://www.youtube.com/watch?v=afImoFeuDnY
15 48 Laurent GUERBY
* https://www.openstack.org/summit/openstack-summit-hong-kong-2013/session-videos/presentation/how-to-write-a-neutron-plugin-if-you-really-need-to et http://www.slideshare.net/salv_orlando/how-to-write-a-neutron-plugin-if-you-really-need-to
16 24 Laurent GUERBY
17 11 Laurent GUERBY
h2. Ressources
18 10 Laurent GUERBY
19 1 Laurent GUERBY
Ressources dispo :
20 52 Laurent GUERBY
# g1 (ex bm0402) Q87M vPro  i7-4770 32 GB FSF France Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 6x SATA 3Gb  http://www.asrock.com/mb/Intel/Q87M%20vPro/?cat=Specifications
21 52 Laurent GUERBY
# g2 (ex bm0403) Q87M vPro  i7-4770 32 GB FSF France Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB
22 52 Laurent GUERBY
# g3 (ex h8) Intel DQ67OW  i5-2500  32 GB (ex velizy) INTEL SSDSC2CT060A3 60GB ST2000DL004 2 TB http://ark.intel.com/products/51999/Intel-Desktop-Board-DQ67OW
23 52 Laurent GUERBY
24 52 Laurent GUERBY
# n7 PowerEdge R310 rackable 32 GB 4x SATA http://www.dell.com/downloads/emea/products/R310_spec_sheet.pdf 3x ST31000528AS 7200.12 1TB
25 52 Laurent GUERBY
# STRI rackable 32 GB 1U SC813MTQ-350CBK - PWS-351-1H - 4x Hot-swap 3.5" SAS/SATA X9SCL-F 4xDDR3 UDIMM 8GB KVR1333D3E9S/8G xeon E3-1230V2 3x3TB WD3000FYYZ RE  http://www.supermicro.com/products/motherboard/Xeon/C202_C204/X9SCL-F.cfm
26 52 Laurent GUERBY
27 49 Laurent GUERBY
# h1 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2M040G2GC 40GB  ST2000DL003 2TB WDC WD20EARS 2TB perso guerby 
28 49 Laurent GUERBY
# h4 P8H67-M EVO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CW080G3  80GB WDC WD20EARS 2TB 4xSATA 3Gb 2xSATA 6Gb 1x eSATA perso guerby http://www.asus.com/Motherboards/P8H67M_EVO/specifications/
29 49 Laurent GUERBY
# h5 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3  40GB  ST2000DM001 2TB 4xSATA 3Gb 2xSATA 6Gb http://www.asus.com/Motherboards/P8H67M_PRO/specifications/
30 49 Laurent GUERBY
# h6 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3  40GB  ST2000DL004 2TB
31 52 Laurent GUERBY
32 49 Laurent GUERBY
# z2-4 P8H67-M PRO i7-2600  16GB upgradable 32 GB WDC WD4001FAEX 4 TB FSF France
33 49 Laurent GUERBY
# z2-9 GA-890GPA-UD3H i7-2600  16GB pas upgradable WDC WD20EARS 2 TB INTEL SSDSC2MH250A2 250 GB INTEL SSDSC2MH250A2 250 GB 6x SATA 6Gb 2x SATA 3Gb FSF France http://www.gigabyte.com/products/product-page.aspx?pid=3516#sp
34 12 Laurent GUERBY
35 52 Laurent GUERBY
# xeon S1200BTL E3-1230 8GB upgradable a 32 GB INTEL SSDSC2CW120A3 120GB 6x SATA  perso guerby http://ark.intel.com/products/53557/intel-server-board-s1200btl
36 15 Laurent GUERBY
# lapaillasse.org GA-B75M-D3H  i3-3220 perso julien core i7 24 upgradable 32 GB + TODO 5 disques http://www.gigabyte.com/products/product-page.aspx?pid=4150#sp
37 15 Laurent GUERBY
# pc2 DQ67SW i5-2500 16GB upgradable 32 GB perso guerby http://ark.intel.com/products/51997/intel-desktop-board-dq67sw
38 49 Laurent GUERBY
39 49 Laurent GUERBY
Stock ddur
40 49 Laurent GUERBY
# 2x Samsung SSD 840 EVO 250 Go ttnn
41 49 Laurent GUERBY
# 2x Samsung SSD 840 EVO 1 TB maposmatic
42 50 Laurent GUERBY
# 1x Seagate 3To SATA ST3000DM001 ttnn
43 50 Laurent GUERBY
# 1x 3 TB guerby
44 29 Laurent GUERBY
# 1x SSD samsung 512 GB guerby
45 3 Laurent GUERBY
46 1 Laurent GUERBY
# TODO PC mutu Yannick ?
47 1 Laurent GUERBY
# TODO INSA ?
48 1 Laurent GUERBY
# perso autre ?
49 32 Laurent GUERBY
50 1 Laurent GUERBY
Total 5*32 + 1*24 + 7*16 + 1*8 = 304 GB upgradable  13*32 + 1*16 = 416 GB
51 17 Laurent GUERBY
52 17 Laurent GUERBY
Autres
53 17 Laurent GUERBY
54 19 Laurent GUERBY
# chaussette H77MA-G43 MS-7756 i3-3220 4GB RAM = 2x2 GB upgradable a 32 GB 2x1.5 TB 2x SATA6Gb + 4 x SATA3Gb http://www.msi.com/product/mb/H77MAG43.html#/?div=Basic
55 23 Laurent GUERBY
# lesplanade.org B75-D3V G620T 16GB RAM upgradable 32 GB 500GB disque 1xSATA6Gb 4x SATA3Gb 1xmSATA http://www.gigabyte.com/products/product-page.aspx?pid=4149#sp
56 25 Laurent GUERBY
# h7 Q87M vPro i5-4570 8GB upgradable a 32GB SSD Samsung_SSD_840_PRO_Series_S1ANNSAF106674W 6x SATA 3Gb   http://www.asrock.com/mb/Intel/Q87M%20vPro/
57 25 Laurent GUERBY
58 25 Laurent GUERBY
59 25 Laurent GUERBY
lapaillasse
60 25 Laurent GUERBY
<pre>
61 25 Laurent GUERBY
disque_dur WESTERN DIGITAL Caviar Red - 3 To - SATA 6Go/s  - 64 Mo cache - disque dur spécial pour NAS 
62 25 Laurent GUERBY
disque_dur WESTERN DIGITAL Caviar Green - 1 To - SATA   6Go/s - 64 Mo Cache WD10EZRX 
63 25 Laurent GUERBY
disque_dur WESTERN DIGITAL Caviar Red - 1 To - SATA 6Gos   - 64 Mo cache - disque dur spécial pour NAS 
64 25 Laurent GUERBY
processeur INTEL Core i3-3220 3.30GHz 3Mo Cache Socket    LGA1155 Graphics HD2500 35W BX80637I33220 |    BX80637I33220 
65 25 Laurent GUERBY
memoire_DDR3 KINGSTON Hyper X Blu Red Serie 8G (1x8Go)   PC12800 1600MHz CL10 | KHX16C10B1R/8 3x
66 25 Laurent GUERBY
carte_mere GIGABYTE GA-B75M-D3H | Chipset Intel B75 -    Socket 1155 - DDR3 - 2x PCIE 16X (dont 1x 3.0) - 1x SATA3 -    USB 3.0 - HDMI/DVI/VGA - mATX 
67 25 Laurent GUERBY
</pre>
68 1 Laurent GUERBY
69 1 Laurent GUERBY
Uses cases
70 1 Laurent GUERBY
71 1 Laurent GUERBY
# Je veux bien filer mes disques a installer sur d'autres machines mais je veux rester seul root sur mes machines physiques, je chiffrerai donc le stockage distant que j'utilise, possible ?
72 1 Laurent GUERBY
# Je veux bien partager des disques de ma machine mais je veux rester seul root sur mes machines physiques, possible ?
73 1 Laurent GUERBY
# Autre ?
74 1 Laurent GUERBY
75 1 Laurent GUERBY
h2. Reunions
76 21 Laurent GUERBY
77 1 Laurent GUERBY
h3. lundi 20140421 
78 21 Laurent GUERBY
79 21 Laurent GUERBY
midi Toulouse centre a la belle verte http://www.labellevertebio.com/
80 21 Laurent GUERBY
# Loic
81 21 Laurent GUERBY
# Elie
82 21 Laurent GUERBY
# Laurent
83 6 Laurent GUERBY
84 6 Laurent GUERBY
discussion droits et ceph : 
85 6 Laurent GUERBY
* http://ceph.com/docs/master/rados/operations/auth-intro/#cephx-limitations
86 7 Laurent GUERBY
* http://ceph.com/docs/master/rbd/rbd-ko/
87 7 Laurent GUERBY
* rados messages https://github.com/ceph/ceph/tree/master/src/messages
88 8 Laurent GUERBY
* rados messenger https://github.com/ceph/ceph/tree/master/src/msg
89 16 Laurent GUERBY
* Public access to RBD http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/019017.html
90 1 Laurent GUERBY
* Sharing hard drives with Ceph http://dachary.org/?p=2930
91 21 Laurent GUERBY
* patch par dachary pour simplifier : https://github.com/ceph/ceph/pull/1717
92 21 Laurent GUERBY
93 21 Laurent GUERBY
h3. vendredi 20140425
94 21 Laurent GUERBY
95 21 Laurent GUERBY
12h30 Labege http://www.lacoteetlarete.fr/
96 21 Laurent GUERBY
# Mehdi
97 21 Laurent GUERBY
# Joris
98 21 Laurent GUERBY
# Elie
99 21 Laurent GUERBY
# Lionel
100 22 Laurent GUERBY
# Laurent
101 22 Laurent GUERBY
102 22 Laurent GUERBY
* howto ubuntu http://redmine.the.re/projects/there/wiki/HOWTO_setup_OpenStack
103 22 Laurent GUERBY
* KVM debian rdb pb avec arm http://metadata.ftp-master.debian.org/changelogs//main/q/qemu/qemu_1.7.0+dfsg-9_changelog
104 22 Laurent GUERBY
* manifest enovance https://github.com/enovance/puppet-openstack-cloud
105 34 Laurent GUERBY
* BSD http://wiki.ceph.com/Planning/Blueprints/Emperor/Increasing_Ceph_portability
106 34 Laurent GUERBY
107 34 Laurent GUERBY
h3. mardi 20140902
108 34 Laurent GUERBY
109 34 Laurent GUERBY
9h 10 tricou, mehdi et laurent
110 34 Laurent GUERBY
111 34 Laurent GUERBY
<pre>
112 34 Laurent GUERBY
ceph osd tree
113 34 Laurent GUERBY
=> affiche les osd et devices
114 34 Laurent GUERBY
=> cat /proc/mounts pour voir ou c'est cree
115 34 Laurent GUERBY
116 34 Laurent GUERBY
ceph osd crush rule dump
117 35 Laurent GUERBY
=> regles
118 35 Laurent GUERBY
119 35 Laurent GUERBY
ceph osd pool get ssds min_size
120 35 Laurent GUERBY
=> repond ok apres min_size replica
121 35 Laurent GUERBY
ceph osd pool get ssds size
122 35 Laurent GUERBY
=> nb de replica
123 35 Laurent GUERBY
124 35 Laurent GUERBY
ceph -s
125 35 Laurent GUERBY
=> status du cluster
126 35 Laurent GUERBY
up => fonction
127 35 Laurent GUERBY
in => utilisé
128 35 Laurent GUERBY
129 35 Laurent GUERBY
pg = placement group
130 35 Laurent GUERBY
131 35 Laurent GUERBY
/etc/init.d/ceph stop osd 
132 35 Laurent GUERBY
=> simuler un arret
133 35 Laurent GUERBY
/etc/init.d/ceph stop osd.4
134 35 Laurent GUERBY
=> arret juste un disque
135 35 Laurent GUERBY
136 35 Laurent GUERBY
ceph osd set noout
137 35 Laurent GUERBY
ceph osd unset noout
138 35 Laurent GUERBY
=> desactive la replication automatique si on sait qu'on va couper une machine
139 35 Laurent GUERBY
140 36 Laurent GUERBY
rbp -p images import fichier_in fichier_dans_pool
141 36 Laurent GUERBY
=> ajout un pichier dans un pool ici images
142 36 Laurent GUERBY
143 36 Laurent GUERBY
rados lspools
144 37 Laurent GUERBY
=> liste des pools
145 37 Laurent GUERBY
146 37 Laurent GUERBY
rados -p disks ls
147 37 Laurent GUERBY
=> affiche les objets
148 37 Laurent GUERBY
149 37 Laurent GUERBY
ceph => osd/mon
150 37 Laurent GUERBY
rados => objets
151 34 Laurent GUERBY
rbd => block device
152 53 Laurent GUERBY
153 53 Laurent GUERBY
ceph osd dump -f json-pretty | grep ssd-cache -A39 -B1
154 38 Laurent GUERBY
</pre>
155 38 Laurent GUERBY
156 38 Laurent GUERBY
question a loic sur les placement groups
157 38 Laurent GUERBY
158 38 Laurent GUERBY
consideration reseau /etc/ceph/ceph.conf
159 38 Laurent GUERBY
160 38 Laurent GUERBY
<pre>
161 38 Laurent GUERBY
cluster_network = 192.168.3.0/24
162 38 Laurent GUERBY
# replication entre les osd
163 38 Laurent GUERBY
164 38 Laurent GUERBY
public_network = 192.168.3.0/24
165 38 Laurent GUERBY
mon_host = 192.168.3.101,192.168.3.102,192.168.3.103
166 38 Laurent GUERBY
# acces aux moniteurs + osd pour les clients
167 39 Laurent GUERBY
</pre>
168 53 Laurent GUERBY
169 39 Laurent GUERBY
170 39 Laurent GUERBY
171 39 Laurent GUERBY
<pre>
172 40 Laurent GUERBY
source os.conf
173 40 Laurent GUERBY
nova list 
174 39 Laurent GUERBY
nova list --fields host,networks,name
175 40 Laurent GUERBY
nova show VM
176 41 Laurent GUERBY
nova list --host g1 
177 41 Laurent GUERBY
178 41 Laurent GUERBY
neutron net-list
179 42 Laurent GUERBY
neutron port-list
180 43 Laurent GUERBY
181 44 Laurent GUERBY
/var/log/libvirt/livirtd.log
182 44 Laurent GUERBY
183 44 Laurent GUERBY
ovs-vsctl show
184 39 Laurent GUERBY
ovs-dpctl show
185 1 Laurent GUERBY
</pre>