Projet

Général

Profil

Openstack » Historique » Version 74

Mehdi Abaakouk, 25/03/2015 08:22

1 1 Laurent GUERBY
{{>toc}}
2 1 Laurent GUERBY
3 1 Laurent GUERBY
h1. Openstack
4 1 Laurent GUERBY
5 1 Laurent GUERBY
h2. Objectifs
6 1 Laurent GUERBY
7 2 Laurent GUERBY
Monter un cluster openstack a tetaneutral.net en remplacement de ganeti (h1/4/5/6) + libvirt (n7).
8 1 Laurent GUERBY
9 24 Laurent GUERBY
h2. Liens
10 24 Laurent GUERBY
11 74 Mehdi Abaakouk
* [[Openstack Installation nouvelle node du cluster]]
12 60 Mehdi Abaakouk
* [[Openstack Management TTNN]]
13 1 Laurent GUERBY
* [[Openstack Setup VM pas dans openstack]]
14 74 Mehdi Abaakouk
* [[Openstack Installation TTNN]]
15 64 Laurent GUERBY
* [[Ceph]]
16 64 Laurent GUERBY
* [[Ceph-Sharing-Disk]]
17 63 Laurent GUERBY
18 63 Laurent GUERBY
h2. Liens Externes
19 63 Laurent GUERBY
20 46 Laurent GUERBY
* https://en.wikipedia.org/wiki/OpenStack
21 68 Laurent GUERBY
* https://opensource.com/resources/openstack-tutorials
22 46 Laurent GUERBY
* http://opensource.com/business/14/5/new-openstack-tutorials
23 67 Laurent GUERBY
* http://opensource.com/business/14/11/8-new-tips-getting-things-done-openstack
24 45 Laurent GUERBY
* Dave Neary http://fr.slideshare.net/nearyd/neutron-open-vswt et http://www.youtube.com/watch?v=afImoFeuDnY
25 48 Laurent GUERBY
* https://www.openstack.org/summit/openstack-summit-hong-kong-2013/session-videos/presentation/how-to-write-a-neutron-plugin-if-you-really-need-to et http://www.slideshare.net/salv_orlando/how-to-write-a-neutron-plugin-if-you-really-need-to
26 24 Laurent GUERBY
27 66 Laurent GUERBY
h2. Bugs
28 66 Laurent GUERBY
29 66 Laurent GUERBY
30 66 Laurent GUERBY
* pb xfs TODO
31 66 Laurent GUERBY
* pb btrfs TODO
32 66 Laurent GUERBY
* vlan cassés OVS ixgbe en 3.16 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=763428
33 66 Laurent GUERBY
* nova perd des ports reseaux https://bugs.launchpad.net/nova/+bug/1323658
34 66 Laurent GUERBY
* ceph vs os-prober http://tracker.ceph.com/issues/9860
35 66 Laurent GUERBY
36 11 Laurent GUERBY
h2. Ressources
37 10 Laurent GUERBY
38 54 Laurent GUERBY
Ressources en place :
39 71 Laurent GUERBY
40 54 Laurent GUERBY
# g1 (ex bm0402) Q87M vPro  i7-4770 32 GB FSF France Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 6x SATA 3Gb + 2X SSD 840 EVO 1TB http://www.asrock.com/mb/Intel/Q87M%20vPro/?cat=Specifications
41 54 Laurent GUERBY
# g2 (ex bm0403) Q87M vPro  i7-4770 32 GB FSF France 2x Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 
42 54 Laurent GUERBY
# g3 (ex h8) Intel DQ67OW  i5-2500  32 GB (ex velizy) INTEL SSDSC2CT060A3 60GB + ST2000DL004 2 TB + Samsung SSD 840 EVO 250GB http://ark.intel.com/products/51999/Intel-Desktop-Board-DQ67OW
43 73 Laurent GUERBY
# n7 PowerEdge R310 Xeon X3430 rackable 32 GB 4x SATA http://www.dell.com/downloads/emea/products/R310_spec_sheet.pdf HDD 3x3 TB + SSD 250GB
44 1 Laurent GUERBY
# STRI rackable 32 GB 1U SC813MTQ-350CBK - PWS-351-1H - 4x Hot-swap 3.5" SAS/SATA X9SCL-F 4xDDR3 UDIMM 8GB KVR1333D3E9S/8G xeon E3-1230V2 3x3TB WD3000FYYZ RE 7200rpm 2x (x8) PCI-E 3.0in x8 slots and 1x (x4) PCI-E 2.0 in x8 slot 2.0 in x8 slot 1x full-height, half-length PCI expansion slot (Riser Card Required) http://www.supermicro.com/products/motherboard/Xeon/C202_C204/X9SCL-F.cfm http://www.supermicro.com/manuals/chassis/1U/SC813.pdf
45 71 Laurent GUERBY
# g4 (ex z2-4) P8H67-M PRO i7-2600 32 GB RAM WDC WD4001FAEX 4 TB FSF France
46 72 Laurent GUERBY
# g5 Q87M vPro i5-4570 CPU @ 3.20GHz 32 GB RAM 
47 57 Laurent GUERBY
48 59 Laurent GUERBY
Ressources dispo :
49 52 Laurent GUERBY
50 49 Laurent GUERBY
# h1 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2M040G2GC 40GB  ST2000DL003 2TB WDC WD20EARS 2TB perso guerby 
51 49 Laurent GUERBY
# h4 P8H67-M EVO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CW080G3  80GB WDC WD20EARS 2TB 4xSATA 3Gb 2xSATA 6Gb 1x eSATA perso guerby http://www.asus.com/Motherboards/P8H67M_EVO/specifications/
52 49 Laurent GUERBY
# h5 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3  40GB  ST2000DM001 2TB 4xSATA 3Gb 2xSATA 6Gb http://www.asus.com/Motherboards/P8H67M_PRO/specifications/
53 52 Laurent GUERBY
# h6 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3  40GB  ST2000DL004 2TB
54 69 Laurent GUERBY
55 65 Laurent GUERBY
# z2-9 GA-890GPA-UD3H  AMD Phenom(tm) II X6 1055T   16GB pas upgradable WDC WD20EARS 2 TB INTEL SSDSC2MH250A2 250 GB INTEL SSDSC2MH250A2 250 GB 6x SATA 6Gb 2x SATA 3Gb FSF France http://www.gigabyte.com/products/product-page.aspx?pid=3516#sp
56 12 Laurent GUERBY
57 15 Laurent GUERBY
# xeon S1200BTL E3-1230 8GB upgradable a 32 GB INTEL SSDSC2CW120A3 120GB 6x SATA  perso guerby http://ark.intel.com/products/53557/intel-server-board-s1200btl
58 55 Laurent GUERBY
# lapaillasse.org GA-B75M-D3H  i3-3220 perso julien 24 GB upgradable 32 GB + TODO 5 disques http://www.gigabyte.com/products/product-page.aspx?pid=4150#sp
59 1 Laurent GUERBY
# pc2 DQ67SW i5-2500 16GB upgradable 32 GB perso guerby http://ark.intel.com/products/51997/intel-desktop-board-dq67sw
60 49 Laurent GUERBY
61 49 Laurent GUERBY
Stock ddur
62 55 Laurent GUERBY
# 1x Seagate 3To SATA ST3000DM001 7200 rpm ttnn
63 55 Laurent GUERBY
# 1x WD Blue WD10EZEX 1 TB 7200rpm gael mugen
64 56 Laurent GUERBY
# 2x  Western Digital Caviar Black 7200rpm WD1002FAEX 1 TB lapaillasse
65 56 Laurent GUERBY
# 1x Hitachi Deskstar 7K1000.B 7200rpm 1 TB lapaillasse
66 56 Laurent GUERBY
# 1x WD10EFRX 5400rpm 1 TB lapaillasse
67 56 Laurent GUERBY
# 1x WD30EFRX 5400rpm 3 TB lapaillasse
68 54 Laurent GUERBY
# 1x 3 TB guerby
69 3 Laurent GUERBY
# 1x SSD samsung 830 512 GB guerby
70 1 Laurent GUERBY
# TODO PC mutu Yannick ?
71 1 Laurent GUERBY
# TODO INSA ?
72 1 Laurent GUERBY
# perso autre ?
73 32 Laurent GUERBY
74 1 Laurent GUERBY
Total 5*32 + 1*24 + 7*16 + 1*8 = 304 GB upgradable  13*32 + 1*16 = 416 GB
75 17 Laurent GUERBY
76 17 Laurent GUERBY
Autres
77 17 Laurent GUERBY
78 19 Laurent GUERBY
# chaussette H77MA-G43 MS-7756 i3-3220 4GB RAM = 2x2 GB upgradable a 32 GB 2x1.5 TB 2x SATA6Gb + 4 x SATA3Gb http://www.msi.com/product/mb/H77MAG43.html#/?div=Basic
79 23 Laurent GUERBY
# lesplanade.org B75-D3V G620T 16GB RAM upgradable 32 GB 500GB disque 1xSATA6Gb 4x SATA3Gb 1xmSATA http://www.gigabyte.com/products/product-page.aspx?pid=4149#sp
80 25 Laurent GUERBY
# h7 Q87M vPro i5-4570 8GB upgradable a 32GB SSD Samsung_SSD_840_PRO_Series_S1ANNSAF106674W 6x SATA 3Gb   http://www.asrock.com/mb/Intel/Q87M%20vPro/
81 25 Laurent GUERBY
82 25 Laurent GUERBY
83 25 Laurent GUERBY
lapaillasse
84 25 Laurent GUERBY
<pre>
85 25 Laurent GUERBY
disque_dur WESTERN DIGITAL Caviar Red - 3 To - SATA 6Go/s  - 64 Mo cache - disque dur spécial pour NAS 
86 25 Laurent GUERBY
disque_dur WESTERN DIGITAL Caviar Green - 1 To - SATA   6Go/s - 64 Mo Cache WD10EZRX 
87 25 Laurent GUERBY
disque_dur WESTERN DIGITAL Caviar Red - 1 To - SATA 6Gos   - 64 Mo cache - disque dur spécial pour NAS 
88 25 Laurent GUERBY
processeur INTEL Core i3-3220 3.30GHz 3Mo Cache Socket    LGA1155 Graphics HD2500 35W BX80637I33220 |    BX80637I33220 
89 25 Laurent GUERBY
memoire_DDR3 KINGSTON Hyper X Blu Red Serie 8G (1x8Go)   PC12800 1600MHz CL10 | KHX16C10B1R/8 3x
90 25 Laurent GUERBY
carte_mere GIGABYTE GA-B75M-D3H | Chipset Intel B75 -    Socket 1155 - DDR3 - 2x PCIE 16X (dont 1x 3.0) - 1x SATA3 -    USB 3.0 - HDMI/DVI/VGA - mATX 
91 25 Laurent GUERBY
</pre>
92 1 Laurent GUERBY
93 1 Laurent GUERBY
Uses cases
94 1 Laurent GUERBY
95 1 Laurent GUERBY
# Je veux bien filer mes disques a installer sur d'autres machines mais je veux rester seul root sur mes machines physiques, je chiffrerai donc le stockage distant que j'utilise, possible ?
96 1 Laurent GUERBY
# Je veux bien partager des disques de ma machine mais je veux rester seul root sur mes machines physiques, possible ?
97 1 Laurent GUERBY
# Autre ?
98 1 Laurent GUERBY
99 1 Laurent GUERBY
h2. Reunions
100 21 Laurent GUERBY
101 1 Laurent GUERBY
h3. lundi 20140421 
102 21 Laurent GUERBY
103 21 Laurent GUERBY
midi Toulouse centre a la belle verte http://www.labellevertebio.com/
104 21 Laurent GUERBY
# Loic
105 21 Laurent GUERBY
# Elie
106 21 Laurent GUERBY
# Laurent
107 6 Laurent GUERBY
108 6 Laurent GUERBY
discussion droits et ceph : 
109 6 Laurent GUERBY
* http://ceph.com/docs/master/rados/operations/auth-intro/#cephx-limitations
110 7 Laurent GUERBY
* http://ceph.com/docs/master/rbd/rbd-ko/
111 7 Laurent GUERBY
* rados messages https://github.com/ceph/ceph/tree/master/src/messages
112 8 Laurent GUERBY
* rados messenger https://github.com/ceph/ceph/tree/master/src/msg
113 16 Laurent GUERBY
* Public access to RBD http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/019017.html
114 1 Laurent GUERBY
* Sharing hard drives with Ceph http://dachary.org/?p=2930
115 21 Laurent GUERBY
* patch par dachary pour simplifier : https://github.com/ceph/ceph/pull/1717
116 21 Laurent GUERBY
117 21 Laurent GUERBY
h3. vendredi 20140425
118 21 Laurent GUERBY
119 21 Laurent GUERBY
12h30 Labege http://www.lacoteetlarete.fr/
120 21 Laurent GUERBY
# Mehdi
121 21 Laurent GUERBY
# Joris
122 21 Laurent GUERBY
# Elie
123 21 Laurent GUERBY
# Lionel
124 22 Laurent GUERBY
# Laurent
125 22 Laurent GUERBY
126 22 Laurent GUERBY
* howto ubuntu http://redmine.the.re/projects/there/wiki/HOWTO_setup_OpenStack
127 22 Laurent GUERBY
* KVM debian rdb pb avec arm http://metadata.ftp-master.debian.org/changelogs//main/q/qemu/qemu_1.7.0+dfsg-9_changelog
128 22 Laurent GUERBY
* manifest enovance https://github.com/enovance/puppet-openstack-cloud
129 34 Laurent GUERBY
* BSD http://wiki.ceph.com/Planning/Blueprints/Emperor/Increasing_Ceph_portability
130 34 Laurent GUERBY
131 34 Laurent GUERBY
h3. mardi 20140902
132 34 Laurent GUERBY
133 34 Laurent GUERBY
9h 10 tricou, mehdi et laurent
134 34 Laurent GUERBY
135 34 Laurent GUERBY
<pre>
136 34 Laurent GUERBY
ceph osd tree
137 34 Laurent GUERBY
=> affiche les osd et devices
138 34 Laurent GUERBY
=> cat /proc/mounts pour voir ou c'est cree
139 34 Laurent GUERBY
140 34 Laurent GUERBY
ceph osd crush rule dump
141 35 Laurent GUERBY
=> regles
142 35 Laurent GUERBY
143 35 Laurent GUERBY
ceph osd pool get ssds min_size
144 35 Laurent GUERBY
=> repond ok apres min_size replica
145 35 Laurent GUERBY
ceph osd pool get ssds size
146 35 Laurent GUERBY
=> nb de replica
147 35 Laurent GUERBY
148 35 Laurent GUERBY
ceph -s
149 35 Laurent GUERBY
=> status du cluster
150 35 Laurent GUERBY
up => fonction
151 35 Laurent GUERBY
in => utilisé
152 35 Laurent GUERBY
153 35 Laurent GUERBY
pg = placement group
154 35 Laurent GUERBY
155 35 Laurent GUERBY
/etc/init.d/ceph stop osd 
156 35 Laurent GUERBY
=> simuler un arret
157 35 Laurent GUERBY
/etc/init.d/ceph stop osd.4
158 35 Laurent GUERBY
=> arret juste un disque
159 35 Laurent GUERBY
160 35 Laurent GUERBY
ceph osd set noout
161 35 Laurent GUERBY
ceph osd unset noout
162 35 Laurent GUERBY
=> desactive la replication automatique si on sait qu'on va couper une machine
163 35 Laurent GUERBY
164 36 Laurent GUERBY
rbp -p images import fichier_in fichier_dans_pool
165 36 Laurent GUERBY
=> ajout un pichier dans un pool ici images
166 36 Laurent GUERBY
167 36 Laurent GUERBY
rados lspools
168 37 Laurent GUERBY
=> liste des pools
169 37 Laurent GUERBY
170 37 Laurent GUERBY
rados -p disks ls
171 37 Laurent GUERBY
=> affiche les objets
172 37 Laurent GUERBY
173 37 Laurent GUERBY
ceph => osd/mon
174 37 Laurent GUERBY
rados => objets
175 34 Laurent GUERBY
rbd => block device
176 53 Laurent GUERBY
177 53 Laurent GUERBY
ceph osd dump -f json-pretty | grep ssd-cache -A39 -B1
178 38 Laurent GUERBY
</pre>
179 38 Laurent GUERBY
180 38 Laurent GUERBY
question a loic sur les placement groups
181 38 Laurent GUERBY
182 38 Laurent GUERBY
consideration reseau /etc/ceph/ceph.conf
183 38 Laurent GUERBY
184 38 Laurent GUERBY
<pre>
185 38 Laurent GUERBY
cluster_network = 192.168.3.0/24
186 38 Laurent GUERBY
# replication entre les osd
187 38 Laurent GUERBY
188 38 Laurent GUERBY
public_network = 192.168.3.0/24
189 38 Laurent GUERBY
mon_host = 192.168.3.101,192.168.3.102,192.168.3.103
190 38 Laurent GUERBY
# acces aux moniteurs + osd pour les clients
191 39 Laurent GUERBY
</pre>
192 53 Laurent GUERBY
193 39 Laurent GUERBY
194 39 Laurent GUERBY
195 39 Laurent GUERBY
<pre>
196 40 Laurent GUERBY
source os.conf
197 40 Laurent GUERBY
nova list 
198 39 Laurent GUERBY
nova list --fields host,networks,name
199 40 Laurent GUERBY
nova show VM
200 41 Laurent GUERBY
nova list --host g1 
201 41 Laurent GUERBY
202 41 Laurent GUERBY
neutron net-list
203 42 Laurent GUERBY
neutron port-list
204 43 Laurent GUERBY
205 44 Laurent GUERBY
/var/log/libvirt/livirtd.log
206 44 Laurent GUERBY
207 44 Laurent GUERBY
ovs-vsctl show
208 39 Laurent GUERBY
ovs-dpctl show
209 1 Laurent GUERBY
</pre>