{{>toc}}

h1. Openstack

h2. Objectifs

Monter un cluster openstack a tetaneutral.net en remplacement de ganeti (h1/4/5/6) + libvirt (n7).

h2. Liens

* [[Openstack Installation TTNN]]
* [[Openstack Management TTNN]]
* [[Openstack Setup VM pas dans openstack]]
* [[Ceph]]
* [[Ceph-Sharing-Disk]]

h2. Liens Externes

* https://en.wikipedia.org/wiki/OpenStack
* https://opensource.com/resources/openstack-tutorials
* http://opensource.com/business/14/5/new-openstack-tutorials
* http://opensource.com/business/14/11/8-new-tips-getting-things-done-openstack
* Dave Neary http://fr.slideshare.net/nearyd/neutron-open-vswt et http://www.youtube.com/watch?v=afImoFeuDnY
* https://www.openstack.org/summit/openstack-summit-hong-kong-2013/session-videos/presentation/how-to-write-a-neutron-plugin-if-you-really-need-to et http://www.slideshare.net/salv_orlando/how-to-write-a-neutron-plugin-if-you-really-need-to

h2. Bugs

* pb xfs TODO
* pb btrfs TODO
* vlan cassés OVS ixgbe en 3.16 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=763428
* nova perd des ports reseaux https://bugs.launchpad.net/nova/+bug/1323658
* ceph vs os-prober http://tracker.ceph.com/issues/9860

h2. Ressources

Ressources en place :
# g1 (ex bm0402) Q87M vPro i7-4770 32 GB FSF France Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 6x SATA 3Gb + 2X SSD 840 EVO 1TB http://www.asrock.com/mb/Intel/Q87M%20vPro/?cat=Specifications
# g2 (ex bm0403) Q87M vPro i7-4770 32 GB FSF France 2x Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB
# g3 (ex h8) Intel DQ67OW i5-2500 32 GB (ex velizy) INTEL SSDSC2CT060A3 60GB + ST2000DL004 2 TB + Samsung SSD 840 EVO 250GB http://ark.intel.com/products/51999/Intel-Desktop-Board-DQ67OW

Ressources dispo :

# n7 PowerEdge R310 rackable 32 GB 4x SATA http://www.dell.com/downloads/emea/products/R310_spec_sheet.pdf 3x ST31000528AS 7200.12 1TB (1 de cassé)
# STRI rackable 32 GB 1U SC813MTQ-350CBK - PWS-351-1H - 4x Hot-swap 3.5" SAS/SATA X9SCL-F 4xDDR3 UDIMM 8GB KVR1333D3E9S/8G xeon E3-1230V2 3x3TB WD3000FYYZ RE 7200rpm 2x (x8) PCI-E 3.0in x8 slots and 1x (x4) PCI-E 2.0 in x8 slot 2.0 in x8 slot 1x full-height, half-length PCI expansion slot (Riser Card Required) http://www.supermicro.com/products/motherboard/Xeon/C202_C204/X9SCL-F.cfm http://www.supermicro.com/manuals/chassis/1U/SC813.pdf

# h1 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2M040G2GC 40GB ST2000DL003 2TB WDC WD20EARS 2TB perso guerby
# h4 P8H67-M EVO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CW080G3 80GB WDC WD20EARS 2TB 4xSATA 3Gb 2xSATA 6Gb 1x eSATA perso guerby http://www.asus.com/Motherboards/P8H67M_EVO/specifications/
# h5 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3 40GB ST2000DM001 2TB 4xSATA 3Gb 2xSATA 6Gb http://www.asus.com/Motherboards/P8H67M_PRO/specifications/
# h6 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3 40GB ST2000DL004 2TB

# z2-4 P8H67-M PRO i7-2600 16GB upgradable 32 GB WDC WD4001FAEX 4 TB FSF France
# z2-9 GA-890GPA-UD3H AMD Phenom(tm) II X6 1055T 16GB pas upgradable WDC WD20EARS 2 TB INTEL SSDSC2MH250A2 250 GB INTEL SSDSC2MH250A2 250 GB 6x SATA 6Gb 2x SATA 3Gb FSF France http://www.gigabyte.com/products/product-page.aspx?pid=3516#sp

# xeon S1200BTL E3-1230 8GB upgradable a 32 GB INTEL SSDSC2CW120A3 120GB 6x SATA perso guerby http://ark.intel.com/products/53557/intel-server-board-s1200btl
# lapaillasse.org GA-B75M-D3H i3-3220 perso julien 24 GB upgradable 32 GB + TODO 5 disques http://www.gigabyte.com/products/product-page.aspx?pid=4150#sp
# pc2 DQ67SW i5-2500 16GB upgradable 32 GB perso guerby http://ark.intel.com/products/51997/intel-desktop-board-dq67sw

Stock ddur
# 1x Seagate 3To SATA ST3000DM001 7200 rpm ttnn
# 1x WD Blue WD10EZEX 1 TB 7200rpm gael mugen
# 2x Western Digital Caviar Black 7200rpm WD1002FAEX 1 TB lapaillasse
# 1x Hitachi Deskstar 7K1000.B 7200rpm 1 TB lapaillasse
# 1x WD10EFRX 5400rpm 1 TB lapaillasse
# 1x WD30EFRX 5400rpm 3 TB lapaillasse
# 1x 3 TB guerby
# 1x SSD samsung 830 512 GB guerby
# TODO PC mutu Yannick ?
# TODO INSA ?
# perso autre ?

Total 5*32 + 1*24 + 7*16 + 1*8 = 304 GB upgradable 13*32 + 1*16 = 416 GB

Autres

# chaussette H77MA-G43 MS-7756 i3-3220 4GB RAM = 2x2 GB upgradable a 32 GB 2x1.5 TB 2x SATA6Gb + 4 x SATA3Gb http://www.msi.com/product/mb/H77MAG43.html#/?div=Basic
# lesplanade.org B75-D3V G620T 16GB RAM upgradable 32 GB 500GB disque 1xSATA6Gb 4x SATA3Gb 1xmSATA http://www.gigabyte.com/products/product-page.aspx?pid=4149#sp
# h7 Q87M vPro i5-4570 8GB upgradable a 32GB SSD Samsung_SSD_840_PRO_Series_S1ANNSAF106674W 6x SATA 3Gb http://www.asrock.com/mb/Intel/Q87M%20vPro/

lapaillasse
<pre>
disque_dur WESTERN DIGITAL Caviar Red - 3 To - SATA 6Go/s - 64 Mo cache - disque dur spécial pour NAS
disque_dur WESTERN DIGITAL Caviar Green - 1 To - SATA 6Go/s - 64 Mo Cache WD10EZRX
disque_dur WESTERN DIGITAL Caviar Red - 1 To - SATA 6Gos - 64 Mo cache - disque dur spécial pour NAS
processeur INTEL Core i3-3220 3.30GHz 3Mo Cache Socket LGA1155 Graphics HD2500 35W BX80637I33220 | BX80637I33220
memoire_DDR3 KINGSTON Hyper X Blu Red Serie 8G (1x8Go) PC12800 1600MHz CL10 | KHX16C10B1R/8 3x
carte_mere GIGABYTE GA-B75M-D3H | Chipset Intel B75 - Socket 1155 - DDR3 - 2x PCIE 16X (dont 1x 3.0) - 1x SATA3 - USB 3.0 - HDMI/DVI/VGA - mATX
</pre>

Uses cases

# Je veux bien filer mes disques a installer sur d'autres machines mais je veux rester seul root sur mes machines physiques, je chiffrerai donc le stockage distant que j'utilise, possible ?
# Je veux bien partager des disques de ma machine mais je veux rester seul root sur mes machines physiques, possible ?
# Autre ?

h2. Reunions

h3. lundi 20140421

midi Toulouse centre a la belle verte http://www.labellevertebio.com/
# Loic
# Elie
# Laurent

discussion droits et ceph :
* http://ceph.com/docs/master/rados/operations/auth-intro/#cephx-limitations
* http://ceph.com/docs/master/rbd/rbd-ko/
* rados messages https://github.com/ceph/ceph/tree/master/src/messages
* rados messenger https://github.com/ceph/ceph/tree/master/src/msg
* Public access to RBD http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/019017.html
* Sharing hard drives with Ceph http://dachary.org/?p=2930
* patch par dachary pour simplifier : https://github.com/ceph/ceph/pull/1717

h3. vendredi 20140425

12h30 Labege http://www.lacoteetlarete.fr/
# Mehdi
# Joris
# Elie
# Lionel
# Laurent

* howto ubuntu http://redmine.the.re/projects/there/wiki/HOWTO_setup_OpenStack
* KVM debian rdb pb avec arm http://metadata.ftp-master.debian.org/changelogs//main/q/qemu/qemu_1.7.0+dfsg-9_changelog
* manifest enovance https://github.com/enovance/puppet-openstack-cloud
* BSD http://wiki.ceph.com/Planning/Blueprints/Emperor/Increasing_Ceph_portability

h3. mardi 20140902

9h 10 tricou, mehdi et laurent

<pre>
ceph osd tree
=> affiche les osd et devices
=> cat /proc/mounts pour voir ou c'est cree

ceph osd crush rule dump
=> regles

ceph osd pool get ssds min_size
=> repond ok apres min_size replica
ceph osd pool get ssds size
=> nb de replica

ceph -s
=> status du cluster
up => fonction
in => utilisé

pg = placement group

/etc/init.d/ceph stop osd
=> simuler un arret
/etc/init.d/ceph stop osd.4
=> arret juste un disque

ceph osd set noout
ceph osd unset noout
=> desactive la replication automatique si on sait qu'on va couper une machine

rbp -p images import fichier_in fichier_dans_pool
=> ajout un pichier dans un pool ici images

rados lspools
=> liste des pools

rados -p disks ls
=> affiche les objets

ceph => osd/mon
rados => objets
rbd => block device

ceph osd dump -f json-pretty | grep ssd-cache -A39 -B1
</pre>

question a loic sur les placement groups

consideration reseau /etc/ceph/ceph.conf

<pre>
cluster_network = 192.168.3.0/24
# replication entre les osd

public_network = 192.168.3.0/24
mon_host = 192.168.3.101,192.168.3.102,192.168.3.103
# acces aux moniteurs + osd pour les clients
</pre>

<pre>
source os.conf
nova list
nova list --fields host,networks,name
nova show VM
nova list --host g1

neutron net-list
neutron port-list

/var/log/libvirt/livirtd.log

ovs-vsctl show
ovs-dpctl show
</pre>