Welcome, Guest
Username: Password: Remember me
Archived CloudStack Forums for reference purposes please direct all future inquiries to the Apache CloudStack mailing lists.

incubator.apache.org/cloudstack/mailing-lists.html

TOPIC: New cloudstack 4 demo install

New cloudstack 4 demo install 10 months 2 weeks ago #13022

  • skeelime
  • skeelime's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
OS: Centos6.3
Hypervisor: KVM
Cloudstack 4

All on the same box for demo purposes.

Hello trying to get cloudstack working on the same box as the hypervisor/nfs etc and am having difficulties.

Box comes up fine and when I go through the basic wizard it sets everything up ok accept at the end it seems to have a hardtime starting the system VMs. It looks like the ConsoleVM starts ok but the secondaryvm just keeps appearing and disappearing. I dont' see a virtual router either. If I ssh into the console vm I can't ping anything etc. I am wondering if the problem is with the networking side of it. The box has a a static private IP on my internal network.

Here are the steps that I took to set it up:

Centos 6.3 minimal install

yum install ntp bridge-utils mysql-server

open up firewall:
iptables -P INPUT ACCEPT
iptables -P OUTPUT ACCEPT
iptables -P FORWARD ACCEPT
iptables -F
iptables -X
service iptables save


disable selinux

vi /etc/sysconfig/selinux

SELINUX=disabled

Setup repo

vi /etc/yum.repos.d/cloudstack.repo

[cloudstack]
name=cloudstack
baseurl=http://cloudstack.apt-get.eu/rhel/4.0
enabled=1
gpgcheck=0

yum install cloud-client

vi /etc/my.cnf

Add the following under [mysqld]
innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
log-bin=mysql-bin
binlog-format = 'ROW'

service mysqld restart
chkconfig mysqld on

mysqladmin -u root -p password mypassword
setup new password

/usr/bin/cloud-setup-databases cloud:dbpassword@localhost --deploy-as=root:dbpassword

vi /etc/sudoers

add

Defaults:cloud !requiretty


/usr/bin/cloud-setup-management

service rpcbind start
service nfs start
chkconfig rpcbind on
chkconfig nfs on



mkdir -p /export/primary
mkdir -p /export/secondary

vi /etc/exports
/export *(rw,async,no_root_squash)

Again assuming same node as management server:

vi /etc/sysconfig/nfs
LOCKD_TCPPORT=32803
LOCKD_UDPPORT=32769
MOUNTD_PORT=892
RQUOTAD_PORT=875
STATD_PORT=662
STATD_OUTGOING_PORT=2020

For KVM:

/usr/lib64/cloud/common/scripts/storage/secondary/cloud-install-sys-tmplt -m /export/secondary -u download.cloud.com/templates/acton/acton...m-02062012.qcow2.bz2 -h kvm -F

yum install cloud-agent

vi /etc/libvirt/libvirtd.conf

set the following parameters:

listen_tls = 0
listen_tcp = 1
tcp_port = 16059
auth_tcp = "none"
mdns_adv = 0

vi /etc/sysconfig/libvirtd

uncomment LIBVIRTD_ARGS="--listen"

service libvirtd restart
chkconfig libvirtd on

Install vhd-util

wget download.cloud.com.s3.amazonaws.com/tools/vhd-util

cp vhd-util /usr/lib64/cloud/common/scripts/vm/hypervisor/kvm/

Set VLANS

vi /etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE="eth0"
BOOTPROTO="none"
HWADDR="D4:BE:D9:A4:D4:CC"
ONBOOT="yes"
IPADDR="192.168.2.198"
GATEWAY="192.168.2.1"
NETMASK="255.255.0.0"
HOTPLUG=no
TYPE="Ethernet"
NW_CONTROLLED="no"


vi /etc/sysconfig/network-scripts/ifcfg-eth0.100

DEVICE="eth0.100"
BOOTPROTO="none"
ONBOOT="yes"
HOTPLUG="no"
TYPE="Ethernet"
VLAN="yes"
NW_CONTROLLED="no"
IPADDR=192.168.2.199
NETMASK=255.255.0.0
GATEWAY=192.168.2.1


vi /etc/sysconfig/network-scripts/ifcfg-eth0.200

DEVICE="eth0.200"
BOOTPROTO="none"
ONBOOT="yes"
HOTPLUG="no"
TYPE="Ethernet"
VLAN="yes"
NW_CONTROLLED="no"
BRIDGE=cloudbr0


vi /etc/sysconfig/network-scripts/ifcfg-eth0.300

DEVICE="eth0.300"
BOOTPROTO="none"
ONBOOT="yes"
HOTPLUG="no"
NW_CONTROLLED="no"
TYPE="Ethernet"
VLAN="yes"
BRIDGE=cloudbr1

vi /etc/sysconfig/network-scripts/ifcfg-cloudbr0

DEVICE="cloudbr0"
TYPE="Bridge"
BOOTPROTO="none"
ONBOOT="yes"
HOTPLUG="no"
NW_CONTROLLED="no"
IPV6INIT=no
IPV6_AUTOCONF=no
DELAY=5
STP=yes



/etc/sysconfig/network-scripts/ifcfg-cloudbr1

DEVICE="cloudbr1"
TYPE="Bridge"
BOOTPROTO="none"
ONBOOT="yes"
HOTPLUG="no"
NW_CONTROLLED="no"
IPV6INIT=no
IPV6_AUTOCONF=no
DELAY=5
STP=yes





/etc/init.d/cloud-management start

chkconfig cloud-management on
chkconfig ntpd on

access through http://hostname:8080/client/

Went through basic wizard setup.


Public IP 192.168.46.0/16
Gateway 192.168.46.1

Private IP 192.168.45.0/16
Gateway 192.168.45.1

Host installed ok etc. Only problem appears to be with the System VMs coming up.


error from agent.log

2012-11-26 14:13:54,035 ERROR [cloud.resource.ServerResourceBase] (main:null) Nics are not configured!
2012-11-26 14:13:54,056 INFO [cloud.resource.ServerResourceBase] (main:null) Designating private to be nic eth0.100

errors from management-server.log

2012-11-26 16:42:01,261 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn

012-11-26 16:42:30,726 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-291-VM]Scope=interface com.cloud.dc.DataCenter; id=1
at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:734)
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472)
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465)
at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257)
at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684)
at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310)
at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119)
at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50)
at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106)
at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34)
at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83)
at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2012-11-26 16:42:30,726 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 291, will recycle it and start a new one
The administrator has disabled public write access.

Re: New cloudstack 4 demo install 10 months 2 weeks ago #13024

  • skeelime
  • skeelime's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
Got it working using something similar to this guy:

www.bizalgo.com/2012/07/08/making-clouds...ick-install-quicker/

My only problem is now that I can't get to anything on the internet but all internal lan resources are working on my system vms. The management/hypervisor server (they are on teh same box) work fine I can ping everything.

Anyone have any idea why it wouldn't be working? Seems like a really strange routing issue:

Management/KVM network config.

Nic:

DEVICE="eth0"
BOOTPROTO="static"
HWADDR="D4:BE:D9:A4:D4:CC"

NM_CONTROLLED=no

ONBOOT=yes
TYPE="Ethernet"
IPADDR=192.168.4.199
GATEWAY=192.168.2.1
NETMASK=255.255.0.0
UUID="ea3cdf75-319d-4bde-a76d-49e04ee3f27a"
BRIDGE=cloudbr0

cloudbr0

DEVICE=cloudbr0
BOOTPROTO="static"
HWADDR="D4:BE:D9:A4:D4:CC"

NM_CONTROLLED=no

ONBOOT=yes

TYPE=Bridge
IPADDR=192.168.4.199
GATEWAY=192.168.2.1
NETMASK=255.255.0.0
UUID="ea3cdf75-319d-4bde-a76d-49e04ee3f27a"

It should be noticed that cloudstack configured these for me I just had my eth witha basic static etc it turned around and added the bridge stuff.

It is strange that I can ping all lan devices including those that have nothing to do with cloudstack but I am unable to ping anything past my ISP router which is the 192.168.2.1.

I tried ping the wan side of the router from one of the system vm and after a huge wait it started responding:

PING myip (myip): 56 data bytes
64 bytes from myip: icmp_seq=135 ttl=64 time=992.763 ms
64 bytes from myip: icmp_seq=136 ttl=64 time=0.493 ms
64 bytes from myip: icmp_seq=137 ttl=64 time=0.517 ms

My system VM are configured within the same subnet range as the management/kvm server 192.168.4.0/16

Nothing seems to respond on the internet.
Last Edit: 10 months 2 weeks ago by skeelime.
The administrator has disabled public write access.
Time to create page: 0.314 seconds

Open@Citrix

Citrix supports the open source community via developer support and evangeslism. We have a number of developers and evangelists that participate actively in the open source community in Apache Cloudstack, OpenDaylight, Xen Project and XenServer. We also conduct educational activities via the Build A Cloud events held all over the world. 

Connect