Welcome, Guest
Username: Password: Remember me
Archived CloudStack Forums for reference purposes please direct all future inquiries to the Apache CloudStack mailing lists.

incubator.apache.org/cloudstack/mailing-lists.html

TOPIC: Waiting For Built-In Templates To Load

Waiting For Built-In Templates To Load 1 year 3 months ago #11519

  • Pytheas
  • Pytheas's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 11
  • Karma: 0
This is a low priority help request. I am just learning Cloudstack for myself and have no production impact for what I am attempting.

Problem statement: Waiting for built-in templates to load is taking a very long while. 20 hours and counting.

Background notes: This is a basic installation consiting of two nodes. One running CloudStack 3.0.2 and the other Citrix Xenserver 6.0.2
There were no obstacles in reaching this point. Both servers are i7 64 bit. The CloudStack Management server is Centos 6.02.

The primary storage continues to get updated and the files continue to grow but at a very slow rate. Here is an ls -l after 20+ hours.

total 684316
-rw-r--r--. 1 root root 565240320 Jun 28 12:45 4a0de6dd-2d3b-4c7e-8626-d964667f0ba0.vhd
-rw-r--r--. 1 root root 8704 Jun 28 12:47 b010d64d-bf62-469f-9d47-f63064bdf983.vhd
-rw-r--r--. 1 root root 1476 Jun 28 12:47 filelog.txt
-rw-r--r--. 1 root root 11 Jun 29 21:37 hb-cb068dd4-a096-4239-bf9f-a68ab30e4b80
-rw-r--r--. 1 root root 200318976 Jun 29 21:37 d881f89f-7fc2-4c61-817e-adf929b1fa4b.vhd
-rw-r--r--. 1 root root 194846720 Jun 29 21:37 84dcd0d7-3377-45e5-ad7e-1e46aa162f4d.vhd

I routinely am able to download 4gb files in about an hour so I am doubtful that it's my internet connection. 20+ hours and less than a 1gig total seems to say I've done something wrong.

Using netstat -a I concluded that the software is connecting to a23-3-106-8.deploy.aka.com

Here is the output from ping.

PING a23-3-106-8.deploy.aka.com (209.59.195.20) 56(84) bytes of data.
64 bytes from 209.59.195.20: icmp_seq=1 ttl=51 time=20.8 ms
64 bytes from 209.59.195.20: icmp_seq=2 ttl=51 time=22.2 ms
64 bytes from 209.59.195.20: icmp_seq=3 ttl=51 time=20.7 ms
64 bytes from 209.59.195.20: icmp_seq=4 ttl=51 time=20.2 ms
64 bytes from 209.59.195.20: icmp_seq=5 ttl=51 time=21.3 ms

Seems like a quite fast response time.
I have attached the management-server.log file.
If other files are desired, please let me know.

Running my eye over the log file I see this...
2012-06-29 21:51:47,336 DEBUG [agent.manager.AgentManagerImpl] (StatsCollector-2:null) Details from executing class com.cloud.agent.api.GetStorageStatsCommand: com.cloud.utils.exception.CloudRuntimeException: GetRootDir for nfs://hook/export/secondary failed due to java.net.UnknownHostException: hook

hook refers to the short hostname of my management server. hook.commonwealth.com (commonwealth.com is a private domain, not the 'real' internet one). An internal DNS is implemented via dnsmasq and port 53 has been opened on the management server with appropriate netfilter iptables entries. My 'cloud' consists of two nodes. hook.commonwealth.com and xenserver-1.commonwealth.com

Both are resolvable as evidenced by the following:

[root@hook management]# nslookup hook
Server: 192.168.1.5
Address: 192.168.1.5#53

Name: hook.commonwealth.com
Address: 192.168.1.5

[root@hook management]# nslookup xenserver-1
Server: 192.168.1.5
Address: 192.168.1.5#53

Name: xenserver-1.commonwealth.com
Address: 192.168.1.11

(both nodes are also resolvable on the xenserver).

As I have written quite a bit at this point and may be wandering off in the wrong direction for a solution I'll stop here and see what feedback and/or questions I receive. I didn't want to overwhelm with files so I only included the management-server.log file and a UI screenshot. If other data is required let me know.
The administrator has disabled public write access.

Re: Waiting For Built-In Templates To Load 1 year 3 months ago #11532

  • muddy
  • muddy's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 26
  • Thank you received: 1
  • Karma: 2
the templates are hosted on amazon, so if youre getting a painfully slow download, its probably bad luck of the draw. There are multiple regions the template is avail. so you might have gotten a link to something far or with poor connectivity in between.
The administrator has disabled public write access.

Re: Waiting For Built-In Templates To Load 1 year 3 months ago #11533

  • muddy
  • muddy's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 26
  • Thank you received: 1
  • Karma: 2
Tip: I suggest you download it locally and modify the database to point to that 'fast' link. template_host_ref is the table to modify.
The administrator has disabled public write access.

Re: Waiting For Built-In Templates To Load 1 year 3 months ago #11543

  • Pytheas
  • Pytheas's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 11
  • Karma: 0
Thank you for the input. Looking at the contents of template_host_ref it may be the case that we are talking about two different things.
+----+
+
+
+
| id | url | download_pct | last_updated |
+----+
+
+
+
| 1 | download.cloud.com/templates/acton/acton...mvm-02062012.vhd.bz2 | 100 | 2012-06-28 16:43:22 |
| 2 | download.cloud.com/templates/acton/acton-systemvm-02062012.ova | 100 | 2012-06-28 16:43:22 |
| 3 | download.cloud.com/templates/acton/acton...m-02062012.qcow2.bz2 | 100 | 2012-06-28 16:43:22 |
| 4 | download.cloud.com/templates/acton/acton...mvm-02062012.vhd.bz2 | 100 | 2012-06-28 16:43:22 |
+----+
+
+
+

The above referenced files are created/downloaded by the cloud-install-sys-templt script referenced on page 20-21 of the Basic Installation Guide for CloudStack versions 3.0.0-3.0.2. Do I have that correct? The cloud-install-sys-templt script completed without incident and was pretty brief. The step I'm waiting on comes after the first time login to the UI at <mgt-server-name>:8080/client and selecting continue with basic installation. Eventually I see the following items are displayed with green checkmarks to the left of the item.

Creating Zone
Creating Physical Network
Configuring Physical Network
Enabling Security Group Provider
Creating Guest Network
Creating Pod
Configuring Guest Traffic
Creating Cluster
Adding Host
Creating Primary Storage
Creating Secondary Storage
Zone Creation Complete
Enabling Zone...
Creating System VMs (this may take awhile) (for me it took about 10 minutes or less)
System VMs Ready

Then there is an item that is in progress (without green checkmark) and has now been running for 72 hours. It is titled
- waiting for builtin templates to load. This is where I'm stuck. After 72 hours the files it is building/populating have only grown marginally. Compare to my original ls -l.

-rw-r--r--. 1 root root 565240320 Jun 28 12:45 4a0de6dd-2d3b-4c7e-8626-d964667f0ba0.vhd
-rw-r--r--. 1 root root 8704 Jun 28 12:47 b010d64d-bf62-469f-9d47-f63064bdf983.vhd
-rw-r--r--. 1 root root 1476 Jun 28 12:47 filelog.txt
-rw-r--r--. 1 root root 11 Jul 2 06:31 hb-cb068dd4-a096-4239-bf9f-a68ab30e4b80
-rw-r--r--. 1 root root 225177600 Jul 2 06:31 d881f89f-7fc2-4c61-817e-adf929b1fa4b.vhd
-rw-r--r--. 1 root root 218537984 Jul 2 06:31 84dcd0d7-3377-45e5-ad7e-1e46aa162f4d.vhd

I'm believe I jumped the gun on thinking that the a23-3-106-8.deploy.aka.com host is related to the cloudstack software. Browsing to that URL also makes me suspicious that it's cloudstack related.

So taking a step back...

What is it exactly that takes place during the "waiting for built-in templates to load" step?
Is that a network operation?
If so, is it a network operation between my two local nodes or is it pulling something from the web?

Where are the files in /export/primary being populated from?
The administrator has disabled public write access.

Re: Waiting For Built-In Templates To Load 1 year 3 months ago #11594

  • mattwang
  • mattwang's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 16
  • Thank you received: 1
  • Karma: 0
Hi Pytheas, I have the same problem with you.

Is there any way to downlaod the template file and upload it to one specific path, and then install or register it manually?

It's critical because I can not create instance without any VM template. Only the System VM template is shown on the template screen.

Thanks!
Last Edit: 1 year 3 months ago by mattwang.
The administrator has disabled public write access.

Re: Waiting For Built-In Templates To Load 1 year 3 months ago #11637

  • Pytheas
  • Pytheas's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 11
  • Karma: 0
mattwang wrote:
Hi Pytheas, I have the same problem with you.

Is there any way to downlaod the template file and upload it to one specific path, and then install or register it manually?

Hi Matt,

I put Cloudstack aside for a week and am just catching up now.

Yes, it is possible to create your own templates. I'll tackle learning how later this week via the more advanced documentation. i.e. The Advanced Install Guide and the Administration Guide. I do not know if it's possible to do a manual download of a template file however. It might be, and I'm speculating here based on skimming the docs, that you'll create a template using an ISO that you d/l from the specific official website such as Centos.org, set it up as a http download on a local machine and then use the new (or add) template feature under templates in the UI...which prompts you for a URL to download the template from.

I may also wipe out my current install and start over again just to make certain I didn't miss any steps. I have a suspicion that I'm configured correctly and that I'm stuck on a download limitation - it's even possible my ISP is throttling me back - although I don't get throttled on other big downloads.

If I make progress I'll post my update here.
Last Edit: 1 year 3 months ago by Pytheas.
The administrator has disabled public write access.
Time to create page: 0.318 seconds

Open@Citrix

Citrix supports the open source community via developer support and evangeslism. We have a number of developers and evangelists that participate actively in the open source community in Apache Cloudstack, OpenDaylight, Xen Project and XenServer. We also conduct educational activities via the Build A Cloud events held all over the world. 

Connect