Hey folks. So, recently I have been doing a bit of work on the Rackspace community, specifically trying to document and make as easy as possible the importing and exporting of cloud server VHD’s between Rackspace regions. This might be really useful if you are designing some HA or multi-region and\/or load balancing solution that might be utilizing autoscale, and other kinds of redundancy too, but moving your ‘golden image’ between regions might be quite difficult if doing the entire process manually or step by step as I have documented in the below two articles:<\/p>\n
Exporting Cloud server images from a Rackspace Region\n\nhttps:\/\/community.rackspace.com\/products\/f\/25\/t\/7089\n<\/link>\n
Importing Cloud Server Images to a Rackspace Region\n\nhttps:\/\/community.rackspace.com\/products\/f\/25\/t\/7186\n<\/link>\n
In this article I completely finish writing the ‘automation demo’ of how to specifically move images, without changing much at all, apart from one ‘serverID’ variable, and the source and destination. The script isn’t finished yet, however the last time I posted this on my blog I was so excited, I actually forgot to include the import function. (which is kind of important!) sorry about that.<\/p>\n
USERNAME='yourmycloudusernamehere' #### DO NOT CHANGE BELOW THIS LINE<\/p>\n TOKEN=`curl https:\/\/identity.api.rackspacecloud.com\/v2.0\/tokens -X POST -d '{ \"auth\":{\"RAX-KSKEY:apiKeyCredentials\": { \"username\":\"'$USERNAME'\", \"apiKey\": \"'$APIKEY'\" }} }' -H \"Content-type: application\/json\" | python -mjson.tool | grep -A5 token | grep id | cut -d '\"' -f4`<\/p>\n # START IMAGE CREATION curl -v -D export-headers \\ echo \"export headers\" # Retrieve correct ImageID and use to check status of image API_ENDPOINT='https:\/\/lon.images.api.rackspacecloud.com\/v2\/images\/' curl -v \\ echo \"imagestatus: $imagestatus\"<\/p>\n STATUS=$(cat imagestatus | grep status | awk '{print $2}' | sed 's\/\"\/\/g' | sed 's\/,\/\/g')<\/p>\n ## WAIT FOR IMAGE TO EXIT SAVE STATE<\/p>\n echo \"Waiting for image to complete...\" STATUS=$(cat imagestatus | grep status | awk '{print $2}' | sed 's\/\"\/\/g' | sed 's\/,\/\/g') ## PREPARE\/CREATE CLOUD FILES CONTAINER for EXPORT<\/p>\n echo \"Preparing\/Creating Cloud Files Container for Export\" curl -v -s \\ ## EXPORT VHD TO CLOUD FILES<\/p>\n echo \"Exporting VHD to Cloud Files\" echo \"IMAGEID detected as $IMAGEID\" echo \"THE IMAGE ID IS: $IMAGEID\" cat export-cloudfiles<\/p>\n sleep 15<\/p>\n echo \"export cloud-files looks like:\" TASKID_EXPORT=$(cat export-cloudfiles | python -mjson.tool | grep '\"id\"' | awk '{print $2}' | sed 's\/\"\/\/g' | sed 's\/,\/\/g')<\/p>\n echo \"task ID export looks like\" API_ENDPOINT='https:\/\/storage101.lon3.clouddrive.com\/v1\/MossoCloudFS_1000000'<\/p>\n sleep 15<\/p>\n echo \"Waiting for Task to complete...\" # This section simply retrieves the TOKEN # This section requests the Glance API to copy the cloud server image uuid to a cloud files container called export EXPORT_STATUS=$(cat export-status | grep status | awk '{print $2}' | sed 's\/\"\/\/g' | sed 's\/,\/\/g')<\/p>\n while [ \"$EXPORT_STATUS\" = \"processing\" ]; do # SET CORRECT CLOUD FILES NAME ## Download VHD Cloud from Cloud Files to this server<\/p>\n API_ENDPOINT='https:\/\/storage101.lon3.clouddrive.com\/v1\/MossoCloudFS_1000000'<\/p>\n # GET FILE FROM SOURCE CLOUD FILES<\/p>\n URL=\"$API_ENDPOINT\/export\/$CLOUD_FILES_NAME.vhd\" curl -s \\ ## NEW API USER\/PASS REQUIRED FOR 2ND REGION<\/p>\n ### DO NOT CHANGE ANYTHING ABOVE THIS POINT<\/p>\n USERNAME='yourmycloudusernamegoeshere' ### DO NOT CHANGE ANYTHING BELOW THIS POINT<\/p>\n ## Now for uploading the VHD to Cloud Files to Destination REGION<\/p>\n API_ENDPOINT='https:\/\/storage101.ord1.clouddrive.com\/v1\/MossoCloudFS_900000' curl -v -s \\ ## Upload VHD Image to Cloud Files destination for import # Find the Customer_ID # This section simply retrieves the TOKEN VHD_NOTES=\"autoimport-$SERVER_ID\" curl -X POST \"$IMPORT_IMAGE_ENDPOINT\/tasks\" \\ <\/code><\/p>\n As You can probably see my code is still rather rough, but it’s just so darn exciting that this script works from start to finish, nicely I just HAD to share it a bit earlier! The plan now is to add commandline function so that you can specify .\/moveregion {SOURCE_REGION} {DEST_REGION} {SERVER_ID} {TENANT_ID} . Then a customer or a racker would only need these 4 variables to import and export images in an automated way.<\/p>\n I can rewrite the script in such a way that it would accept a .txt file of a couple of hundred cloud server UUID’s, and it would take the server UUID of each, use that uuid to create an image of each server, export to cloud files, import to cloud files, and then import to glance image store for the second region destination. Which naturally, would save hundreds of hours of human time doing this manually.. which is … nice \ud83d\ude00<\/p>\n I would really like to make a UI frontend, using something like Django, and utilize some form of ‘light’ database, that keeps track of all the API import\/exports, and even provides estimated time for completion, but my UI skills are really limited to xhtml, css php and mysql.. I need a python or django guy to help out with some of this. If anyone is interested, please reach out to me.<\/p>\n This project will be avaialble on github soon<\/p>\n","protected":false},"excerpt":{"rendered":" Hey folks. So, recently I have been doing a bit of work on the Rackspace community, specifically trying to document and make as easy as possible the importing and exporting of cloud server VHD’s between Rackspace regions. This might be … Continue reading
\n#!\/bin\/bash<\/p>\n
\nAPIKEY='youapikeyhere'
\nAPI_ENDPOINT='https:\/\/lon.servers.api.rackspacecloud.com\/v2\/1000000'
\nSERVER_ID='94157dc7-924a-424a-8825-c5ffbd341622'
\nTENANT='1000000'
\nCUSTOMER_ID='1000000'<\/p>\n
\necho \"Creating Image at Local Datacentre\"<\/p>\n
\n-H \"X-Auth-Token: $TOKEN\" \\
\n-H \"Accept: application\/json\" \\
\n-H \"content-type: application\/json\" \\
\n-d '{\"createImage\" : {\"name\" : \"RA-'$SERVER_ID'\", \"metadata\": { \"ImageType\": \"Rackspace Automation Image Exported from '$TENANT'\", \"ImageVersion\": \"2.0\"}}}' \\
\n-X POST \"$API_ENDPOINT\/servers\/$SERVER_ID\/action\" -o \/tmp\/export-file<\/p>\n
\ncat export-headers<\/p>\n
\nIMAGEID=$(cat export-headers | grep -i location | sed 's\/\\\/\/ \/g' | awk '{print $7}')
\nsleep 5
\necho \"image id\"
\necho $IMAGEID<\/p>\n
\nURL=$API_ENDPOINT$IMAGEID
\nURL=${URL%$'\\r'}<\/p>\n
\n-H \"X-Auth-Token: $TOKEN\" \\
\n-H \"X-Project-Id: 1000000\" \\
\n-H \"Accept: application\/json\" \\
\n-H \"content-type: application\/json\" \\
\n-X GET \"$URL\" | python -mjson.tool > imagestatus<\/p>\n
\nsleep 5
\nwhile [ \"$STATUS\" != \"active\" ]; do
\n\techo \"image $IMAGEID is still saving...\"
\n\tsleep 10
\n\tcurl -s \\
\n\t-H \"X-Auth-Token: $TOKEN\" \\
\n\t-H \"X-Project-Id: 1000000\" \\
\n\t-H \"Accept: application\/json\" \\
\n\t-H \"content-type: application\/json\" \\
\n\t-X GET \"$URL\" | python -mjson.tool > imagestatus<\/p>\n
\ndone<\/p>\n
\nAPI_ENDPOINT='https:\/\/storage101.lon3.clouddrive.com\/v1\/MossoCloudFS_1000000'<\/p>\n
\n-H \"X-Auth-Token: $TOKEN\" \\
\n-H \"X-Project-Id: 1000000\" \\
\n-H \"Accept: application\/json\" \\
\n-X PUT \"$API_ENDPOINT\/export\"
\nsleep 5<\/p>\n
\n# This section simply retrieves the TOKEN
\nTOKEN=`curl https:\/\/identity.api.rackspacecloud.com\/v2.0\/tokens -X POST -d '{ \"auth\":{\"RAX-KSKEY:apiKeyCredentials\": { \"username\":\"'$USERNAME'\", \"apiKey\": \"'$APIKEY'\" }} }' -H \"Content-type: application\/json\" | python -mjson.tool | grep -A5 token | grep id | cut -d '\"' -f4`<\/p>\n
\n# This section requests the Glance API to copy the cloud server image uuid to a cloud files container called export
\n# > export-cloudfiles<\/p>\n
\nIMAGEID=${IMAGEID%$'\\r'}
\ncurl -v \"https:\/\/lon.images.api.rackspacecloud.com\/v2\/$TENANT\/tasks\" -X POST -H \"X-Auth-Token: $TOKEN\" -H \"Content-Type: application\/json\" -d '{\"type\": \"export\", \"input\": {\"image_uuid\": \"'$IMAGEID'\" , \"receiving_swift_container\": \"export\"}}' -o export-cloudfiles
\necho \"Export looks like\"<\/p>\n
\ncat export-cloudfiles<\/p>\n
\necho \"$TASKID_EXPORT\"<\/p>\n
\n## WAIT FOR TASKID EXPORT TO COMPLETE TO CLOUD FILES<\/p>\n
\nTOKEN=`curl https:\/\/identity.api.rackspacecloud.com\/v2.0\/tokens -X POST -d '{ \"auth\":{\"RAX-KSKEY:apiKeyCredentials\": { \"username\":\"'$USERNAME'\", \"apiKey\": \"'$APIKEY'\" }} }' -H \"Content-type: application\/json\" | python -mjson.tool | grep -A5 token | grep id | cut -d '\"' -f4`<\/p>\n
\ncurl \"https:\/\/lon.images.api.rackspacecloud.com\/v2\/1000000\/tasks\/$TASKID_EXPORT\" -X GET -H \"X-Auth-Token: $TOKEN\" -H \"Content-Type: application\/json\" | python -mjson.tool > export-status<\/p>\n
\nsleep 15
\ncurl \"https:\/\/lon.images.api.rackspacecloud.com\/v2\/1000000\/tasks\/$TASKID_EXPORT\" -X GET -H \"X-Auth-Token: $TOKEN\" -H \"Content-Type: application\/json\" | python -mjson.tool > export-status
\nEXPORT_STATUS=$(cat export-status | grep status | awk '{print $2}' | sed 's\/\"\/\/g' | sed 's\/,\/\/g')
\ndone<\/p>\n
\nCLOUD_FILES_NAME=$(cat export-cloudfiles | python -mjson.tool | grep image_uuid | awk '{print $2}' | sed 's\/,\/\/g' | sed 's\/\"\/\/g')<\/p>\n
\nURL=${URL%$'\\r'}<\/p>\n
\n-H \"X-Auth-Token: $TOKEN\" \\
\n-H \"X-Project-Id: $TENANT\" \\
\n-H \"Accept: application\/json\" \\
\n-X GET \"$API_ENDPOINT\/export\/$CLOUD_FILES_NAME.vhd\" > $CLOUD_FILES_NAME.vhd<\/p>\n
\nAPIKEY='yourapikeyfromsecondregiongoeshere'<\/p>\n
\nTOKEN=`curl https:\/\/identity.api.rackspacecloud.com\/v2.0\/tokens -X POST -d '{ \"auth\":{\"RAX-KSKEY:apiKeyCredentials\": { \"username\":\"'$USERNAME'\", \"apiKey\": \"'$APIKEY'\" }} }' -H \"Content-type: application\/json\" | python -mjson.tool | grep -A5 token | grep id | cut -d '\"' -f4`<\/p>\n
\n-H \"X-Auth-Token: $TOKEN\" \\
\n-H \"X-Project-Id: 900000\" \\
\n-H \"Accept: application\/json\" \\
\n-X PUT \"$API_ENDPOINT\/import\"<\/p>\n
\ncurl -v -s \\
\n-H \"X-Auth-Token: $TOKEN\" \\
\n-H \"X-Project-Id: 900000\" \\
\n-H \"Accept: application\/json\" \\
\n-X PUT \"$API_ENDPOINT\/import\/$CLOUD_FILES_NAME.vhd\" -T \"$CLOUD_FILES_NAME.vhd\"<\/p>\n
\nIMPORT_IMAGE_ENDPOINT=https:\/\/ord.images.api.rackspacecloud.com\/v2\/$CUSTOMER_ID<\/p>\n
\nTOKEN=`curl https:\/\/identity.api.rackspacecloud.com\/v2.0\/tokens -X POST -d '{ \"auth\":{\"RAX-KSKEY:apiKeyCredentials\": { \"username\":\"'$USERNAME'\", \"apiKey\": \"'$APIKEY'\" }} }' -H \"Content-type: application\/json\" | python -mjson.tool | grep -A5 token | grep id | cut -d '\"' -f4`<\/p>\n
\nIMPORT_CONTAINER=import
\nVHD_FILENAME=\"$CLOUD_FILES_NAME.vhd\"<\/p>\n
\n -H \"X-Auth-Token: $TOKEN\" \\
\n -H \"Content-Type: application\/json\" \\
\n -d \"{\\\"type\\\":\\\"import\\\",\\\"input\\\":{\\\"image_properties\\\":{\\\"name\\\":\\\"$VHD_NOTES\\\"},\\\"import_from\\\":\\\"$IMPORT_CONTAINER\/$VHD_FILENAME\\\"}}\" |\\
\n python -mjson.tool<\/p>\n