So we went through our first Windows Azure Pack update and we also did the latest Windows update as well. The entire project was done in three phases. First, we updated our back end infrastructure, then updated Windows Azure Pack, and then we applied the latest Windows updates.
To update our back end infrastructure, we announced and scheduled a 10 minute outage mainly to update our databases to make way for the changes in the Windows Azure Pack update. While we never like taking an outage, in our testing in our dev environment a short outage was the cleanest way of getting the WAP update done without introducing a lot of other technical issues.
Once the back end updates were complete we proceeded to update Windows Azure Pack. The way it works is WAP pushes the update out to the servers one at a time. We found the update in production took longer to apply than we thought it would, even with all of the testing we did in our development environment. But the great news is that there were no site outages during this phase.
The update was also good news to all of you who were waiting for the PDF generation bug to be fixed. You had to wait a little longer than any of us would have liked, but we got the job done!
Finally, we wanted make sure our O/S was hardened with the latest Windows update. At DiscountASP.NET, or any traditional host for that matter, the updates would involve a reboot (or two) of the servers so there would be at least a 15 minute site outage across the board. And of course the longer you wait between the updates, the more reboots and the more time it takes, since there are many previous update dependencies in any Windows update.
In any case, Everleap sites did not experience any outages. This is because we employed a rolling update strategy, taking a few servers out of the cluster pool at a time to apply the updates. Once updated, we put the servers back into the active pool and move on to a few other servers, and so forth until every server has been updated.
This was our first Windows Azure Pack update and the first time we applied a Windows update on the Everleap system. We learned a lot through this first update and we hope to be able to speed things up and provide more accurate time estimates the next time around. (When is next time? Well, we expect the WAP updates to be a semi-annual or annual thing.)
All in all, I think the update worked great and was a painless experience for Everleap users. What do you think?