Issue with Steadfast Cloud Platform and SAN
Posted by Chris Swingler on 31 October 2012 09:31 AM
As of 8:20 AM CDT we had detected an issue with our NetApp SAN, which has resulted in many Steadfast Cloud Virtual Machines to shift their filesystems into read-only mode.
We have rectified the issue with our SAN. To bring your Virtual Machine back online, reboot it - after remounting the filesystem, your virtual machine should be back online.
If you have any questions, or would like our support team to handle this task for you, please open a ticket on our website, or email firstname.lastname@example.org.
Update: November 1, 2012 11:14 AM CDT
One of our SAN controllers is still running in a degraded state, which is causing a small impact on performance.
Customers that had their virtual machines to rely heavily on swap space in lieu of memory may be impacted more severely. Our suggestion at this time is to upgrade the RAM allocated to your virtual machine - not only will it fix this problem immediately, it will improve performance moving forward.
Update: November 1, 2012 1:12 PM CDT
At November 2, 2012, 2:00 AM CDT, we will be re-introducing the downed SAN controller to the SAN configuration. At this point, we expect performance to return to normal. Be aware that there is a risk that Virtual Machines on the Steadfast Cloud Platform will require another reboot.
Update: November 2, 2012 2:30 AM CDT
The second SAN controller has been returned to normal operation without incident or storage system interruption. We will continue working with our SAN hardware vendor to monitor the SAN performance and reliability during the day.