Server Status

Affecting Server - cp14.can.hostgeek.com.au

• 04/04/2023 12:00 - 04/04/2023 14:30
• Last Updated 04/04/2023 16:05

12.30pm - Our internal monitoring systems detected a connectivity issue with our Canberra Data Center. 
Engineers are currently investigating, and we are now awaiting an update. 

2:30PM - Services tested and back online. The outage was caused by an internal network issue within the data center controlled by the DC operator.

 We await a further explanation of what caused this issue to see how it can be dealt with better. 

 Apologies for the inconvenience caused. 

Affecting Other - Sydney DC

• 13/01/2022 15:45 - 13/01/2022 19:15
• Last Updated 13/01/2022 19:19

3:45PM - We have noticed that there are issues with systems located in our Sydney Data Center at the moment. This is currently being investigated by the Network Operations team and will come back to you with an update.

4:55PM - Network Team are currently working on the issue with some backend systems - CP13.SYD.HOSTGEEK.COM.AU is offline due to this outage. 

7:15 PM - Services Fully Operational again and Tested

Thanks for your Patience.

Affecting Server - cp14.can.hostgeek.com.au

• 24/01/2021 04:00 - 24/01/2021 19:00
• Last Updated 25/01/2021 01:32

24/1/2021 - 4:00am - We are currently experiencing an outage on CP14.CAN.HOSTGEEK.COM.AU this is affecting ALL users and services located on this server.  Network Engineers are currently investigating and working on the issue.  Further updates will be provided when they are available.  We would like to apologise for the inconvenience this is causing.

24/1/2021 - 6:30am - The issue has been identified as a problematic Kernel update which has been escalated to the Software Vendor and they are currently working on a resolution. Once Again we will keep you up to date and appreciate your patience.

24/1/2021 - 12:00pm - The Network team are still working with the Software vendor on a fix. Further updates will be provided as soon as they come to hand.

24/1/2021 - 2:30pm - Some services have started to be restored. However there may be intimitant connectivity issues as further remediation works are done to fix the problem completely.

24/1/2021 - 7:00pm - The Network Team has been monitoring the situation for a number of hours and we are confident that everything is back up and running now.

We are waiting for more information from the Software vendor on how the events of today happened  so they can be avoided in the future. We hope to have a more complete understanding over the next few days.

Once again we appreciate everyone's understanding and patience in this matter.  

Affecting Other - VPS Server Nodes

• 04/06/2020 12:15 - 11/06/2020 15:16
• Last Updated 11/06/2020 15:16

12:00pm - We were alerted to an outage on a number of servers in our datacenter - Network Engineers have been dispatched.

1:00 pm - Engineers are onsite and are investing the issue. At this time it appears to be a Storage issue

2:30 pm - Engineers are installing parts and repairing the issue.

6:00 pm - Engineers are currently working with the Storage Vendor as repairs have not gone to plan.

6:30 pm - Additional New Storage brought online.

7:00 pm - Recovery of Server is underway - Backup currently being restored. This will be a lengthy process. 

-----------------------

Friday 5/6/2020

7:00 am - Restore is progressing on System expected eta to completion is around 7 pm tonight.  Engineers are continuing to monitor the restoration progress.

12:30 pm - Restore is still continuing and is being monitored closely by the engineers

6:00 pm - Restores are still progressing however they are slower than desired. This may result in services not being available until tomorrow morning. Engineers are still monitoring and will get the systems online as soon as the restoration has completed. Unfortunately, we can not make this process go any faster and must allow it to run its own course.

9:00 PM - All services restored and up and running - Outage over - if you are having an issue please call or log a support ticket.

We appreciate the support and patience during this outage. 

Affecting Server - cp02.mdc.hostgeek.com.au

• 04/06/2020 12:00 - 05/06/2020 21:00
• Last Updated 11/06/2020 15:16

12:00 pm - We were alerted to an outage on a number or servers in our datacenter - Network Engineers have been dispatched.

1:00 pm - Engineers are onsite and are investing the issue. At this time it appears to be a Storage issue

2:30 pm - Engineers are installing parts and repairing the issue.

6:00 pm - Engineers are currently working with the Storage Vendor as repairs have not gone to plan.

6:30 pm - Additional New Storage brought online.

7:00 pm - Recovery of Server is underway - Backup currently being restored. This will be a lengthy process. 

-----------------------

Friday 5/6/2020

7:00 am - Restore is progressing on System expected eta to completion is around 7 pm tonight.  Engineers are continuing to monitor the restoration progress.

12:30 pm - Restore is still continuing and is being monitored closely by the engineers

6:00 pm - Restores are still progressing however they are slower than desired. This may result in services not being available until tomorrow morning. Engineers are still monitoring and will get the systems online as soon as the restoration has completed. Unfortunately, we can not make this process go any faster and must allow it to run its own course.

9:00 PM - All services restored and up and running - Outage over - if you are having an issue please call or log a support ticket.

We appreciate the support and patience during this outage. 

Affecting Server - cp01.mdc.hostgeek.com.au

• 04/06/2020 12:15
• Last Updated 11/06/2020 15:16

12:00 pm - We were alerted to an outage on a number of servers in our datacenter - Network Engineers have been dispatched.

1:00 pm - Engineers are onsite and are investing the issue. At this time it appears to be a Storage issue

2:30 pm - Engineers are installing parts and repairing the issue.

6:00 pm - Engineers are currently working with the Storage Vendor as repairs have not gone to plan.

6:30 pm - Additional New Storage brought online.

7:00 pm - Recovery of Server is underway - Backup currently being restored. This will be a lengthy process. 

-----------------------

Friday 5/6/2020

7:00 am - Restore is progressing on System expected eta to completion is around 7 pm tonight.  Engineers are continuing to monitor the restoration progress.

12:30 pm - Restore is still continuing and is being monitored closely by the engineers

6:00 pm - Restores are still progressing however they are slower than desired. This may result in services not being available until tomorrow morning. Engineers are still monitoring and will get the systems online as soon as the restoration has completed. Unfortunately, we can not make this process go any faster and must allow it to run its own course.

9:00 PM - All services restored and up and running - Outage over - if you are having an issue please call or log a support ticket.

We appreciate the support and patience during this outage. 

Affecting Server - cp04.mdc.hostgeek.com.au

• 01/06/2020 06:00 - 01/06/2020 08:50
• Last Updated 01/06/2020 09:42

We are currently experiencing a connectivity issue with CP04 which is resulting in sites housed on this server to be inaccessible. Engineering teams are currently investigating and working on the issue.

Connectivity Issue has been fixed and server is back online serving requests.

Affecting Server - cp01.mdc.hostgeek.com.au

• 28/05/2020 15:00 - 28/05/2020 18:30
• Last Updated 29/05/2020 22:20

We are currently experiencing increased Server load on CP01.MDC.HOSTGEEK.COM.AU . This is due to a DDos attack on a number of clients sites with unpatched WordPress & Joomla installations. 

This is currently resulting in slower performance of all sites hosted on CP01.

The Engineering team is working on this issue to rectify.

More updates to follow

Server Load Restored to Normal - 28/5/2020 18:30pm 

Affecting Other - All Melbourne Infrastructure

• 03/06/2019 18:00 - 05/06/2019 05:00
• Last Updated 05/06/2019 09:33

Update 5 June 2019, 9:05aM

ALL Services have now been fully restored CPO3 is operational and online.

If you have had any issues accessing resources other than CP03 please lodge a ticket to support.

Update 5 June 2019, 3:15aM

The engineering team have all cPanel Servers back online with exception of CP03 which is currently being worked on.  All Client VPS Servers are online and fully functional.

CP03 Update will be given at 9am.

If you have had any issues accessing resources other than CP03 please lodge a ticket to support.

Update 5 June 2019, 12:15aM

The engineering team are currently performing maintenance on a number of the cPanel Server and also VPS Servers.  This will finalise the remediation works following Monday's incident.  The outage has a window of approximately 1.5 hours and servers will be brought back online as they are finished being updated.

Update 4 June 2019, 01:37PM

All cPanel servers are in operation with exception of CP03. Customers with websites on that server will continue to be affected for a further number of hours as this server is being recovered from backup – due to the damage caused by the power outage.

Update 4 June 2019, 09:30AM

Our engineers have worked through the night and are still working to bring services back online. Some of our clients’ websites are accessible however others may have mysql errors. The team will continue to work through restoring services and fixing these mysql errors. The mysql errors are due to the servers not being cleanly shutdown from the power failure.

We have noticed that node SVMN06 is also working harder than it should be and some VPS services are not performing as expected. Our engineers are investigating this as well.

We will be providing another update around 12pm today.

Once again we are very sorry for the inconvenience and we never wish for this to happen to our clients. Be assured that we will be seeking a full explanation to why this happened.

We apologise for the delay in communication and also the issues caused and will keep you updated on progress.

Open 3 June 2019, 06:00PM

At approximately 3:03pm today (Monday 3 June 2019) Melbourne time, there was a power outage to our Data Centre provider’s  building  at 530 Collins St Melbourne. All of our other facilities in the building had no loss of power, with a seamless transition to the generator.

On the floor of our Data Centre provider – there was some form of issue (being investigated currently) that caused the power to trip at the data centre level. This caused a major power outage in the data centre.

The generators kicked in and power was restored to equipment at approximately 3:13pm.  However bear in mind that a significant amount of equipment had completely lost power – so equipment had to restart.

At 4:17pm Melbourne time the power to the building was restored.  This caused the power in the data centre to again trip for under two minutes.

We have raised a severity 1 fault with our data centre providers and teams are on-site presently investigating the cause of the issue. We do expect a full report.

We are incredibly disappointed in this event, given that this data centre is a Tier III data centre – and these types of events should not happen (many of our other data centres have 100% uptime).  We have raised this directly with the executive management of the company that owns the data centre and will be provided with a full report on the investigations and outcomes.

As you can imagine server equipment does not cope well with sudden losses of power and disk checks and recoveries are underway.  This will take some time to complete and our engineers are working on restoring services.

Thanks for your patience, and our apologies once again.

Affecting Server - cp04.mdc.hostgeek.com.au

• 27/03/2019 09:00 - 28/03/2019 17:00
• Last Updated 29/03/2019 08:32

Please be aware that our cp04 shared hosting server is currently experiencing issues with website availability. Our engineers are working on this and hoping to have it resolved as soon as possible.

During this time, websites may become intermittently available and email sending/receiving may be slightly delayed.

We apologise for any inconvenience this issue has caused and thank you for your patience.

Update (11:22am GMT +11): Our engineers are continuing to work toward a resolution to the issues persisting on cp04. Email deliverability and availability should now be largely unaffected and working as normal, but web pages will still be intermittently available until a full resolution has been reached.

Update (2:40pm (GMT +11): We are currently discussing remedies for these issues with our datacenter. While we do not yet have an ETA, we are optimistic that they will be able to provide some assistance in the rectification of this issue in a timely manner.

Update (5:14pm GMT +11): Discussions with our datacenter are ongoing and possible fixes are being implemented to ensure that webpage availability on cp04 is restored.

Update (5:00 GMT +11 - 28/03/19): We have made significant progress throughout the day with the issues on cp04 and the server has now stabilised. We are optimistic that the issue has been fully resolved and will closely monitor the situation going forward. We would like to sincerely apologise for any inconvenience that this has caused our customers and extend our thanks for your patience while we worked toward a solution.

Affecting Server - sti

• 20/09/2018 11:59 - 20/09/2018 12:05
• Last Updated 20/09/2018 12:00

Test

Affecting Server - cp03.mdc.hostgeek.com.au

• 31/08/2018 11:34 - 31/08/2018 12:23
• Last Updated 31/08/2018 11:42

We are currently performing some emergency maintenance on our cp03 server.

We expect some possible but very short outages during this time.

Maintenance should be concluded by 1pm at the latest.

Your patience is appreciated.

Affecting Server - SolusVM

• 28/02/2018 08:30 - 02/03/2018 04:00
• Last Updated 02/03/2018 10:46

Updated 2/3/2018

Overnight, our engineering team was able to restore full functionality to Node 2 and began booting each virtual server affected by the outage. All systems should now be up.

We thankyour for your patience and apologise for this extended outage. Should you require further support, please lodge a support ticket at: support@hostgeek.com.au

________________________________________________________

Affecting Server - cp01.mdc.hostgeek.com.au

• 06/10/2017 14:13 - 07/10/2017 11:23
• Last Updated 06/10/2017 14:20

Following an issue with two of our servers (cp01 & cp02) over the past 18 hours, our network engineers have resolved the problems and have scheduled a server restart for the later hours of tonight to finalise the changes to our servers. This downtime will be very brief and will ensure that these problems do not reoccur in the future.

We thank you for your patience and apologise for any inconvenience you may have expereinced.

Affecting System - All Systems

• 07/07/2017 13:28 - 07/07/2017 15:30
• Last Updated 07/07/2017 15:33

07/07/2017 13:28: Our system have detected a host server failure. Some clients may be experiencing issues with their hosting and email. We are currently investigating and will have more information shortly.
07/07/2017 13:40: Internal failover systems have started re-starting services on other hosts. Services should be available shortly
07/07/2017 14:00: Most servers have re-started. Service may be slow for the next approx. half hour as loads are re-distributed within the network. VPS guests on svmn04 are starting to boot, but may take half an hour to complete
07/07/2017 14:16: All servers have restarted, nd all services are operational. Some service may be slow for another few minutes as the network load completes re-distribution.
07/07/2017 14:25: VPS Node svmn06 is reporting stability issues - our engineers are rebooting the server to resolve the issue
07/07/2017 14:50: SVMN06 is coming back online now, and customers VPS containers are starting to come back online
07/07/2017 15:30: All servers and services have rebooted. Issue closed.

Affecting System - All Australian Servers

• 23/11/2016 15:44 - 30/11/2016 01:45
• Last Updated 30/11/2016 08:25

An emergency outage has been scheduled for 30th November between 12:00am and 2:00am for updating our core SAN (Storage) systems. This update is required to resolve a number of existing issues, as well as allow for increased performance and capacity. During the upgrade there will be an outage of approximately 1 hour, affecting all Australian based services.

This is a re-schedule of a previous upgrade attempt where some unforeseen issues were encountered. These have been rectified by the storage system vendor.

30/11/2016 1:45AM - The storage upgrades have been completed, and all services have been restarted. The opportunity was also taken to install additional compute capacity into the network ahead of schedule.

Affecting Server - stream1

• 03/11/2016 06:00
• Last Updated 23/11/2016 15:44

Our enginerring team is investigating an issue with a loss of connectivity with the streaming server stream1.fre.hostgeek.com.au. We are workign with our US based datacenter provider to investigate this issue.
8:24am - The issue is ongoing, and we suspect it is related to a hardware issue at our US based datacenter provider. The provider is working to resolve the issue, and an updated is exxpected within the next hour.

Affecting System - All Australian based services

• 02/11/2016 00:00 - 02/11/2016 03:00
• Last Updated 23/11/2016 15:44

An emergency outage has been scheduled for 2nd November between 12:00am and 2:00am for updating our core SAN (Storage) systems. This update is required to resolve a number of existing issues, as well as allow for increased performance and capacity. During the upgrade there will be an outage of approximately 1 hour, affecting all Australian based services.

2016-11-02 2am - Due to unforseen complications, our engineers are reverting changes made. We are expecting services to be back online within half an hour
2016-11-02 2:30am - Server's have restarted and the vast majority of services are back online.

Affecting System - VPS Node 05

• 09/12/2015 11:15 - 09/12/2015 11:50
• Last Updated 09/12/2015 11:56

09/12/2015 11:15 - Our systems have idnetified a critical issue with VPS node 05 affecting all VPS guests on that node
09/12/2015 11:30 - We are performing an emergency reboot to restore services for this node
09/12/2015 11:40 - Our engineers are applying a kernel update to the affected node to patch some issues and the server will go through a graceful reboot to apply these changes
09/12/2015 11:50 - Server has rebooted and all VPS guests are now back online

Affecting Other - All Systems

• 04/12/2015 11:45
• Last Updated 04/12/2015 13:05

04/12/2015 11:45 - Our network engineers have detected network connectivity issues. The issue is a suspected DDoS attack and our team
04/12/2015 12:00 - The issue is a suspected DDoS attack and our team is working on mitigating the attack
04/12/2015 12:30 - Our engineers have sucessfully mitigated the DDoS attack and network services are returning to normal

Affecting Other - Network Services

• 30/11/2015 11:30 - 30/11/2015 12:35
• Last Updated 01/12/2015 09:03

30/11/2015 11:30 - Our network operations team has identified high packet loss on an upstream providers link and are investigating.
30/11/2015 12:35 - The cause of the issue has been confirmed to be a DDoS attack. Our engineers have update the network configuration to mitigate the attack, and services are returning to normal.

Affecting Server - cp01.mdc.hostgeek.com.au

• 27/10/2015 22:00 - 27/10/2015 23:00
• Last Updated 27/10/2015 23:15

Server Software Upgrade - cp01.mdc.hostgeek.com.au

Outage start: 10pm.

Several server restarts may be required to apply updates.

UPDATE 27/10/2015 23:00: Server upgrade works have been completed sucessfully.

• 07/07/2015 22:00 - 07/07/2015 23:00
• Last Updated 07/07/2015 23:01

Due to a host node issue, one system requires a power cycle. This outage will affect several hosting services including some shared webhosting and VPS customers.

This outage is planned to take 30 minutes between 10pm and 12am, 7th July.

Update 11:00 - Server restart has completed sucessfully and all services have returned to normal.

Affecting Server - SolusVM

• 05/07/2015 19:00 - 05/07/2015 23:00
• Last Updated 05/07/2015 21:17

*RESOLUTION* 5/7/15 - 9:16pm - We have identified and resolved the issue occuring on svnm04, all services have returned to normal.

5/7/15 - 7:50pm - We are currently investigating an SQL database error appearing on the VPS's hosted on svmn04.

Affecting Server - stream1

• 30/05/2015 15:56 - 30/05/2015 16:45
• Last Updated 30/05/2015 16:45

We are experiencing a power outage at the data centre where our SHOUTcast server is kept.

Update 4PM: Our upstream provider has provided a new estimated time to restoration of 4:30PM AEST.
Update 4:44PM: The power event has been resolved, and the services have returned to normal.

Please check back here for an update.

Apologies for the inconvenience.

HostGeek

• 18/03/2015 23:00 - 19/03/2015 04:00
• Last Updated 19/03/2015 11:13

18/03/2015 23:00 - Our team is investigating a server node issue affecting multiple servers. We are investigating and hope to have services restored shortly.
19/03/2015 03:30 - The affected server is undergoing an emergency reboot, our engineers will re-start services once the server has rebooted to ensure that services are restored.
19/03/2015 04:00 - Server reboot completed sucessfully - all services are back in operation.

Affecting Server - cp01.mdc.hostgeek.com.au

• 03/12/2014 17:00 - 05/12/2014 20:30
• Last Updated 05/12/2014 20:51

03/12/2014 17:00 - Our engineers are investigating reports of slow page load times on cp01
04/12/2014 09:00 - We have identified a load related issue on the server, and are working to resolve the issue
04/12/2014 11:00 - Our engineers have identified the cause of the issue and the speed for websites should return abck to normal over the next 24 hours
04/12/2014 14:00 - Our monitoring systems have identified that the load for this server has increased again above the threshold. We have identified some client accounts causing excessive CPU usage and are working with the website owners to resolve the issue. In the meantime we expect loads to start dropping and services to return to normal.
04/12/2014 17:00 - Engineers are working through further troubleshooting on this issue
05/12/2014 08:30 - This issue is continuing and has been escalated
05/12/2014 20:30 - Our engineers have identified an underlying issue in the virtualisation system used to deliver all services, and have re-configured a number of parameters to resolve the issue. The affected server has been restarted to apply these settings, and we are seeing that the load has returned to normal.

Affecting Server - SolusVM

• 14/11/2014 14:01 - 14/11/2014 14:15
• Last Updated 14/11/2014 15:11

*UPDATE* Node 1 has been rebooted and services have returned to normal. *UPDATE*

Affecting Server - cp01.mdc.hostgeek.com.au

• 31/10/2014 11:00 - 31/10/2014 13:00
• Last Updated 31/10/2014 12:14

One of our shared hosting servers was close to reaching it's disk space so we are expanding the disk space to avoid any major issues occuring.

Some services might be stopped or delayed during this time. We apologise for any inconvenience.

Kind Regards,

HostGeek Management.

UPDATE: 12:15pm - We have rectified any issues occuring with cp01.mdc.hostgeek.com.au.

Affecting System - svmn03.mdc.hostgeek.com.au

• 06/08/2014 08:50 - 06/08/2014 11:06
• Last Updated 17/09/2014 16:40

06/08/2014 08:50 - Our engineers have identified an issue with node svmn03.mdc.hostgeek.com.au which is causing stability issues for teh VPS's on this sytstem. Our engineers are investigating the issue.

06/08/2014 09:02 - Update - Our enginners have identified a disk issue as the cause of the instability. Action has been taken to workaround the issue and all services are back up and running. A further permament fix will be applied later this morning.

06/08/2014 11:06 - Update - A reboot of the node is in progress this will cause a brief interruption to services on the node while the reboot occurs.

Affecting System - VPS Node 3

• 10/07/2014 08:50 - 10/07/2014 09:16
• Last Updated 10/07/2014 09:13

10/07/2014 08:50 - Our monitoring team identified an issue with VPS Node 3 which is resulting in some VPS customers being unable to access their system. An emergency restart is being performed which we expect to be completed shortly to resolve the issue.
10/07/2014 09:16 - Node reboot completed sucessfully - all VPS customers are now back online.

Affecting System - All Australian Services

• 05/05/2014 20:00 - 06/05/2014 03:00
• Last Updated 06/05/2014 09:08

<strong>Australian Services: Datacenter Migration</strong><br /><br />Please note that from 8pm 5th May 2014 to approximatley Midnight we will be performing a physical datacenter move of our Australian services. During this time all Australian hosting services will be offline.<br /><br />Update 6/5/14 3am - Unfortunatley due to some complications the move of the equipment to the new datacenter took longer then expected, however all services are now back online.

Affecting Server - Stream3

• 22/04/2014 08:04
• Last Updated 06/05/2014 09:01

22/4/104 08:05 - The server stream3.geekinternetserver.com (US server for geo-redundant DNS and Stream Hosting) is experincing network connectivity issues. We are currently working with the US based transit provider to establish the cause of the issue.

Affecting Server - snowy

• 06/03/2014 13:51 - 07/03/2014 10:06
• Last Updated 06/03/2014 14:07

06/03/2014 13:51 - There are currently intermittent issues effecting services on the Snowy Server. We are currently investigating the cause of this issue.
06/03/2014 14:08 - We have performed a restart and since the restart websites are coming back online.

Affecting Server - sti

• 18/11/2013 16:58 - 18/11/2013 17:26
• Last Updated 19/11/2013 09:44

18/11/2013 16:58 - Currently investigating an issue with our USA stream 3 server. Updates to be advised as they become available.

18/11/2013 17:26 - Transit provider had a network issue. Provider has resolved the issue.

Affecting Server - Stream3

• 12/11/2013 11:40 - 12/11/2013 13:40
• Last Updated 12/11/2013 16:11

We are currently aware of a network outage effecting our streaming server. Technicians are investigating the issue and updates will be advised as they become available.

Carrier has resolved issues affecting the streaming server. 

Affecting System - hotham & everest

• 28/10/2013 14:10
• Last Updated 28/10/2013 18:57

28/10/2013 14:10 - The server hotham & everest are under heavy load and is slow responding to requests. Engineering’s investigating.
28/10/2013 15:31 - Load related issues on hotham have been resolved. Engineers will continue to monitor. Investigations regarding issues on Everest are continuing.
28/10/2013 18:28 - Engineers are still investigating issues with Everest. Some services intermittently online. Further update will be provided.
28/10/2013 16:57 - Issue has been resolved. Root cause has been identified as a large spam mail attack. Additional resources and network protection has been put in place. All services have returned to normal. If you continue to experience any difficulty please lodge a support ticket.

Affecting Server - Stream3

• 07/09/2012 12:02 - 07/09/2012 12:32
• Last Updated 07/09/2012 14:30

07/09/2012 12:02 - Currently investigating an issue with our USA stream 3 server. Updates to be advised as they become available.

07/09/2012 12:32 - Transit provider had a network issue. Have contacted provider who have resolved the issue.

Affecting System - svmn01

• 06/09/2012 09:25 - 06/09/2012 10:37
• Last Updated 06/09/2012 11:17

06/09/2012 09:25 - Currently investigating an issue with svmn01 affecting some VPS customers. Updates to be advised as they become available.

06/09/2012 09:33 - Node requires emergency reboot. Performing reboot now.

06/09/2012 09:45 - Node is in the process of performing a disk check. Update will be provided when completed.

06/09/2012 09:59 - Disk check has been completed. VPS services are in the process of booting up.

06/09/2012 10:37 - All VPS services on this node have been rebooted and service has been restored.

Affecting Server - SolusVM

• 29/08/2012 09:30 - 29/08/2012 10:15
• Last Updated 30/08/2012 10:15

29/08/2012 09:30 - Currently investigating an issue affecting some VPS customers. Updates to be advised as they become available.

Affecting Server - hotham

• 19/08/2012 10:19
• Last Updated 20/08/2012 18:10

19/08/2012 10:19 - Technicians are investigating a denial of service attack currently affecting the hotham server.

19/08/2012  23:00 - Technicians have identified a compromised user account that was responsible for the attacks. Have taken action against the account to ensure no further interruptions to the server are caused.

Affecting System - svmn01

• 20/08/2012 09:00
• Last Updated 20/08/2012 18:10

20/08/2012 09:00 - Our monitoring systems have identified an issue with svmn01 affecting some VPS customers. Our engineers are investigating
20/08/2012 10:00 - We have identified the issue and require to put the server through an emergency reboot. Updates to follow once this has been completed.
20/08/2012 11:00 - Node restart has nearly completed - customer VPS systems are coming back online
20/08/2012 11:45 - Node restart has been completed and all customer VPS' on this node have restarted.

Affecting Server - hotham

• 16/08/2012 10:04 - 16/08/2012 10:54
• Last Updated 16/08/2012 10:55

16/08/2012 10:04 - Technicians are currently investigating an denial of service attack affecting the hotham server.

16/08/2012 10:54 - We have mitigated the effects of the attack, services and performance has returned to normal. Any customer’s still experiencing difficulty should contact the help desk directly to lodge a support ticket.

Affecting Other - All Services

• 21/07/2012 23:40 - 22/07/2012 04:00
• Last Updated 22/07/2012 06:38

21/07/2012 23:40 - Major network outage detected. Technicians currently investigating

22/07/2012 00:00 - Technicians en route to datacenter to further troubleshoot issues. Currently believe issue is a network outage with a transit provider.

22/07/2012 04:00 - OUTAGE RESTORED. Upstream network provider technicians have identified a failed core switch that was causing errors on their network and preventing proper data flow. The failed switch has been removed from the system and the network has re-converged on the redundant hardware while the failed switch is replaced.

Affecting Server - hotham

• 10/07/2012 19:19 - 11/07/2012 06:00
• Last Updated 13/07/2012 14:58

10/07/2012 19:19 - We are currently experiencing high load on the hotham server. Access to hosting services on the hotham server will be delayed. We are currently investigating the cause of the issue.

10/07/2012 19:38 - We have tracked the cause of the issue down to a drive fault within our SAN array. We are working to fix the underlying issues. Servers may require disk check which will need to be completed before services resume

11/07/2012 01:50 - Engineers are currently performing a live migration of the hotham server to new SAN storage to alleviate performance issues. This process is expected to take a few hours. Services are currently operational but may be slow.

11/07/2012 06;00 - Migration of hotham server to new SAN storage has completes and services and performance have returned to normal. Any customers still experincing difficulty should contact the help desk directly to lodge a support ticket.

• 18/12/2011 19:30 - 18/12/2011 21:00
• Last Updated 20/04/2012 11:38

Issues experinced with mutiple hosts/nodes on the network.

Firewall issue has been investigated and rectified.

Technicians are investigating root cause of outage.

All services back on-line approx 9pm 18/12/2011

Affecting Server - hotham

• 17/04/2012 12:23 - 00/00/0000
• Last Updated 20/04/2012 11:36

We are currently experiencing an outage with the Hotham Server. We are in the process of resolving the issue and aim to have this resolved by 2.30pm AEST.

- Our technicians have resolved the issue and are now in the process of restoring hosting services.

-We are completing system integrity checks now after replacing a component of the disk subsystem. We expect all services to be back online and back to normal within an hour.

Affecting System - All Services

• 21/12/2011 10:26 - 21/12/2011 10:48
• Last Updated 21/12/2011 10:48

Upstream provider appears to be experiencing a routing issue which is affecting some customer’s access to services. Technicians are liaising with the provider now and expect services to be restored shortly.

Update 10:48 am - Routing issue has been sorted, access to all services restored

Affecting Server - Stream3

• 03/11/2011 17:57
• Last Updated 03/11/2011 21:14

-- Service Alert --
Time: 4:58PM AEST
New state: critical
Host: stream3 (199.71.212.205)
Service: All

We are currently investigating an unexpected outage on our USA based 'stream3' server

We will advise further as soon as possible.

ISSUE RESOLVED - SERVICES RESTORED 8:50PM

If you are still experiencing problems at all please submit a support ticket.