UPDATE: As of 11:55 AM Zimbra is back up and running.
We are currently experiencing issues with Zimbra Webmail. Zimbra is reporting a network error when accessing Webmail. We are working to address the issue and will post updates here.
Business Service:
Campus Data Network (CDN Wired)
Start Time:
08/07/19 12:51 PM
End Time:
Last Update:
08/07/19 02:09 PM
Details:
We received reports of slow network performance on campus. OIT Network Administrators are aware of the problem and currently investigating.
More Information can be found at https://princeton.service-now.com/snap/?id=outage&sys_id=cc578ef2db8f7b000dc79a82ca961910&table=cmdb_ci_outage&spa=1
Date: Tuesday, May 3, 2016 9:30PM
Who is affected:
Users of CS Department Services
Problem:
We are currently having issues with the CS file server. We are working to restore service and will post updates here as we learn more. CS Staff is currently on-site at the data center. We are working with the vendor to track down the issue. We should have another update by 10:00 PM.
Update 10:00 PM:
Services are starting to get restored. We are now working to bring things back online. We will have another update at 10:30 PM
Update 10:30 PM:
We are still in the process of restoring services. We will post another update at 11:00 PM
Update 11:00 PM:
We had to reboot all the file server nodes and we have one node left to reboot. Once the nodes come back online we will need to check and maybe reboot some CS servers to restore all services back to normal. We will post another update at 11:30 PM.
Update 11:30 PM:
All file server nodes are back online and working as expected. We are in the process of checking on each CS server and rebooting if needed. We will post another update at 12:00 AM.
Update 12:00 AM:
We are still checking on the status of all the CS servers. Some services have already been restored. We will post another update at 12:30 AM.
Update 12:15 AM:
Most CS services have been restored. We have a few servers that are still coming up.
Update 12:30 AM:
All CS services have been restored. Please let us know if you experience any continued trouble.
6:10 PM We are currently experiencing network issues. We are looking to resolve the problem and should have another update soon.
6:20 PM There is presently a Campus wide Network outage ongoing. OIT Administrators are aware of this and are working to restore service ASAP. Updates can be found at http://helpdesk.princeton.edu/outages/view.plx?ID=5226
At 8:40pm OIT Technical Operations and Network Monitoring Services staff swapped in new hardware and all buildings listed below have been stable since that time.
New South building network (does not impact any systems in the New South Data Center)
Computer Science
Eno Hall
1879/Marx Hall
Firestone Library
Nassau Hall
Guyot/Moffett/Schultz
Maclean House
Jadwin Hall
Lewis Thomas Lab
Jul 10, 2015 @ 3:40PM We are currently experiencing some service outages and are working to resolve the problems. Email is currently one of those services not working. More updates to come soon…
Jul 10, 2015 @ 4:05PM We have located the cause of the problem and services are starting to get restored now.
As part of the network relocation work, we will need to bring down the
wireless network in the CS Building. This work will take place
6:00am-9:00am tomorrow morning (1/31/2014).
Users may have received a phishing attempt to their CS e-mail account. The subject may be \”Account Login Alert!\” or \”Princeton Security\”.
Please be aware that there seems to be a coordinated spear-phishing campaign targeting the CS Department. Various e-mails are being delivered to accounts making assorted claims from improper password use to free money or local news and events.
Remember to always exercise caution with e-mail and web sites. These messages prey on your inattention in order to steal your credentials and use them for various nefarious purposes. DO NOT CLICK SUSPICIOUS LINKS, and DO NOT TYPE YOUR USERNAME OR PASSWORD on any site that you are not 100% sure belongs to the CS Department.
If you are not sure, please feel free to forward suspicious messages to CS Staff (including full headers if you can) and we can verify whether or not the message is valid.
If you may have compromised your account, contact CS Staff
If you need any additional assistance, please contact the CS Staff at any time.
Both of the CS LDAP authentication servers went down this morning due to hardware failure. The LDAP servers provide authentication for e-mail, SSH access to public CS servers, and the CS file system. We are working to restore the servers. We currently don\’t have a time when the service will be restored. Updates will be posted to this site as we make progress repairing the servers.
8:30 AM Update – The servers are now booting again and we are working to restore the LDAP software and the LDAP database.
9:20 AM Update – The LDAP software is now working and we are working on restoring the LDAP database.
10:20 AM Update – The LDAP database has been restored from an older version dating back to September. We are trying to update to the latest backup from last night.
11:11 AM Update – We were unsuccessful in restoring to a later version of the LDAP database. If you created a CS account or changed your password after September 24, 2013, you will need to contact CS Staff to update your password.
Who is affected:
All users of the CS Department Network
What is happening:
The Department\’s primary border firewall will be replaced with a new firewall device. During the replacement, connections from the CS Department to the main campus, the internet, or to portions of the CS Department network which are outside our firewall, will be interrupted. However, as OIT will also be performing router maintenance between 05:00 and 07:00 (see earlier announcement), we don\’t anticipate this work causing much additional impact.
Why is it happening:
This is the second step of our three-step process to provide 10Gbps networking from our network core out to the main campus, and, by extension, the internet. This upgrade will give our firewall the internal capacity to support 10Gbps connections.
Due to technical complications, the decision was made to postpone the work in order to minimize the risk of problems. Those issues having been worked out, we have rescheduled this maintenance for Monday, August 12, 2013.
Who is affected:
Potentially, all users of CS Department computing and storage infrastructure.
What is happening:
On Thursday, the storage cluster that provides file service for all CS Department public services will undergo upgrades to its network interfaces.
During this maintenance, connections to Samba/CIFS file shares will experience occasional, temporary interruptions. Users may need to re-establish connections to the file share in some cases.
We DO NOT anticipate actual downtime for other services, but since all maintenance involves the risk of broader problems, this announcement serves as a heads-up. In the event of problems with this maintenance, impacts could range up to outages of ALL CS Department public services that rely on the storage cluster (file service, public login hosts, e-mail, web service, etc). Note that wired and wireless networking connectivity will not be affected.
Why is it happening:
This upgrade will provide 10Gbit network connectivity to our storage cluster, getting us one step closer to end-to-end 10Gbit capability for our services.