ITS Network & Systems Status

SDSC Network Slowness

Investigating - Application slowness in various parts of the enterprise is being investigated. At this time the root cause has not been identified and ITS teams continue to investigate.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 27, 2023 - 15:16 PST

About This Site

Report a Problem: If you can't find a listing for a current issue, contact the ITS Service Desk - (858) 246-4357

Academic Services Operational

Business Services Operational

Network Degraded Performance

Communication and Collaboration Operational

Email Operational

Phones and Voicemail Operational

SSO Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Radius Services Rule clean-up Jan 31, 2023 20:00 - Feb 1, 2023 00:00 PST

What: Radius Services Rule clean-up
When: Jan 31st, 8pm-11:59pm

IT Services will be performing maintenance on network equipment which may impact access to services. Services such as wireless and VPN authentication may be affected during this window.

If you notice any additional issues, impact or access to services normally accessible is interrupted, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Posted on Jan 25, 2023 - 12:10 PST

Radius Services Rule Clean-Up Jan 31, 2023 20:00 - Feb 1, 2023 00:00 PST

IT Services will be performing maintenance on network equipment which may impact access to services. Services such as wireless and VPN authentication may be affected during this window. If access to services normally accessible is interrupted, please report this to the Service Desk.
Posted on Jan 23, 2023 - 16:52 PST

Past Incidents

Jan 28, 2023

No incidents reported today.

Jan 27, 2023

Verizon outage

Resolved - This incident has been resolved.
Jan 27, 12:45 PST

Investigating - Verizon is investigating possible issues with cellular services on campus. These services may be slow or unavailable at this time. Visit the following Verizon page for more information https://www.verizon.com/support/residential/service-outage.
Jan 25, 13:28 PST

Maintenance: Student Activity Hub

Completed - The scheduled maintenance has been completed.
Jan 27, 12:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 27, 09:00 PST

Scheduled - The Student Activity Hub (SAH) reports using Hana Production will be undergoing maintenance and thus, unavailable on Friday, January 27 from 9:00 a.m. to 12:00 p.m. PST for scheduled enhancement migrations. This is a minor change with no outage to systems. The expected duration for completing the implementation plan is approximately 30 minutes. With every activity hub (AH) release, the BIA team will conduct a series of steps to publish updates and perform data validation before we consider the release complete.
Jan 25, 08:58 PST

BFS Proxy

Resolved - ITS has confirmed that the issues affecting BFS Proxy have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 27, 11:11 PST

Identified - ITS has identified the cause of issues with the BFS Proxy and is working to implement a solution.. Thank you for your continued patience as our team works to restore these services as quickly as possible. Additional updates and details will be shared here as they become available. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 27, 09:41 PST

Investigating - ITS is investigating possible issues with BFS Proxy. These services may be slow or unavailable at this time, and some users may experience an error message after attempting to change their password.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 27, 07:55 PST

Network Maintenance on switch ctri-2-2-3850-stk

Completed - The scheduled maintenance has been completed.
Jan 27, 08:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 27, 07:00 PST

Scheduled - ITS has scheduled the following maintenance:

START: Friday Jan 27, 2023 7 AM
STOP: Friday Jan 27, 2023 8 AM

IMPACT: Loss of wired and wireless network connectivity to network switch ctri-2-2-3850-stk for approx 60 minutes.

SCOPE: A new stack switch will be added to the stack on the network switch

Please contact ITS Service Desk at (858)246-HELP(4357) or servicedesk@ucsd.edu if you have any questions or concerns.
Jan 25, 15:34 PST

Jan 26, 2023

Maintenance - Research Activity Hub

Completed - The scheduled maintenance has been completed.
Jan 26, 18:31 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 26, 15:01 PST

Scheduled - The Research Activity Hub (RAH) reports using Hana Production will be undergoing maintenance and thus, unavailable on Thursday, January 26 from 3:00 p.m. to 6:00 p.m. PST. This is a minor change with no outage to systems. The expected duration for completing the implementation plan is approximately 30 minutes. With every activity hub (AH) release, the BIA team will conduct a series of steps to publish updates and perform data validation before we consider the release complete.
Jan 23, 15:51 PST

Maintenance: Student Activity Hub

Completed - The scheduled maintenance has been completed.
Jan 26, 18:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 26, 15:02 PST

Scheduled - The Student Activity Hub (SAH) reports using Hana Production will be undergoing maintenance and thus, unavailable on Thursday, January 26 from 3:00 p.m. to 6:00 p.m. PST for scheduled enhancement migrations. This is a minor change with no outage to systems. The expected duration for completing the implementation plan is approximately 30 minutes. With every activity hub (AH) release, the BIA team will conduct a series of steps to publish updates and perform data validation before we consider the release complete.
Jan 25, 08:51 PST

Gmail.ucsd.edu

Resolved - ITS has confirmed that the issues affecting Gmail.ucsd.edu have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 26, 08:14 PST

Investigating - ITS is investigating possible issues with Gmail.ucsd.edu . These services may be slow or unavailable at this time, and some users may experience an error message after attempting to change their password.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 26, 07:28 PST

Network Maintenance--v-stein-0-1-4500x-dist

Completed - The scheduled maintenance has been completed.
Jan 26, 08:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 26, 07:00 PST

Scheduled - ITS Datacom/Installation & Repair Team has scheduled the following urgent network maintenance.

WHAT: Replace v-stein-0-1-4500-dist distro switch
WHEN: Thursday, Jan. 26th at 7:00 AM
SCOPE: Replace faulty switch with new switch
IMPACT: Loss of wired and wireless network connectivity to devices connected to v-stein-0-1-4500-dist distro switch for a duration of 45 minutes to 1 hour.

**Note-this will affect wired and wireless network connectivity to switches connected to distro v-stein-0-1-4500-dist:

v-stein-0-1-3850-24
v-stein-0-2-3850-24
v-stein-1-1-3850-stk
v-stein-1-2-3850-48
v-stein 2-1-3850-stk
v-stein-2-2-3850-48
v-stein-3-1-3850-stk
v-stein-3-2-3850-stk
v-stein-4-1-3850-48
Jan 25, 12:19 PST

Jan 25, 2023

Network Maintenance--aa-voice-9300-stk--Wednesday, Jan. 25th between 3:00 AM & 5:30 AM

Completed - The scheduled maintenance has been completed.
Jan 25, 05:31 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 25, 03:01 PST

Scheduled - ITS Datacom/Network Monitoring Team has scheduled the following network maintenance.
WHAT: Reload aa-voice-9300-stk network switch
WHEN: Wednesday, Jan. 25th between 3:00 AM & 5:30 AM
SCOPE: Reload switch to establish correct switch stack priority
IMPACT: Loss of wired and wireless network connectivity to devices connected to aa-voice-9300-stk for a duration of 15 to 20 minutes
Jan 23, 12:22 PST

Reload network switch b-dib-122-av-9200-24

Completed - The scheduled maintenance has been completed.
Jan 25, 05:31 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 25, 03:01 PST

Scheduled - WHAT: Reload network switch b-dib-122-av-9200-24
WHEN: Sometime between 3 AM and 5:30 AM on Wednesday Jan 25, 2023
SCOPE: Reload the switch to upgrade the IOS software code to resolve an IOS software vulnerability issue.
IMPACT: Loss of wired and wireless network connectivity to network switch b-dib-122-av-9200-24 for approx 30 minutes.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 21, 17:13 PST

Network Maintenance: Reload network switch b-dib-121-av-9200-24

Completed - The scheduled maintenance has been completed.
Jan 25, 05:31 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 25, 03:01 PST

Scheduled - ITS-Datacom/Network Monitoring has scheduled the following maintenance:

WHAT: Reload network switch b-dib-121-av-9200-24
WHEN: Sometime between 3 AM and 5:30 AM on Wednesday, January 25, 2023
SCOPE: Reload the switch to upgrade the IOS software code to resolve an IOS software vulnerability issue.
IMPACT: Loss of wired and wireless network connectivity to network switch b-dib-121-av-9200-24 for approx 30 minutes.
Note: location of switch: Design and Innovation Building (DIB) Room 121
Jan 20, 11:50 PST

Jan 24, 2023

Multiple student systems are experiencing degraded service

Resolved - This incident has been resolved.
Jan 24, 15:23 PST

Monitoring - A fix has been implemented and we are monitoring the results.
Jan 24, 12:07 PST

Update - We are continuing to investigate this issue.
Jan 24, 09:16 PST

Update - We are continuing to investigate this issue.
Jan 24, 09:15 PST

Investigating - We are receiving reports that multiple student systems are not responding this morning. These systems include the Virtual Advising System, Blink Student Tools->Find A Student, and Degree Audit (so far). We are investigating...multiple student systems are experiencing degraded service including MyTritonlink

Thank you for your continued patience as our team works to restore these services as quickly as possible. Updates and additional details will be shared here as they become available. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 24, 08:46 PST

Kaltura

Resolved - This incident has been resolved.
Jan 24, 09:15 PST

Monitoring - Kaltura is experiencing erratic and/or degraded performance following a service outage early this morning. Users can check https://status.kaltura.com to check for updates.
Jan 23, 10:39 PST

Maintenance: Degree Planner application

Completed - The scheduled maintenance has been completed.
Jan 24, 07:43 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 13, 16:32 PST

Scheduled - ITS has scheduled the following maintenance:

START: 2023-01-13 @ 4:30pm
STOP: 2023-01-26 @ 4:30pm

IMPACT: Brief interruption of the Degree Planner application is currently down to apply security updates. The system will be back online before end of business, Thurs 1/26.

Please contact ITS Service Desk at (858)246-HELP(4357) or servicedesk@ucsd.edu if you have any questions or concerns.
Jan 13, 16:28 PST

Network Maintenance--m-hds-admin-4-1-3850-stk--Tuesday, Jan. 24th between 3:00 AM & 5:30 AM

Completed - The scheduled maintenance has been completed.
Jan 24, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 24, 03:00 PST

Scheduled - ITS Datacom/Network Monitoring Team has scheduled the following network maintenance.

WHAT: Reload m-hds-admin-4-1-3850-stk network switch
WHEN: Tuesday, Jan. 24th between 3:00 AM & 5:30 AM
SCOPE: Upgrade software code and reload switch to resolve software bug issues
IMPACT: Loss of wired and wireless network connectivity to devices connected to m-hds-admin-4-1-3850-stk for a duration of 15 to 20 minutes
Jan 19, 11:09 PST

Network Maintenance--a-cogsci-001-its-av-c9200-24

Completed - The scheduled maintenance has been completed.
Jan 24, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 24, 03:00 PST

Scheduled - ITS Datacom/Network Monitoring Team has scheduled the following network maintenance.

WHAT: Reload a-cogsci-001-its-av-c9200-24 network switch
WHEN: Tuesday, Jan. 24th between 3:00 AM & 5:30 AM
SCOPE: Upgrade software code and reload switch to remove provisioned status of switch
IMPACT: Loss of wired and wireless network connectivity to devices connected to a-cogsci-001-its-av-c9200-24 for a duration of 15 to 20 minutes.
Jan 17, 11:55 PST

Jan 23, 2023

Concur - concur.ucsd.edu

Resolved - ITS has confirmed that the issues affecting Concur have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 23, 16:57 PST

Monitoring - ITS has implemented a fix for the issues with Concur. We are currently monitoring the situation to ensure our services have been restored. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 23, 08:53 PST

Update - We are continuing to investigate this issue.
Jan 20, 11:01 PST

Investigating - Concur is investigating possible issues with - concur.ucsd.edu. These services may be slow or unavailable at this time, and some users may experience an error message error 500 bad gateway.

https://open.concur.com/?data-center=us2

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 20, 10:21 PST

ITS Confluence (collab.ucsd.edu) Migration

Completed - The scheduled maintenance has been completed.
Jan 23, 08:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 20, 17:02 PST

Scheduled - What: ITS Confluence (Collab.ucsd.edu)
When: Friday, January 20th, 5pm - Monday, January 23rd, 8am

ITS is migrating its Confluence instance to the cloud version. Affected users have been emailed updates and documentation regarding this move. Collab.ucsd.edu will initially be down for 30 minutes as the database is copied. Remaining work, trouble-shooting, and testing is expected to take the entirety of the weekend, with service resuming the morning of Monday, January 23. The legacy server at collab.ucsd.edu will remain accessible for at least several months afterwards.
Jan 20, 14:55 PST

Jan 22, 2023

No incidents reported.

Jan 21, 2023

No incidents reported.

Jan 20, 2023

Emergency Maintenance

Completed - The scheduled maintenance has been completed.
Jan 20, 13:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 20, 12:00 PST

Update - We will be undergoing scheduled maintenance during this time.
Jan 20, 11:17 PST

Scheduled - In order to address SSO authentication issues, ITS will reboot all DB2 production standby servers this will impact all applications requiring SSO, during this time, applications will be unavailable or experience slowness.
Jan 20, 11:14 PST

Password Change Tool - password.ucsd.edu

Resolved - We identified and removed a system error message that was coming up for some customers if they were trying unacceptable password updates. Customers trying to update their password with an unacceptable word/phrase will now get an error message telling them so. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 20, 08:35 PST

Monitoring - The password change tool appears to be working as expected, but we are continuing to monitor it. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 20, 08:24 PST

Investigating - ITS is investigating possible issues with Password Change Tool - password.ucsd.edu. These services may be slow or unavailable at this time, and some users may experience an error message after attempting to change their password.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Jan 19, 17:04 PST

Jan 19, 2023

Maintenance: Reload network distribution switch v-stein-0-1-4500x-dist

Completed - The scheduled maintenance has been completed.
Jan 19, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 19, 03:00 PST

Scheduled - ITS has scheduled the following maintenance:

START: 3 AM on Thursday Jan 19, 2023
STOP: 5:30 AM on Thursday Jan 19, 2023

IMPACT: Brief interruption of loss of wired and wireless network connectivity to network distribution switch v-stein-0-1-4500x-dist for approx 30 minutes.

Note: the following edge switches that connect to the distribution switch will be impacted and unavailable during the reload:
v-stein-1-1-3850-stk
v-stein-2-1-3850-stk
v-stein-3-1-3850-stk
v-stein-4-1-3850-stk
v-stein-0-1-3850x-24
v-stein-0-2-3850-24
v-stein-3-2-3850-48
v-stein-2-2-3850-48
v-stein-1-2-3850-48

Please contact ITS Service Desk at (858)246-HELP(4357) or servicedesk@ucsd.edu if you have any questions or concerns.
Jan 18, 10:32 PST

Jan 18, 2023

No incidents reported.

Jan 17, 2023

Maintenance - Cognos Production

Completed - The scheduled maintenance has been completed.
Jan 17, 18:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jan 17, 17:00 PST

Scheduled - Cognos Production (bianalytics.ucsd.edu) from 5:00pm to 6:00pm today will be undergoing maintenance and thus, users may experience system slowness and may need to clear their cache after the change is completed.
Jan 17, 12:32 PST

Jan 16, 2023

No incidents reported.

Jan 15, 2023

No incidents reported.

Jan 14, 2023

No incidents reported.