ITS Network & Systems Status

Discontinuation of the Daily Symptom Screening Email Reminder

Monitoring - In partnership with Health Services and EHS, we will be discontinuing the daily Symptom Screening email reminder after Wednesday, December 6th. Suggestions for other ways to get to the Symptom Screening tool can be found in this Knowledgebase Article: https://go.ucsd.edu/47yQGdb.

Please contact the ITS Service Desk if you have any questions at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 29, 2023 - 12:06 PST

InCommon Certificate * new trust chain *

Monitoring - If you're updating your SSL certificate or have updated your certificate on or after October 24, 2023, please note that InCommon has updated an intermediate certificate that will need to be updated as well.
• When retrieving your updated SSL certificate, ensure you've downloaded the updated full chain.
• Install the new chain to the server's trust store along with your approved certificate.

BACKGROUND
UC San Diego subscribes to the InCommon Certificate Service, which allows us to offer certificates at no cost to the end user. These certs should be installed with a complete signing chain in order to be recognized by browsers and other clients.

What is the problem?

InCommon replaced an expiring intermediate certificate around November 3, 2023. Any previously installed signing chains will not work for these new certificates.

How can I tell the difference between the “old” and “new” certificates?

The “old” certificates are issued by “InCommon RSA Server CA”. The “new” certificates are issued by “InCommon RSA Server CA 2” (note the “2” at the end).

How do I get the new certificate signing chain?

The “Enrollment Successful” email from “Certificate Services Manager” include links to “Certificate (w/chain)” and “Issuing CA certificates only” – choose the appropriate link for your particular requirements.

What about certificates that were installed recently?

An excellent tool for testing is the “curl” utility – in verbose mode this will return an error like “unable to get local issuer certificate” in the case of a mismatched certificate chain. In some cases you may need to go back and install the proper signing chain.

Office of Information Assurance

University of California San Diego
Nov 22, 2023 - 16:36 PST

About This Site

Report a Problem: If you can't find a listing for a current issue, contact the ITS Service Desk - (858) 246-4357

Academic Services Operational

Business Services Operational

Network Operational

Communication and Collaboration Operational

Email Operational

Phones and Voicemail Operational

SSO Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Reload network switch revelle-keeling-3-3-1-9300-24 on Thursday Nov 30, 2023 between 3 AM and 5:30 AM Nov 30, 2023 03:00-05:30 PST

Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch revelle-keeling-3-3-1-9300-24
When: Thursday Nov 30, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch revelle-keeling-3-3-1-9300-24 for approx 30 minutes.
Posted on Nov 25, 2023 - 14:22 PST

Reload network switch revelle-keeling-1-9-1-9300-24 on Thursday Nov 30, 2023 between 3 AM and 5:30 AM Nov 30, 2023 03:00-05:30 PST

Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch revelle-keeling-1-9-1-9300-24
When: Thursday Nov 30, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch revelle-keeling-1-9-1-9300-24 for approx 30 minutes.
Posted on Nov 25, 2023 - 12:24 PST

Research Activity Hub maintenance Nov 30, 2023 15:00-18:00 PST

The Research Activity Hub (RAH) reports using Hana Production will be undergoing maintenance and thus, unavailable on Thursday, November 30 from 3:00 - 6:00 p.m. PT for scheduled enhancement migrations. This is a minor change with no outage to systems. The expected duration for completing the implementation plan is approximately 30 minutes. With every activity hub (AH) release, the BIA team will conduct a series of steps to publish updates and perform data validation before we consider the release complete.
Posted on Nov 27, 2023 - 16:22 PST

Student Activity Hub maintenance Nov 30, 2023 15:00-18:00 PST

The Student Activity Hub (SAH) reports using Hana Production will be undergoing maintenance and thus, unavailable on Thursday, November 30 from 3:00 - 6:00 p.m. PT for scheduled enhancement migrations. This is a minor change with no outage to systems. The expected duration for completing the implementation plan is approximately 30 minutes. With every activity hub (AH) release, the BIA team will conduct a series of steps to publish updates and perform data validation before we consider the release complete.
Posted on Nov 22, 2023 - 08:32 PST

Migrate vlan 290 from Agg-vss-1 PO41 to the new Port-channel PO54 Nov 30, 2023 20:00-21:00 PST

On Thursday, November 30 at 8:00 p.m. PT, IT Services will be migrating vlan 290 from Agg-vss-1 PO41 to the new Port-channel PO54. Phone services will be briefly interrupted during the migration.
Posted on Nov 22, 2023 - 09:36 PST

Network Maintenance: reload network switch eng-ebu3b-0-1-3850-stk-2 Dec 6, 2023 03:00-05:30 PST

Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch eng-ebu3b-0-1-3850-stk-2
When: Wednesday Dec 6, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to resolve a software bug issue.
Impact: Loss of wired and wireless connections to network switch eng-ebu3b-0-1-3850-stk-2 for approx 30 minutes.
Posted on Nov 29, 2023 - 12:28 PST

Agg-vss2 upgrades Dec 17, 2023 07:00-14:00 PST

On Sunday, December 17 from 7:00 a.m. - 2:00 p.m. PT, IT Services will be conducting Agg-vss2 upgrades. During this timeframe there will be intermittent outages to all wired and wireless campus networks at these locations:

1) Node-b including (Book Store, Canyon View, Canyon Vista, Chancelor Complex, CMRR (Center for Magnetic Recording Research), DIB (Design and Innovation Building), foodworx, Geisel Library, Gilman Parking,HDH Sixth Launday, Literature Building, Music Center, North Campus Facilities Management Substation, Pepper Canyon Hall, Price Center, Price Center Expansion, VISUAL ARTS BUILDING, Warren Student Activity Center , wlh (Warren lecture Hall), Warren Black Facility Management FM, Warren Brennen FM, Warren Douglas FM, Warren Goldberg FM, Warren mall outdoor Classroom)

2) Node S: (Career Services, Center Hall, SSC Student Services Complex, Student Health.

3) Node G( La jolla Pro)

4) Engineering (bioengineering, calit (Atkinson Hall), ebu1 (Jacobs School of Engineering), serf, smeb, ebu2 , ebu3 (Computer Science and Engineering)

5) [sdsc]cui-sherlock and [sdsc]CIOPS-MGMT-VMOTION
Posted on Nov 29, 2023 - 11:50 PST

Past Incidents

Nov 29, 2023

Migrate Cognos Production Load Balancers (bianalytics.ucsd.edu)

Completed - The scheduled maintenance has been completed.
Nov 29, 17:01 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 29, 16:00 PST

Scheduled - What: Migrate Cognos Production Load Balancers
When: Wednesday, November 29th starting at 4pm for approximately 1 hour.
On Wednesday, November 29th at 4 p.m. PT there will be planned Cognos Production (bianalytics.ucsd.edu) down time for the migration of Cognos Production URL.
Nov 27, 18:20 PST

Migrate Cognos Production url

Completed - The scheduled maintenance has been completed.
Nov 29, 16:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 28, 16:00 PST

Scheduled - From Tuesday, November 28 at 4:00 p.m. PT to Wednesday, November 29 at 4:30 p.m. PT there will be planned down time for the migration of Cognos Production URL.
Nov 22, 09:51 PST

Nov 28, 2023

Reload network switch rsnt-sixth-bldg-1500-c9300-24 on Tuesday Nov 28, 2023 between 3 AM and 5:30 AM

Completed - The scheduled maintenance has been completed.
Nov 28, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 28, 03:00 PST

Scheduled - Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch rsnt-sixth-bldg-1500-c9300-24
When: Tuesday Nov 28, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch rsnt-sixth-bldg-1500-c9300-24 for approx 30 minutes.
Nov 21, 11:35 PST

Reload network switch music-ctr-3-1-9300-24 on Tuesday, Nov 28, 2023 between 3 AM and 5:30 AM

Completed - The scheduled maintenance has been completed.
Nov 28, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 28, 03:00 PST

Scheduled - Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch music-ctr-3-1-9300-24
When: Tuesday, Nov 28, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch music-ctr-3-1-9300-24 for approx 30 minutes.
Nov 21, 15:11 PST

Nov 27, 2023

No incidents reported.

Nov 26, 2023

No incidents reported.

Nov 25, 2023

Resnet core router update

Completed - The scheduled maintenance has been completed.
Nov 25, 06:01 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 25, 05:00 PST

Scheduled - On Saturday, November 25 from 5:00 - 6:00 a.m. PT, IT Services will be performing a Resnet core router update. During this timeframe there will be intermittent outages to all wired and wireless networks

Resnet buildings:

erc-earth-mid-9500-dist
fleet-meteor-3850-12x-dist
mrshll-bldg-j-3850-dist
mrshll-res-p-4-1-4500x-dist
mtthws-sixth-lodge-3850-12x-dist
muir-tamarack-e1-1-4500x-dist
muir-tioga-6.1-9500-dist
ntplln-resnet-1-1-9500-dist(RWlk)
ntplln-bldg3-1-1-9500-dist(Kldscp)
revelle-res-4500x-dist
sixth-bldg-lnge-4500x-dist
V-Warren I (ResHalls)
Warren II (Apartments) Black - Brennen
Warren II (Apartments) Douglas - Z
revelle-keeling-1-1-1-4500x-dist
tdlln-resnet-bldg6-b1-1-9500-dist
tdlln-bldg6-b1-1-9500-dist(garage)
Nov 15, 09:47 PST

Nov 24, 2023

No incidents reported.

Nov 23, 2023

No incidents reported.

Nov 22, 2023

Virtual Advising Center - Unable to Login

Resolved - ITS has confirmed that the issues affecting Virtual Advising Center have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 22, 04:49 PST

Monitoring - ITS has implemented a fix for the issues with Virtual Advising Center. We are currently monitoring the situation to ensure our services have been restored. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 21, 21:48 PST

Investigating - ITS is investigating possible issues with Virtual Advising Center. These services may be slow or unavailable at this time.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 21, 21:17 PST

Nov 21, 2023

Maintenance - Wireless Access Points

Completed - The scheduled maintenance has been completed.
Nov 21, 16:31 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 21, 08:30 PST

Scheduled - ITS Installation/Repair Team has scheduled the following network maintenance.

WHAT: Replace 76 wireless access points located in Urey Hall and Urey Hall Annex

WHEN: Tuesday, November 21st starting at 8:30 AM to end of day

SCOPE: End-of-Life cycle wireless access points need to be replaced with new wireless access points

IMPACT: There may be some periodic loss of wireless access as the individual End-of-Life cycle wireless access points are removed and replaced.
Each wireless access point will go offline for about 15 minutes as these units are being replaced.
There still should be some wireless access as not all of the wireless access points will be replaced, but coverage may be spotty.
This will not affect the wired network.
Nov 20, 14:51 PST

Reload network switch muir-apm-2-1-3850-stk on Tuesday Nov 21, 2023 between 3 AM and 5:30 AM

Completed - The scheduled maintenance has been completed.
Nov 21, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 21, 03:00 PST

Scheduled - Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch muir-apm-2-1-3850-stk
When: Tuesday Nov 21, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 16.12.08 standard code.
Impact: Loss of wired and wireless connections to network switch muir-apm-2-1-3850-stk for approx 30 minutes.
Nov 14, 09:24 PST

Nov 20, 2023

Maintenance - Cognos

Completed - The scheduled maintenance has been completed.
Nov 20, 21:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 20, 16:00 PST

Scheduled - Cognos Downtime tonight, Monday, Nov 20, 4pm-9pm for security patching.
Nov 20, 13:42 PST

SSO - cannot login

Resolved - This incident has been resolved.
Nov 20, 18:43 PST

Monitoring - ITS has implemented a fix for the issues with SSO. We are currently monitoring the situation to ensure our services have been restored. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 20, 16:52 PST

Investigating - ITS is investigating possible issues with Single Sign-On (SSO). This impacts access to multiple applications, such as Duo, Canvas, and Zoom. These services may be slow or unavailable at this time.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 20, 15:02 PST

Nov 19, 2023

Maintenance - UC Learning Center

Completed - The scheduled maintenance has been completed.
Nov 19, 02:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 18, 20:01 PST

Scheduled - The UC Learning Center will upgraded this weekend. The site will be offline starting at 8 p.m. on Friday, November 17th and is expected to be back online on Saturday, November 18th at 2 a.m.
Nov 17, 13:20 PST

Nov 18, 2023

OS Upgrade on HRDB1

Completed - The scheduled maintenance has been completed.
Nov 18, 12:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 18, 08:00 PST

Scheduled - Scheduled Maintenance - The HRDB1.ucsd.edu server will be undergoing maintenance and thus, unavailable on Saturday, November 18 from 8:00 a.m. - 12:00 p.m. PT, for scheduled OS Upgrade from Windows Server 2012r2 to 2022. The expected duration for completing the implementation plan is approximately 4 hours. This OS upgrade has been tested on multiple servers and no issues have been found.
The following application are going to be affected by this upgrade:
a. UCSD Jobs Site
b. HireOnline
c. JDOnline
Nov 15, 10:51 PST

Nov 17, 2023

Datahub/DSMLP down

Resolved - ITS has confirmed that the issues affecting Datahub/DSMLP have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 15:35 PST

Monitoring - ITS has implemented a fix for the issues with Datahub/DSMLP. We are currently monitoring the situation to ensure our services have been restored. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 14:48 PST

Investigating - ITS is investigating possible issues with Datahub/DSMLP. These services may be slow or unavailable at this time.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 13:30 PST

Blink directory search

Resolved - ITS has confirmed that the issues affecting the Blink directory search have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 15:34 PST

Monitoring - ITS has implemented a fix for the issues with Blink. We are currently monitoring the situation to ensure our services have been restored. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 12:30 PST

Update - We are continuing to investigate this issue.
Nov 17, 11:48 PST

Investigating - ITS is investigating possible issues with the Blink directory search turning up blank results. These services may be slow or unavailable at this time.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 11:41 PST

Wifi Connectivity Issues at Center Hall

Resolved - ITS has confirmed that the issues affecting wireless have been resolved. Thank you for your patience as we worked to restore service. If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 17, 07:56 PST

Investigating - ITS is investigating possible wifi connectivity issues at Center Hall 3rd floor. These services may be slow or unavailable at this time.

Thank you for your patience as our team works to restore functionality for these services. Updates and additional details will be shared here as they become available.

If you notice any additional issues or impact, please contact the ITS Service desk at https://support.ucsd.edu, support@ucsd.edu or at (858) 246-4357.
Nov 16, 15:31 PST

Load Balancers fronting Radius (Wireless authentication) will be upgraded

Completed - The scheduled maintenance has been completed.
Nov 17, 00:00 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 16, 20:00 PST

Scheduled - On Thursday, November 16 from 8:00 - 11:59 p.m. PT, IT Services will be upgrading the F5 load balancers fronting Radius services. There is not expected to be any disruptions due to the Load Balancer HA.
Nov 15, 09:49 PST

Nov 16, 2023

Network Maintenance--ebu3b-4-1-3850-stk--IP address 172.31.240.209

Completed - The scheduled maintenance has been completed.
Nov 16, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 16, 03:00 PST

Scheduled - ITS-Datacom/Network Monitoring Team has scheduled the following network maintenance.

WHAT: Reload ebu3b-4-1-3850-stk network switch
WHEN: Thursday, Nov. 16th between 3:00 AM & 5:30 AM
SCOPE: Upgrade software code and reload switch to resolve software bug issue
IMPACT: Loss of wired and wireless network connectivity to devices connected to ebu3b-4-1-3850-stk for a duration of 15 to 20 minutes
Nov 13, 11:32 PST

Network Maintenance--n-mesa-w-parking-c9200-stk--IP address 172.31.251.132

Completed - The scheduled maintenance has been completed.
Nov 16, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 16, 03:00 PST

Scheduled - ITS Datacom/Network Monitoring Team has scheduled the following network maintenance.

WHAT: Reload n-mesa-w-parking-c9200-stk network switch
WHEN: Thursday, Nov. 16th between 3:00 AM & 5:30 AM
SCOPE: Upgrade software code and reload switch to resolve software bug issue
IMPACT: Loss of wired and wireless network connectivity to devices connected to n-mesa-w-parking-c9200-stk for a duration of 15 to 20 minutes
Nov 13, 11:05 PST

Nov 15, 2023

Network Maintenance: Reload network switch erc-earth-n-b-9300-24 on Wednesday Nov 15, 2023 between 3 AM and 5:30 AM

Completed - The scheduled maintenance has been completed.
Nov 15, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 15, 03:00 PST

Scheduled - Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch erc-earth-n-b-9300-24
When: Wednesday Nov 15, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch erc-earth-n-b-9300-24 for approx 30 minutes.
Nov 11, 11:57 PST

Network Maintenance: Reload network switch erc-earth-s-b-9300-24 on Wednesday Nov 15, 2023 between 3 AM and 5:30 AM

Completed - The scheduled maintenance has been completed.
Nov 15, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 15, 03:00 PST

Scheduled - Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch erc-earth-s-b-9300-24
When: Wednesday Nov 15, 2023 between 3 AM and 5:30 AM
Scope: reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch erc-earth-s-b-9300-24 for approx 30 minutes.
Nov 9, 09:50 PST

Reload network switch m-stud-cntr-co-op-c9300-48 on Wednesday Nov 15, 2023 between 3 AM and 5:30 AM

Completed - The scheduled maintenance has been completed.
Nov 15, 05:30 PST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 15, 03:00 PST

Scheduled - Datacom/Netmon has scheduled the following maintenance:

What: Reload network switch m-stud-cntr-co-op-c9300-48
When: Wednesday Nov 15, 2023 between 3 AM and 5:30 AM
Scope: Reload the switch to upgrade the IOS software code to 17.06.05 standard code.
Impact: Loss of wired and wireless connections to network switch m-stud-cntr-co-op-c9300-48 for approx 30 minutes.
Nov 8, 14:13 PST