Please note: The issue was identified as related to BadgerNet core routers in Madison. No ETR has been received as of this posting, but an unofficial report from CenturyLink to a site contact mentioned resolution should be completed by 1:00pm.
]]>Thank you,
]]>Thank you,
]]>We suspect that the PayPal service may have an issue with the use of our SSL certificate for catalog.wvls.org migrating to a new server and are investigating with III support.
Thank you for your patience while we work to resolve PayPal Payflow functionality.
]]>Thank you
]]>Sierra services (staff and patron access) across the IFLS and WVLS networks were briefly this morning at approximately 11:05 due to an unexpected router reboot at the WAN core. All services were restored within a few minutes once the router restarted, but we are monitoring.
Please let us know if you continue experiencing any disruption of internet, or Sierra services during the course of the day
Please feel free to blame all weirdness on the Solar Eclipse... =)
]]>Our apologies for the inconveniences. We thank you all very much for your patience.
]]>A graceful "resource offline due to maintenance" placehold webpage has been put in place to ensure users who may try to access the online catalog between 11:30pm cdt 5/14/17 and early-late morning 5/15/17 don't just get a broken resource, but some helpful info.
]]>As of this reporting, services are are already back online, but we are working with III support to ensure all sub-systems came up appropriately. Until we are able to verify 100% operational status, please refrain from using Sierra Desktop Client or Sierra Automation Clients (Self Checks) as there is a possibility of transaction history loss (data loss).
]]>Internet connectivity has been restored to the libraries. The default route needed to be edited to point to the CVTC (Chippewa Valley Technical Collage) BCN switch. Connectivity was reestablished once the route was updated.
We have received reports of several BCN libraries are without internet. WVLS tech team is currently investigating the situation. The libraries with
]]>WVLS is working with BCN to update member libraries using BCN to change default routes.
This means that instead of libraries' network traffic going to WVLS HQ, then on to the Datacenter, such traffic will go directly to the datacenter.
This also means that BCN libraries' primary public IP address will change from 198.150.25.212 to 216.56.243.195.
A future cleanup project will resassign yet a different public IP address for pubic library internet use, but that will be accompanied with separate notifications.
]]>MCPL's WAM configuration appears to be fully functional. https://0-www.whatismyip.com.ilsapp.wvls.org should return 216.56.161.106 for any MCPL libraried patron. It should return 216.56.10.137 for any valid non-MCPL patron.
09:32 am - MCPL resources which are not configured to reach catalog.wvls.org via the WVLS WAN may be unable to connect to the catalog until CCIT is able to remove the WCAN network advertisements for the IP address blocks which were migrated.
Updated route policy for Web Access Management config for MCPL will be completed ASAP. That service remains offline at this time.
The primary services are back online after a brief interruption.
This change would only affect libraries' patrons, accessing the catalog from outside the WVLS WAN.
Normal operations have been restored.
Console access for III support and direct Db Server Access for 3rd party services (if any) will be restored after the completion of the rest of this project.
]]>Update (11/14 9:00am): Three BCN sites are experiencing what appear to be BCN route related issues - we are following up. MCPL is experiencing a route related issue under investigation. TB Scott is likely experiencing a DNS related issue, under investigation. All other sites appear to be working as expected.
Update (11/14 7:25am): Sierra Servers were back online to public at approximately 11:00pm and back online inside WAN (for Sierra Desktop AND catalog access inside libraries) at approximately midnight. We are reviewing individual sites for access consistency, and monitoring connectivity in general.
The Sierra Servers are offline while being physically moved to the new Data Center. They are expected to be back online and fully operational by 11:30pm 11/13/2016.
]]>Some routers on the WVLS network received firmware updates during our regularly scheduled maintenance window on October 18th. As a reminder, our regularly scheduled maintenance window falls on the 3rd Tuesday of each month, from 9:00pm to midnight and can be found on the WVLS Web Calendar (https://calendar.google.com/calendar/embed?src=r0254542jrd8v2lpg8c0sommlc@group.calendar.google.com&ctz=America/Chicago). Recent experiences with (still seemingly random) configuration changes on some current and former Charter library routers after the Oct. 18th updates led us to investigate the Content Filtering service of our core router. The Content Filtering service is included with a bundled license of several security features but has been disabled for the duration of our use of the router. After some preliminary "blanket" application and network troubleshooting, Chris Heitman quickly discovered the unexpected configuration change and was able to resolve it.
While we have now experienced a few unexpected configuration changes like this post firmware update, we have not experienced recurring changes of the same config item on the same router.
]]>While inspecting the Minocqua router, it began dropping responses from the DHCP server. This was unexpected behavior. SonicWall Support Engineers advised the creation of a dedicated routing policy for forwarding traffic to the DHCP server. While this solution (though highly specific) appears to be a redundant configuration, and doesn't explain the rule-based packet dropping which had no triggers to match, it does appear to be working. This issue only began affecting Minocqua today (10/31/16), and may have been catalyzed by router inspection. We will remain mindful of this in the off-chance that other routers with similar configurations somehow fall into the same state.
We will monitor the traffic during the course of this evening and when affected libraries come online tomorrow (11/1/16).
Over the past 5-7 business days, we've received an uptick in reports from a few libraries of an increase in error messages referencing JAR file issues and error messages indicating that Sierra licenses are unavailable.
We are investigating these reports to determine the extent of libraries affected and the root cause.
]]>Update: This issue only appears to be affecting BCN sites.
Update: The root issue has been identified and SonicWall engineering support engaged. DCHP forwarding appears to be failing for sites with routers configured for BCN circuits.
Update: Chris is still online with SonicWall support engineers trying to figure out why the BCN libraries connections are "funky" but not the direct links or the Charter libraries' virtual links.
Update: Issue resolved.
]]>