OT: AWS having substantial outages today

horshack.sixpack

All-American
Oct 30, 2012
11,360
8,258
113
My frickin Dotloop is out and I'm on the last day of the inspection period with multiple clients. This sucks.
I have a scheduling program that I use that is back ended by AWS. I need to start copying next week's schedule offline every Friday because I can't deliver those services today...
 

mstateglfr

All-American
Feb 24, 2008
15,963
5,815
113
Currently Still Impacted Services:
AWS AppSync
AWS Application Migration Service
AWS Batch
AWS Client VPN
AWS CloudHSM
AWS CloudTrail
AWS Config
AWS Database Migration Service
AWS Deadline Cloud
AWS Directory Service
AWS Elemental
AWS Global Accelerator
AWS Glue
AWS HealthImaging
AWS HealthLake
AWS HealthOmics
AWS IoT Core
AWS Lambda
AWS Outposts
AWS Parallel Computing Service
AWS Payment Cryptography
AWS Private Certificate Authority
AWS Secrets Manager
AWS Site-to-Site VPN
AWS Transit Gateway
AWS Verified Access
Amazon AppStream 2.0
Amazon Athena
Amazon Aurora DSQL Service
Amazon Bedrock
Amazon Chime
Amazon CloudFront
Amazon Cognito
Amazon DocumentDB
Amazon EMR Serverless
Amazon ElastiCache
Amazon Elastic Compute Cloud
Amazon Elastic Container Registry
Amazon Elastic Container Service
Amazon Elastic File System
Amazon Elastic Kubernetes Service
Amazon Elastic Load Balancing
Amazon Elastic MapReduce
Amazon EventBridge
Amazon FSx
Amazon GameLift Servers
Amazon GameLift Streams
Amazon Interactive Video Service
Amazon Kendra
Amazon Kinesis Video Streams
Amazon Location Service
Amazon MQ
Amazon Managed Service for Apache Flink
Amazon Managed Service for Prometheus
Amazon Managed Streaming for Apache Kafka
Amazon Managed Workflows for Apache Airflow
Amazon Neptune
Amazon OpenSearch Service
Amazon Pinpoint
Amazon Polly
Amazon Q Business
Amazon Redshift
Amazon Relational Database Service
Amazon SageMaker
Amazon Security Lake
Amazon Simple Notification Service
Amazon Transcribe
Amazon VPC IP Address Manager
Amazon WorkSpaces
EC2 Image Builder
Traffic Mirroring

Resolved and Restored Services:
AWS B2B Data Interchange
AWS CloudFormation
AWS DataSync
AWS Elastic Beanstalk
AWS End User Messaging
AWS Firewall Manager
AWS IAM Identity Center
AWS Identity and Access Management
AWS IoT Analytics
AWS IoT Events
AWS IoT FleetWise
AWS IoT SiteWise
AWS NAT Gateway
AWS Network Firewall
AWS Organizations
AWS Security Token Service
AWS Step Functions
AWS Storage Gateway
AWS Support API
AWS Support Center
AWS Systems Manager
AWS Systems Manager for SAP
AWS Transfer Family
AWS VPCE PrivateLink
Amazon API Gateway
Amazon AppFlow
Amazon CloudWatch
Amazon Connect
Amazon DynamoDB
Amazon EventBridge Scheduler
Amazon GuardDuty
Amazon Kinesis Data Streams
Amazon Simple Email Service
Amazon Simple Queue Service
Amazon Simple Storage Service
Amazon VPC Lattice
Amazon WorkMail
 
Nov 16, 2005
27,478
20,399
113
Fun way to say ole miss lost & florida is after their coach
You Got It Agree GIF
 

Dawgzilla2

All-Conference
Oct 9, 2022
2,038
2,370
113
The white noise my echo dot plays at night went silent, and I couldn't get back to sleep. I kept asking Alexa to resume playing, but she couldn't understand me.

Things seemed back to normal when my alarm went off on time, though.
 

horshack.sixpack

All-American
Oct 30, 2012
11,360
8,258
113
This is one of the terrifying things about cloud computing. Amazon, Google etc. are becoming the new single points of failure. As amazing as they are to use and work with, this was bound to happen every now and then.
Some platforms are multi-cloud, but honestly, not enough. If you rely heavily on a SaaS vendor and their backend is tied firmly to a single cloud provider, you are carrying quite a bit of business risk whether you recognize it or not.
 

horshack.sixpack

All-American
Oct 30, 2012
11,360
8,258
113
"Cloud-based" sounds far more sophisticated than "it's saved on a computer in a shed in West Memphis"
The number of business owners I run across who are completely OK with not understanding or acknowledging risks that are inherent to cloud computing is countless. It's almost like they see a pivot to cloud as a reason to stop caring about their IT. There are many good reasons to go to cloud, but none of those is to reduce/eliminate all risk. It simply changes risks.
 

Chesusdog

All-Conference
May 2, 2006
4,781
4,738
113
The white noise my echo dot plays at night went silent, and I couldn't get back to sleep. I kept asking Alexa to resume playing, but she couldn't understand me.

Things seemed back to normal when my alarm went off on time, though.
Must have affected Ring as well. Had a hell of a time trying to disarm my home security so I could leave for work this morning.
 
  • Haha
Reactions: BreckyBratt
Nov 16, 2005
27,478
20,399
113
Must have affected Ring as well. Had a hell of a time trying to disarm my home security so I could leave for work this morning.
The parent company of the grain elevator we use I guess uses their cloud services. I can’t access the load tickets online. Also the pivotal Weather website I look at has outages because of the same thing. Pretty wild.
 

eckie1

All-Conference
Jun 23, 2007
3,887
3,797
113
I heard DNS issues. All that tells me is that 1) It really is DNS issues OR 2) A network guy who has no idea what the problem is said "DNS Issues" because it is impossible to prove a negative and many times it is DNS issues
I read that it had to do with EC2 and some updates made where it was tripping up trying to find healthy instances…. I thought it was just US EAST, and some companies automatically fail over to WEST. My company was hit pretty hard.
 

RebelRH

Freshman
May 2, 2013
104
82
28
Don't know if it tied to the AWS stuff but AT&T is out for the Tupelo area. No internet on the main system, no phones, no emails, several restaurants/stores are cash only, etc. We have a really slow internet service we can log into. It is marginal service.
 

onewoof

Heisman
Mar 4, 2008
14,870
12,963
113
AT&T and Verizon have been down several times this year. Guessing that Tupelo and other areas around here are not on their top 100 priorities