Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
sergeyshinder
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
We put the error rate in our alert's labels and it never stayed the same alert long enough to fire
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 28
We put the error rate in our alert's labels and it never stayed the same alert long enough to fire
#
sergeyshinder
#
observability
#
prometheus
#
alerting
Comments
Add Comment
2 min read
Our document store took forty one minutes to start because Kubernetes rechecked every file on its disk
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 28
Our document store took forty one minutes to start because Kubernetes rechecked every file on its disk
#
sergeyshinder
#
kubernetes
#
storage
#
containers
Comments
Add Comment
2 min read
A hundred and eighty six tests passed on every laptop and CI never collected one of them
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 28
A hundred and eighty six tests passed on every laptop and CI never collected one of them
#
sergeyshinder
#
cicd
#
python
#
testing
Comments
Add Comment
2 min read
Our rollout finished in two minutes and the new pods started crashing in the fifth
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 28
Our rollout finished in two minutes and the new pods started crashing in the fifth
#
sergeyshinder
#
releaseengineering
#
kubernetes
#
node
Comments
Add Comment
2 min read
One queue nobody was reading filled the disk and RabbitMQ stopped every publisher we had
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 28
One queue nobody was reading filled the disk and RabbitMQ stopped every publisher we had
#
sergeyshinder
#
sre
#
rabbitmq
#
messaging
Comments
Add Comment
2 min read
One secret in our task definition hid the database change sitting next to it
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 28
One secret in our task definition hid the database change sitting next to it
#
sergeyshinder
#
terraform
#
aws
#
iac
Comments
Add Comment
2 min read
We stretched one Alertmanager timer to quiet a disk warning and our payment alert waited behind it
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 27
We stretched one Alertmanager timer to quiet a disk warning and our payment alert waited behind it
#
sergeyshinder
#
observability
#
prometheus
#
alerting
1
reaction
Comments
Add Comment
2 min read
Our nightly image rebuild stopped because nobody had pushed to the repository for sixty days
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 27
Our nightly image rebuild stopped because nobody had pushed to the repository for sixty days
#
sergeyshinder
#
cicd
#
githubactions
#
docker
1
reaction
Comments
Add Comment
2 min read
We streamed our claims file to save memory and the insurer's gateway asked how long it was
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 27
We streamed our claims file to save memory and the insurer's gateway asked how long it was
#
sergeyshinder
#
api
#
integration
#
python
1
reaction
Comments
Add Comment
2 min read
Ansible turned off password logins on every server and sshd read another file first
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 27
Ansible turned off password logins on every server and sshd read another file first
#
sergeyshinder
#
ansible
#
linux
#
security
1
reaction
Comments
Add Comment
2 min read
Our ingress saw every visitor as one of our own nodes and let them reach the admin pages
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 27
Our ingress saw every visitor as one of our own nodes and let them reach the admin pages
#
sergeyshinder
#
kubernetes
#
networking
#
security
1
reaction
Comments
Add Comment
2 min read
Kubernetes knew why checkout failed at three in the morning and forgot by four
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 16
Kubernetes knew why checkout failed at three in the morning and forgot by four
#
sergeyshinder
#
observability
#
kubernetes
#
monitoring
Comments
1
comment
2 min read
Every supplier file with a space in its name was refused as access denied
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 16
Every supplier file with a space in its name was refused as access denied
#
sergeyshinder
#
api
#
integration
#
aws
Comments
Add Comment
2 min read
Terraform said no changes and our Lambda kept running last month's code
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 16
Terraform said no changes and our Lambda kept running last month's code
#
sergeyshinder
#
terraform
#
aws
#
serverless
Comments
Add Comment
2 min read
Our routing table outgrew kubectl apply and half a release went out
Sergey Shinder
Sergey Shinder
Sergey Shinder
Follow
Oct 16
Our routing table outgrew kubectl apply and half a release went out
#
sergeyshinder
#
releaseengineering
#
kubernetes
#
kubectl
Comments
Add Comment
2 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account