Too Long; Didn't Read
Recently, one of our Site Reliability Engineers noticed a workload running in our cluster which he hasn’t seen before. The workload was consuming some resources and the SRE wanted to apply some updates to the cluster but was not sure who owns the workload, or what part of the system it belonged to. Eventually, we figured out that it was part of a prototype that an engineer was working on with someone from the business team to experiment with a new feature. Many critical hours would’ve passed without reaching a resolution.