Skip to main content

Configuration without enforcement is just documentation !!! Redhat OpenShift Multi Cluster Environment

 

You Have ACM. You Have ACS. So Why Is Your Platform Still Flying Blind?

Most OpenShift platforms have both installed.

ACM — Advanced Cluster Management. Manages the fleet. ACS — Advanced Cluster Security. Secures the fleet.

Most teams treat them as two separate tools that happen to live on the same Hub. That is the mistake. And the consequences show up quietly — until they show up loudly.


What happens when they are not tied together

Scenario 1: The CVE that travelled for 11 days. A critical vulnerability lands in a base image running across nine clusters. Without ACM and ACS wired together — someone manually hunts which clusters are affected, raises tickets, chases teams, waits for patches, re-scans. That process took one platform eleven days. The image ran in production, exposed, for eleven days. With both tools tied: ACS spots the affected image across all nine clusters in minutes. ACM Policy flags every cluster non-compliant. The admission controller blocks new deployments of that image. Hours. Not days.

Scenario 2: The data scientist who could reach production. A Jupyter notebook pod — used for model experimentation — had network access nobody had audited. It could reach the live inference service. One misconfigured query pulled live customer data into a development environment. Without ACS, nobody knew for six days. With ACS Network Graph, that east-west connection appears the moment it is made — flagged, blocked, before the data moves.

Scenario 3: The GPU cluster that onboarded its own way. A new H100 cluster was provisioned in a hurry. ACS was never deployed on it. For three weeks it ran with no runtime monitoring, no admission control, no vulnerability scanning. Nobody noticed — because there was no automated policy requiring it. With ACM Policy managing ACS enrollment, every new cluster inherits ACS automatically at provisioning. Security is not a step someone remembers. It is architecture.


The four decisions that tie them together — and the real production benefit of each


Decision 1: ACS Central on the Hub. SecuredCluster everywhere via ACM Policy.

The moment a new cluster is provisioned through ACM — a GPU spoke, an edge cluster, a regional production cluster — it automatically receives the ACS SecuredCluster agent via ACM Policy. No manual onboarding. No security team ticket. No three-week blind spot.

Production benefit: A financial services platform managing 14 clusters across three regions reduced new cluster security onboarding from a 3-day manual process to zero. Every cluster is born secured. The security team stopped being a bottleneck and started being an architecture.


Decision 2: Every ACS policy carries an enforcement action — not just an alert.

An alert tells someone something is wrong. An enforcement action stops it. The ACS Admission Controller sits at the entry point of every cluster — if a container image carries a critical CVE, the pod never starts. No override. No exception path. No "we'll patch it next sprint."

Production benefit: A healthcare platform eliminated an entire class of vulnerability-in-production incidents. Before enforcement mode: an average of 4 critical CVEs per month reaching running workloads. After: zero in eight months. Not because vulnerabilities stopped appearing — because they stopped being deployable.


Decision 3: ACS Network Graph generates network policies — it does not just visualise them.

The Network Graph shows every real, live connection across every secured cluster — not what was documented two years ago, but what is actually happening right now. That observed reality becomes the NetworkPolicy. Lock it. Any connection outside that policy — a compromised pod reaching an external IP, a dev namespace touching production — is dropped silently and surfaced immediately.

Production benefit: An OpenShift AI platform running NVIDIA NIM inference services used Network Graph to discover three undocumented east-west connections between model serving pods and an internal legacy API. Those connections had existed for months, unmonitored. Network policies locked the real traffic baseline. Two weeks later, a dependency compromise attempted an outbound call. Dropped. Logged. Flagged. The attacker was inside. They could not move.


Decision 4: ACM Policy + ACS = compliance that proves itself continuously.

ACM enforces platform standards across the fleet — ResourceQuotas, LimitRanges, approved registries, GitOps-only deployment paths. ACS enforces security standards — CIS Kubernetes Benchmark, PCI-DSS, HIPAA, NIST 800-53 — mapped to real cluster state, not self-assessed checkboxes. Both feed one compliance dashboard. Both generate evidence automatically.

Production benefit: A government platform reduced its quarterly compliance audit preparation from six weeks of manual evidence collection to a single dashboard export. The auditor received real-time cluster state, policy violation history, and remediation logs — not a spreadsheet someone filled in the week before the audit. The CISO signed off in one meeting because for the first time the evidence was not a claim. It was a proof.


Days into hours — and what that actually means as a platform architect

Here is the question that reveals whether a platform is real or just aspirational:

"A zero-day CVE drops at 2am. How long before every affected workload across every cluster is identified, blocked, and the security team has evidence of containment?"

Without ACM and ACS wired together the answer is measured in days — and it looks like this: someone is woken up, they start manually checking each cluster, they raise tickets to teams who own workloads they cannot directly touch, they wait for responses, they re-scan, they compile evidence, they write the incident report.

Meanwhile the vulnerability is running.

With ACM and ACS properly integrated the answer is measured in hours — and it looks like this: ACS identifies every affected image across the entire fleet within minutes of the CVE entering the vulnerability database. ACM Policy simultaneously flags every non-compliant cluster. The Admission Controller blocks new deployments of the affected image fleet-wide — automatically, without a single human action. The on-call engineer wakes up not to a crisis but to a notification that the platform already contained it, with a full evidence log already generated.

That is not a technology difference. That is an architecture difference.

The platform architect's job is not to install tools. It is to wire them into a system that makes the right decision faster than a human can — at 2am, across 14 clusters, without waking anyone up unless the situation genuinely requires a human.

When ACM governs the fleet and ACS enforces every node of it — and both share a single policy brain — the platform stops being a collection of clusters someone has to watch. It becomes infrastructure that watches itself, governs itself, and proves its own compliance.

That is the shift from platform administrator to platform architect.

Days into hours is not a metric. It is the evidence that the architecture is real.


#OpenShift #RHACM #ACS #PlatformEngineering #CyberSecurity #OpenShiftAI #RedHat #Kubernetes #CloudNative #ZeroTrust

Comments

Popular posts from this blog

TKGS VMware/Kubernetes ReadWriteMany Functionality with NFS-CSI

 TKGS VMware WRX Functionality with NFS CSI ReadWriteMany Access mode in Kubernetes When it come to RWX access mode in PVC, TKGS support it if we have the following: 1. Kubernetes is upgraded to 1.22.9 (This version supports this RWX functionality) 2. vSAN should be there in your environment (VMware uses the vpshere csi, which only support vSAN) How to done it without vSAN: 1. Upgrade the kubernetes to version 1.22.9 2. Use NFS-CSI and then create a new storage class to be consumed. Work Around : 2.a : Please use the below link to get the nfs-csi-driver  https://github.com/ibraraziz/csi-driver-nfs Note: It absolutely fine that we have multiple CSI drivers/provisioner in kubernetes (Just for information) Step:1 Goto csi-driver-nfs/deploy/v4.0.0/ and apply that yaml into your environment. It will create NFS csi provisioner and controller pods in namespace of kubesystem as below Step: 2 Now create storage class and goto the example folder  csi-driver- nfs/deploy/example...

Choosing the Right OpenShift Service: Service Mesh, Submariner, or Service Interconnect?

In today’s digital world, businesses rely more and more on interconnected applications and services to operate effectively. This means integrating software and data across different environments is essential. However, achieving smooth connectivity can be tough because different application designs and the mix of on-premises and cloud systems often lead to inconsistencies. These issues require careful management to ensure everything runs well, risks are managed effectively, teams have the right skills, and security measures are strong. This article looks at three Red Hat technologies—Red Hat OpenShift Service Mesh and Red Hat Service Interconnect, as well as Submariner—in simple terms. It aims to help you decide which solution is best for your needs. OPENSHIFT Feature Service Mesh (Istio) Service Interconnect Submariner Purpose Manages service-to-service communication within a single cluster. Enables ...

PV and PVC Deletion in Kubernetes and remains stuck in terminating state

 First we need to note that :  When you need to delete both PV, PVC then you must start from PVC and then go for PV . I n case mistakenly a PV is deleted first then it goes in terminating state as shown below: Deleted the pv mistakenly Output : See the higlighted one Enlisting the desired PVC for which the PV we have deleted as highlighted  Now if we delete that particular PVC so it will also go into terminating state as shown below After deletion it also goes in terminating state. Work Around Edit the particular PVC like as shown kubectl edit pvc < pvc name> Remove that particular line just as highlighted below: Once Edit is done that Terminiating state is no more there and PVC AND PV completely deleted.👏                     Feel Free to query : Click Here   By: Ibrar Aziz (Cloud Enthusiast) https://ibraraziz-cloud.blogspot.com/ https://www.linkedin.com/in/ibraraziz/