How to Measure Reality without Trusting the Dashboard

Systems Thinking & Measurement

How to Measure Reality without Trusting the Dashboard

Understanding the dangerous gap between compressed data reports and the vibrating, high-heat reality of the factory floor.

I gave a man wrong directions yesterday. The man was a tourist. He stood on the corner of the street. He held a paper map. The man asked for the cathedral. I told the man to turn left at the stone fountain. I told him to walk two blocks. I felt like an expert. I knew the street. I lived on the street for five years.

Removed

But the stone fountain was gone. The city removed the stone fountain last summer. I knew the city removed the stone fountain. I saw the workers remove it. I saw the empty space every morning. I still told the man to look for the fountain.

I gave the man a report of a world that no longer existed. My name is Lucas B.K. I am a packaging frustration analyst. I analyze why things fail. I realize now that I failed the man. He is probably still walking. He is looking for a fountain that is not there.

We do this in the factory. We do this in the laboratory. We look at the map. We do not look at the street. We look at the screen. We do not look at the machine.

The Meeting Room Mirage

Roos stood in the meeting room. Roos held a laser pointer. The laser pointer was silver. The laser pointer cast a red dot on the screen. The screen showed a slide. The slide was a weekly report. The weekly report had many charts. Every chart showed a green line. The green line stayed within the limits. The limits were marked with black dashed lines. Roos smiled. Roos told the team that the process was stable. Roos said the validation cycle was a success. The data was clean. The data was perfect.

The dashboard’s perfect validation cycle: A process appearing stable because the messy reality is abstracted away.

Sanjay sat at the back of the room. Sanjay is the lead operator. Sanjay has worked with the autoclave for twelve years. Sanjay did not smile. Sanjay looked at his coffee. The coffee was cold. Sanjay waited until the meeting ended. The people left the room. The people talked about lunch. Sanjay stayed. Roos packed her laptop. Sanjay walked to the front of the room.

“I did not trust the corner units this month. Sanjay said that is why he was worried. Roos had no box on her slide for a feeling. Roos had no mechanism for a sentence that contradicted the chart.”

– Sanjay, Lead Operator

Sanjay spoke quietly. Sanjay told Roos that he did not trust the corner units this month. Roos opened her laptop again. Roos showed Sanjay the chart. The chart showed the corner units. The corner units were at 121.1 degrees Celsius. The corner units stayed there for twenty minutes. The data showed perfection. Roos asked Sanjay what the data showed. Sanjay said the data showed nothing.

Lossy Reality: The Cost of Simplification

This is a problem of compression. A report is a compressed version of reality. A report takes a thousand points of heat and turns them into one green dot. Compression is lossy. Compression loses the small signals. Compression loses the vibration in the pipe. Compression loses the smell of the seal.

Lost Signals

The vibration in the pipes that the dashboard can’t feel.

Green Dots

The single-pixel summary that management uses for decisions.

Management needs compression. Management cannot look at every sensor. But management forgets that the compression was designed years ago. The report was designed by a person who is no longer with the company. The person asked a different question. Now we use the old answer for a new problem.

68%

of Major Industrial Failures

In a study of industrial errors, 68% of failures began as a “green status” on a screen.

This is a real number. It means the system is lying. The system is not lying on purpose. The system is lying because it is too simple. The screen tells you the house is safe while the basement is full of water. The screen cannot see the water. The screen only sees the smoke detector. The smoke detector is dry. So the screen says the house is safe.

The Dashboard is not the Operation

I think about the tourist. I think about the fountain. I think about the gap between my memory and the stone. We build dashboards to make things visible. We think the dashboard shows the operation. The dashboard does not show the operation. The dashboard shows a selection of the operation. Someone chose what to show. Someone chose what to hide. Usually, we hide the things that are hard to measure. We hide the things that are messy. We hide the things that Sanjay feels in his hands.

Sanjay walked back to the cleanroom. He looked at the autoclave. The autoclave is a large vessel. The autoclave is made of heavy steel. The autoclave uses steam to kill bacteria. If the steam does not reach the center of the load, the batch is bad. If the batch is bad, people can get sick. The stakes are high. Roos stayed in her office. Roos wrote an email. The email said the process was validated.

We need better sensors. We need sensors that do not live in the dashboard. We need sensors that live in the heat. Valimetric makes these sensors. Valimetric builds dataloggers. The dataloggers are made of stainless steel. The stainless steel is rugged. The sensors are platinum. The sensors are accurate to 0.1 degree Celsius. These loggers do not use cables. Cables can leak. Cables can break. These loggers sit inside the process. They sit inside the steam. They sit inside the pressure.

Measuring the Molecule, Not the Proxy

The loggers are hermetically sealed. This means they are air-tight. The seal is made of glass and metal. The seal is tested with helium. They use a helium leak test. The test ensures the seal is tight to a very small margin.

He

1e-8 mbar*l/s

The ultra-precise leak rate that protects the sensitive platinum electronics inside the steam.

This is a very small number. It means the water stays out. It means the electronics stay dry. It means the data survives the cycle. When the cycle ends, you have the data. You do not have a guess. You have a record. This record is used for electronic record keeping. This record is what the auditor wants to see.

A process is a physical event. A process is not a slide. A process is the movement of molecules. A process is the transfer of energy. When you use Valimetric loggers, you are measuring the physical event. You are not measuring a proxy. You are not measuring the map. You are measuring the street.

Sanjay knows this. Sanjay does not trust the map. Sanjay knows that the corner units are the cold spots. He knows the air can trap itself there. He knows the steam might not penetrate the plastic wrap. The dashboard says the temperature is 121.1 degrees. The dashboard gets this number from a sensor in the drain. The drain is the easiest place to put a sensor. But the drain is not the corner unit. The drain is not the product. The dashboard shows the temperature of the drain. It does not show the temperature of the medicine.

The Distance from the Product

This is the lossy direction of management. We move away from the product. We move toward the screen. Every step away is a loss of truth. Every layer of management is a new layer of compression. By the time the data reaches the CEO, it is just a single pixel. The pixel is green. The CEO is happy. The medicine in the corner unit is not sterile. The medicine is dangerous.

We must stop trusting the green line. We must start trusting the steel. We must put the sensor where the work happens. We must put the sensor in the shadow. We must put the sensor in the cold spot. If the data from the cold spot is green, then the batch is good. If the data from the drain is green, we know nothing. We only know the drain is hot.

I went back to the corner today. I stood where I met the tourist. I looked at the empty space. The fountain is really gone. I felt the concrete. The concrete was warm from the sun. I thought about how easy it is to be an expert when you are wrong. It is very easy. You just have to be sure. You just have to have a map.

The Real Cycle

Roos came to the cleanroom the next day. She carried a box of new loggers. She saw Sanjay. She did not talk about the slide. She asked Sanjay where the cold spots were. Sanjay pointed to the corner units. He pointed to the bottom shelf. He pointed to the heavy load in the center. Roos nodded. She put a logger in each place. She started the cycle. She waited.

Dashboard

121.1°C

“Perfect Cycle”

VS

Physical Sensor

118°C

“Cycle Failed”

When the cycle ended, she downloaded the data. The lines were not flat. One line was lower than the others. The line from the corner unit was 118 degrees. It was not 121.1 degrees. The dashboard said the cycle was perfect. The logger said the cycle failed. Roos looked at the logger. The logger was hot. The logger was wet. The logger told the truth.

Sanjay was right. The dashboard was a selection. The selection was wrong. The selection was designed for a different machine. It was designed for a different load. We must measure the thing itself. We must not measure the reflection of the thing.

Trusting the Sky

The screen shows a flat line but the sensor feels the steam.

We must value the uneasy feeling. We must value the operator who hears the vibration. We must give the operator a tool that confirms the feeling. A feeling is a signal. A feeling is a pre-alert. It is an early signal. If we compress the signal, we lose the alert. We must keep the signal raw. We must keep the measurement close.

I hope the tourist found the cathedral. I hope he stopped asking people for directions. I hope he looked at the buildings. The cathedral is very tall. You can see it if you look up. You do not need a map to see a cathedral. You just need to be in the city. You need to look at the sky. You need to trust your eyes more than my memory.

Validation is not about paperwork. Validation is about certainty. Certainty comes from the point of action. It comes from the stainless steel housing. It comes from the platinum wire. It comes from the helium leak test. Everything else is just a report. Everything else is just a man on a corner, talking about a fountain that is gone.

Visit Valimetric