How Shift and Operator Differences Move Your Thresholds
One pattern shows up on a great many lines after go-live: day shift runs quietly, night shift generates noticeably more false alarms. The cheap fix is to loosen the threshold, which buys peace at the cost of more misses. The better fix is to find out why first — whether the imaging itself changed with ambient light or temperature, whether incoming batches genuinely differ at night, or whether the crews really do work differently. This article covers how to split the statistics, whether per-shift thresholds are acceptable, and when the difference is a management problem rather than an algorithm problem.
Key takeaways
- Split false alarms by shift, by check item and by hour before deciding to touch a threshold.
- Per-shift thresholds are acceptable, but the threshold version must be recorded or historic data becomes inexplicable.
- Ambient light and lamp ageing drift slowly, so periodic review beats one-off tuning.
- If the difference comes from operator habit, tuning the threshold only hides it.
The same vision system, five false alarms in a day shift and thirty in a night shift: a very common complaint after go-live. The first instinct is to loosen the threshold, at the cost of more misses — the problem moves rather than resolves. The more effective sequence is to separate the causes first. Did the images themselves change, through ambient light at shift changeover, daylight through windows, or focus drift as equipment warms up? Did the incoming material genuinely change overnight, with a different supplier or a different storage age? Or do the crews really work differently, with different placement, pace and cleaning habits? The three have entirely different remedies, and only after separating them does tuning make sense.
Split the data three ways first
A single overall false alarm count tells you nothing about cause. Split it at least three ways: by shift, by check item — whether every item rose or only one or two — and by hour, whether the increase is uniform across the shift or concentrated after start-up or before handover. Once split, conclusions often surface on their own. If the rise concentrates on one check item, that item's imaging condition is probably the most light-sensitive. If it concentrates in the first hour, the usual explanation is a cold machine, or state left behind by the previous shift. If it is uniform across the shift, incoming material or operator difference is more likely. None of this needs any investment beyond putting shift and check item into the write-back fields, which is exactly why field design insists on them.
| Possible cause | How to verify | Direction of fix |
|---|---|---|
| Ambient or lamp change | Compare brightness distribution of alarm images from day and night | Add shrouds, use integrated lighting, stabilise shop lighting |
| Temperature drift | Record focus and image sharpness over several hours of running | Longer warm-up, cooling or a stable enclosure, periodic recalibration |
| Incoming batch difference | Join alarm records against incoming batch numbers | Feed batch into the criteria, or stabilise the incoming material |
| Operator habit | Report separately for the window where a different person operates | Back to training and work standard, not to tuning |
Per-shift thresholds are allowed, but must leave a trail
If the cause is environmental and cannot be removed at source in the short term, giving different shifts different thresholds is an acceptable engineering compromise. It needs two companions. First, threshold versions must be recorded, so that every change to per-shift thresholds carries a version number written into each verdict record. Second, there must be a review path, so that two standards are never running unnoticed — in a quality system that is not acceptable, because a part passing on days and failing on nights becomes a quality incident the moment it is traced. The safer position is therefore to remove the difference at source where possible, treat per-shift thresholds as a transitional measure, and state clearly in the process documentation which of the two you are currently in.
The other half: operator rotation
Beyond shift timing, rotation has an easily missed effect. The same station in different hands sees different placement attitude, different seating depth, and even different surface condition. A system sensitive to attitude shows this as more false alarms after a crew change. The right fix is usually not to loosen the criteria but to add a little constraint in the fixture — a locating block, a datum edge — which suppresses the variation far more reliably than teaching the algorithm to tolerate every pose. How camera and fixture work together is covered in camera mounts and fixtures. One more thing worth stating in advance: new operators typically run both a higher defect rate and a higher false alarm rate for their first weeks. That is normal, and if the acceptance period happens to cover it, both sides should mark those weeks out when reading the numbers.
Periodic review beats one-off tuning
Lamps age, lenses collect dust, fixtures wear, incoming material changes. All of these accumulate slowly, none of them triggers an alarm, and so none of them announces itself. By the time the line notices more false alarms, the drift is usually weeks old. The countermeasure is a cheap periodic review: every so often, run a fixed set of standard samples or standard parts through the system and check whether the verdicts still match the previous run. If they do not, something in the system state changed — go and look at lighting, cleanliness or thresholds. Equipment or quality staff can do this in a few minutes, and it catches most drift early. Model-level drift and when to retrain are covered in model drift and recalibration.
Shift variance questions we get asked
Night shift has more false alarms. Will an extra lamp fix it?
If the cause is insufficient or dimmed shop lighting at night, extra illumination usually helps — but use integrated lighting or a shroud to isolate ambient light. Simply raising overall brightness can introduce glare and make things worse.
Do per-shift thresholds breach quality system requirements?
Only if they are undocumented. If threshold versions are fully recorded and process has signed off, per-shift settings are acceptable. What is not acceptable is two different standards running without anyone knowing.
How should we set targets on a station full of new operators?
Treat experience level as a reporting dimension and base acceptance figures on stable operation. Tightening the fixture to reduce the human variable is more fundamental than relaxing the acceptance requirement.
Are your false alarms concentrated on one shift too?
Send us the per-shift numbers and we will help you separate environmental, incoming-material and process causes.
Related articles
-
Alarm Fatigue: Why the Floor Turns the System Off
Many visual SOP systems are not beaten by technical problems — they are muted by…
Read more → -
Visual SOP Camera Selection and Mounting
Camera selection for visual SOP is not the same as for product inspection. The s…
Read more → -
Vision Monitoring at the Semiconductor Die Bonder
Semiconductor packaging stations are characterised by high precision, fast cycle…
Read more → -
Wrong-Assembly Alarms Without the False Alarms
The most common reason a visual SOP project fails is not poor recognition — it i…
Read more →
Need specific advice for your production line?
Our engineers can share practical approaches to process error prevention and SOP compliance inspection for your scenario.
Request a free trial plan