Before applying a test stimulus through a switched fixture, establish both the commanded selection and the physical path that selection produced. Keep the route under one owner through stimulus and observation. A selector register reading back the requested channel does not prove that the intended contacts, wiring and load are connected. This is an original…
Count a power-cycle exposure only after evidence shows that the relevant device rails reached the required off state for the required interval. A relay command, a dark LED or a new console banner is insufficient by itself. Keep invalid exposures separate from functional failures after a valid cycle. This is an original campaign-validity procedure informed…
A two-device radio result belongs to a specific pair, direction and pair of software configurations. Bind both participants before starting and invalidate that association when either side reconnects or changes firmware. A good response from a nearby third device must not complete the intended pair’s test. This is an original paired-evidence procedure with one concrete…
A skipped or filtered test needs a reason before it can be removed from a coverage claim. Unsupported product hardware, missing bench equipment, unavailable host tools and deliberate selection filters are different conditions. Preserve them separately and reconcile every required configuration against actual execution evidence. The implementation examples below are pinned to Zephyr v4.0.0 Twister….
When tests fail only in parallel, first inventory shared names and mutable state. Two otherwise correct cases can overwrite one result file, change a process-global setting or reuse a cached connection. Adding a sleep may change the interleaving without repairing ownership. This guide focuses on runtime test-host interference, not shared electrical supplies or parallel build…
Compare old and new test parsers on identical raw fixtures, but judge both against an independently specified meaning. Agreement can preserve a shared defect. A justified parser change may deliberately alter a result, especially when the old implementation mishandled units, missing data or invalid numeric text. This article executes sixteen original host fixtures on CPython…
A device that remains powered for several days may have exercised the intended storage, radio or peripheral path for only a few minutes. Qualify a long-run test by completed work and resource-specific activity as well as elapsed time. A quiet log and a live heartbeat do not demonstrate sustained exposure. This article provides an original…
A simulator returning the same error code as a failed device does not automatically reproduce the device failure. Review the causal path, outstanding work, side effects and recovery state before using that simulated result as evidence for a hardware fault requirement. This article defines an original fault-equivalence worksheet. Its only executed example is a small…
A saved seed can reproduce a generated command list under controlled software conditions. It cannot reproduce a USB delivery delay, an independently running peer, an interrupt order or the electrical state left by a previous case. Preserve the generated schedule and the observed external events alongside the seed when a randomized hardware-in-the-loop test fails. This…
Use diagnostic firmware for the hardware paths it genuinely exercises, then map its differences from the shipping image to the final verification still required. A direct peripheral test can establish useful assembly evidence while bypassing the scheduler, driver configuration, security policy or application logic that the customer will use. This is an original configuration-delta procedure…