The Test Conditions Changed Mid-Run — Can You Still Use the Results?

The Test Conditions Changed Mid-Run — Can You Still Use the Results?

·September 13, 2026

Quick answer: A change in experimental conditions does not automatically make the results unusable. The important question is whether the change can be identified, its effect on the hypothesis can be evaluated, and the affected observations can still be compared meaningfully. Where the change introduces a new uncertainty, the appropriate response may be to separate the runs or design a further experiment rather than combine the observations without accounting for the changed condition.

The 2026–27 Federal Budget announced R&DTI reforms for income years starting on or after 1 July 2028. Until those changes take effect, the R&DTI continues to be administered under the current legislation.

Real experiments rarely stay perfectly controlled

An experimental plan may look tidy before execution.

Then reality intervenes.

A component is replaced. Weather changes. The available material batch is different. A sensor is recalibrated. A software version changes. The production team cannot hold one parameter at the original setting.

These events are particularly common when experiments happen in operating environments rather than isolated laboratories.

The instinct may be either to discard all affected results or to continue as though nothing changed.

Neither response is automatically correct.

The first task is to understand what the change means for the comparison the experiment was designed to make.

Australian Government guidance describes an experiment as a scientific procedure used to test a hypothesis. It notes that experimental records may, for example, describe the parameters that are varied, held constant and observed or measured.

A condition that was meant to remain constant but changes during the run can therefore affect the interpretation.

The question becomes:

Did the condition change the outcome being measured, the mechanism being tested, or the comparability between runs?

Separate a deviation from a new experimental variable

Not every deviation has the same consequence.

Suppose a field trial is testing whether a new control method reduces equipment instability.

Halfway through the trial, ambient temperature moves outside the range used during the earlier runs.

There are several possibilities.

• The temperature change may have no meaningful effect on the measured outcome.

• It may affect both the baseline and experimental configuration in the same way.

• It may interact directly with the control method and become an important explanatory variable.

• Or it may make the earlier and later observations impossible to compare directly.

Those are different research situations.

The team should avoid classifying the significance of the deviation solely after seeing the experimental outcome.

Instead, record the deviation and evaluate its technical significance.

Where possible, that evaluation should use established knowledge, additional controls or a targeted follow-up test.

If the environmental change itself reveals a previously unidentified mechanism, it may even lead to a revised hypothesis.

Preserve what happened before deciding what it means

A deviation log does not need to be complicated. This is a practical research-recording discipline rather than a prescribed R&DTI template. For each material change, record:

For each material change, record:

• when it occurred;

• what changed;

• which runs were affected;

• why the change occurred;

• whether it was planned or unplanned;

• what part of the experiment it could influence;

• how the affected observations will be treated; and

• whether another experiment is required.

This keeps observation separate from interpretation.

That separation matters.

“The temperature rose to X” is an observation.

“The control method failed because of temperature” is an interpretation.

The second statement requires evidence.

R&DTI record-keeping guidance includes experimental plans, trial-run records and test reports showing results and evaluation among the records that may support the experimental progression.

A contemporaneous deviation record can provide the link between the original plan and the analysis that follows.

Do not clean away the conditions that define the limit

Commercial research often seeks a technology that must work in an imperfect operating environment.

In that setting, variation is not always contamination.

Sometimes it is the thing the research ultimately needs to understand.

A system that performs well only under a narrow temperature range, input quality or communications condition may still have produced a valuable research result.

The conclusion is simply narrower than the original ambition.

For example:

• The evidence may support performance within one operating envelope but not another.

• The hypothesis may be supported under controlled loading but remain unresolved under transient loading.

• The mechanism may work at one scale but require further investigation at another.

That is more useful than forcing all observations into one average and declaring the experiment successful or unsuccessful.

Ignition Research's own research approach similarly treats practical constraints as part of the operating envelope rather than something to edit out of the result.

The purpose of experimental discipline is not to create perfect-looking data.

It is to produce a conclusion whose limits are visible.

A changed condition should inform the next decision

Once the deviation has been analysed, the team should decide what follows.

• If the change did not materially affect the test, the original experimental sequence may continue.

• If it created a confounding effect, a repeat run under controlled conditions may be needed.

• If it revealed a new mechanism, the hypothesis may need revision.

• If it established an operating boundary, the research question may already have been partly answered.

The important point is that the next experiment should follow from the evidence.

It should not simply be another run because the previous data looked untidy.

Conclusion

Experimental conditions do not need to remain perfectly unchanged for the evidence to remain useful.

What matters is whether the change is visible, its technical significance can be evaluated, and the resulting observations can still support a defensible conclusion about the hypothesis.

When a deviation changes what the evidence can support, the research record should show that boundary — and the next experimental decision should follow from it.

Sources & Further Reading

Talk to Ignition Research if field conditions, equipment changes or other deviations have complicated the interpretation of an experimental programme and it is unclear what the evidence still supports or what the next research step should be. As a Registered Research Service Provider, Ignition Research assists businesses with research question definition, experimental design, technical investigations and contemporaneous supporting records within its registered research fields.

RSP registration confirms that the provider has met the relevant registration requirements for its registered research fields. It does not constitute government endorsement of a project or guarantee R&DTI eligibility.

We do not determine R&DTI eligibility or provide tax advice. The R&D Tax Incentive is a self-assessment program, and companies remain responsible for assessing their activities, expenditure and circumstances and obtaining appropriate tax advice.

This article provides general information only and is not tax, legal or financial advice.

Working on a project like this?

Tell us what you're building and the part you're not sure will work. A researcher from our Adelaide team (registered Research Service Provider RSP000047) reads every enquiry and replies within two business days. No documents needed.

Describe your projectTry the 2-minute pathway check
Joy Fang
Written byJoy FangFounder, Ignition Research

Joy Fang is the Founder of Ignition Research, helping Australian businesses solve uncertainty through structured, well-documented R&D.

View LinkedIn profile