in reply to Re^5: How would you code this?
in thread How would you code this?
Do you have a physical understanding of what happens when the sensor generates an aberrant series?
Okay. This is my understanding; which may not be perfect, but isn't too far wrong.
The curves are B-H magnetisation curves produced by Remagraph C hardware. These are renowned as the best available -- they essentially set the standards by which this is done.
The X values are the controlled variable; the Y-values the dependent. Both are digitised quanta of continuously variable analogue properties -- magnetic field strength and magnetic flux density. The measured values are magnetic flux density, induced within the samples under test, as extrapolated from those sensed by external sensing coils.
As the magnetic samples, the inducing & sensing coils, have both reluctance (thus hysteresis) and are subject to eddy currents under the influence of changing magnetic fields; the software that performs the test cycle has a feedback loop and 'goal seeking' criteria to both vary the speed of sampling, and to actively adjust (step back) the input field values in order to detect when and where the induced flux density stabilises, so as to eliminate the transient affects causes by the changing field.
The exact algorithm used by the software to produce the graphs is not publicly documented -- presumably it is valuable proprietary IP -- but the equipment isn't just good; it's the best.
Perhaps the most important thing I can say at this point is that these discontinuities are tiny aberrations within the overall dataset. To try and explain how tiny I've uploaded this image that shows that you need to zoom in (twice) a long way to see just how tiny they are in relation to the overall B-H hysteresis loop.
Thus, throwing them away has little on no effect upon the integrity of the overall information the datasets contain. It just has to be done; and I was looking for a clean way to do it.
(In the end the code is probably going to be rewritten in something akin to matlab, so avoiding Perlish niceties is one goal of my question here.)