Predetermination of the quantization error in digital measurement systems

Abstract

Digital measuring instruments and systems are subject to inherent quantization errors as a systematic source of error, since there is no way to eliminate them. The general intention is to keep these below a tolerable limit. The paper deals with a method to predetermine the quantization error if the A/D converter word length, the numeric processor word length, the D/A converter word length and the measurement data processing algorithm are known. © 1997 IEEE.