The optimal linear receiving filter for digital transmission over nonlinear channels

Abstract
The filter minimizes the mean-square error between the sampled input to the decision device and the corresponding transmitted symbols. It is shown that the structure of this optimal receiving filter corresponds to a bank of matched filters, each followed by a linear transversal filter. Applications of this theory cover nonlinear channels with memory, linearly or nonlinearly modulated signals, and disturbances other than Gaussian noise (e.g. interference from other data sources)