In this paper we propose a simple multistep regression smoother which is constructed in an iterative manner, by learning the Nadaraya–Watson estimator with L2 boosting. We find, in both theoretical analysis and simulation experiments, that the bias converges exponentially fast, and the variance diverges exponentially slow. The first boosting step is analysed in more detail, giving asymptotic expressions as functions of the smoothing parameter, and relationships with previous work are explored. Practical performance is illustrated by both simulated and real data.
On boosting kernel regression
DI MARZIO, Marco;
2008-01-01
Abstract
In this paper we propose a simple multistep regression smoother which is constructed in an iterative manner, by learning the Nadaraya–Watson estimator with L2 boosting. We find, in both theoretical analysis and simulation experiments, that the bias converges exponentially fast, and the variance diverges exponentially slow. The first boosting step is analysed in more detail, giving asymptotic expressions as functions of the smoothing parameter, and relationships with previous work are explored. Practical performance is illustrated by both simulated and real data.File in questo prodotto:
Non ci sono file associati a questo prodotto.
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
