The paper proposes the vicinities merging algorithm for prediction with side information. The algorithm is based on specialist experts techniques. We use vicinities in the side information domain to identify relevant past examples, apply standard learning techniques to them, and then use prediction with expert advice tools to merge those predictions. Guarantees from the theory of prediction with expert advice ensure that helpful vicinities are selected dynamically. The algorithm automatically converges on the right vicinities from an initial broad selection. We apply the resulting algorithms to two problems, prediction of implied volatility of options and prediction of students' performance at tests. On the problem of predicting implied volatility, the algorithm consistently outperforms naive competitors and a highly-tuned proprietary method used in the industry. When applied to the students' performance, the algorithm never falls behind the baseline and outperforms it when the side information is beneficial.
|Title of host publication||Proccedings of the 2015 IEEE 15th International Conference on Data Mining Workshops|
|Place of Publication||IEEE|
|Number of pages||8|
|Publication status||Published - 4 Feb 2016|
|Event||Proceedings of the 2015 IEEE 15th International Conference on Data Mining Workshops - Atlantic City, NJ, USA, 14-17 November 2015|
Duration: 4 Feb 2016 → …
|Name||IEEE International Conference on Data Mining (ICDM)|
|Workshop||Proceedings of the 2015 IEEE 15th International Conference on Data Mining Workshops|
|Period||4/02/16 → …|
FingerprintDive into the research topics of 'Specialist experts for prediction with side information'. Together they form a unique fingerprint.