TY - CONF AU - Soboroff, Ian AU - Bailey, Peter AU - Craswell, Nick AU - Smeaton, Alan AU - Yilmaz, Emine AU - Thomas, Paul C2 - Proceedings of the 31th Annual International ACM SIGIR Conference on Research and Development Information Retrieval, Singapore, SN DA - 2008-07-21 LA - en PB - Proceedings of the 31th Annual International ACM SIGIR Conference on Research and Development Information Retrieval, Singapore, SN PY - 2008 TI - Relevance assessment: are judges exchangeable and does it matter? ER -