Traditionally it has been held 
at the Kensington Town Hall
or at the Olympia. 

The Olympia Exhibition Centre is a "proper" conference hall, located in Kensington, and even has an Underground stop on the District Line with the same name.

Olympia Conference Centre
Hammersmith Road
London W14 BUX

For directions and map click here  
or scroll down!