The journalist’s incendiary debut novel allows readers to speculate about the lives of the Austrian artist’s muses. She tells Helen Brown why she was drawn to his arrogance, his anxiety and the radical poses of his subjects