If you have an image set as the background image for a diagram and want to delete it, with nothing selected, in the right-hand "diagram" panel select the "Image" button next to "background":



In the background image dialog press "reset" then "apply":