When you go to Appearance > Background, it loads the customizer, then under the image showing up there should be two buttons, the left one says Remove, the right one change.
If you are not seeing that then something is off in your WordPress install.
You may want to try and deactivate ALL non weaver plugin, just to check if there is an interference.
You may also want to redo the last WP update from Appearance > Update