This is how I found to remove the background of an RDC login.

Remove the Wallpaper data in:

HKEY_USERS\.DEFAULT\Control Panel\Desktop