A. This sucks.
B. This puts so many constraints on your future operations on a given environment that you should at least document the consequences and warn people that there is no coming back from setting up an RDS instance for your environment. At least tell them to create a Saved Configuration before doing that!
C. Given these contraints, I would generally recommend not to use the RDS feature of EBS at all. Instead, create your RDS instance and security group separately, then connect via traditional methods (e.g connection URI etc.). It's better for operational flexibility anyway, and you're VERY likely to want to access your RDS instance from outside of EBS.
For those who got bit as we did and are looking for a way out:
1) Simply deleting the RDS instance does not work (you won't be able to run your next environment update), so don't try that.
2) After having set up my RDS instance from EBS (and regretted it), I created a saved configuration, downloaded it from S3 (in your EBS S3 bucket, go to resources/templates/<your-app-name>/), edited it to remove the RDS instance, and re-uploaded it.
3) Loading this modified saved configuration did not work: EBS won't let you modify the RDS settings, so don't try that either.
4) I terminated my environment and re-created it from the above-mentioned saved configuration and the last application version. Then, because the domain name had changed, I also had to update my DNS settings.