throw the baby out with the bathwater

Meaning: to remove something good in the bid of getting rid of something bad

Example: Janet quitting her job because her ex started working there is a classic example of throwing out the baby with the bathwater. Read on