Just don't throw out the baby with the bath water.
只是不要把婴儿和洗澡水一起倒掉。
英语百科
Don't throw the baby out with the bathwater
Don't throw the baby out with the bathwater is an idiomatic expression and a concept used to suggest an avoidable error in which something good is eliminated when trying to get rid of something bad, or in other words, rejecting the essential along with the inessential.