If that's the only mod you have, just delete everything in C:\Program Files (x86)\Steam\steamapps\common\The Binding of Isaac Rebirth\resources.
Otherwise, the best thing I can suggest is opening up the rar/zip file next to your \resources folder and comparing the two to delete what it changed.

Same issue. I've tried logging out and logging in again after changing baby, nothing.