If the owner offers to fix the problems,but I no longer want the house,can I still get my deposit back.?

I put a bid and deposit on a house that failed inspection. The owners offered to fix the problems (Worn out roof,old plumbing,and electrical)but I have already found a house that is ready to move in to.I was told my my RA that I have to let them fix the problem,but I just do not want the house.I was also told that I can not get out of the agreement,nor can I get my deposit back.Is there anything that I can do to get out of this nightmare.Can they really hold on to my deposit and make me stay in a contract for a house that I do not want,that has failed inspection?