IF a husband divorces his wife but the couple...

IF a husband divorces his wife but the couple never consummated their marriage. They met several times but there was always someone present in the house and there was always a fear of someone entering the room. They never locked the door (sometimes the doors were closed) but there were always some one coming in intervals. I want to know how to reconcile. If the khulwat e sahiha happened would then the divorce be talaaq e bain (irrevocable). Please give references. Thanks