What should I do about reputation of being a whore even though I've changed my life?

I am 26 and at 13 I have some really poor decisions as a teenager. Im deeply in love with this guy and the problem is when I was younger I was promiscuous.The man Im engaged to he's hearing it from others. Although I have shared this with him beforehand.He question me about what was said to him and right now I don't know what to do..I have been honest and I'm thinking that me being promiscuous at 13 may break us up eventually..I just don't see now why does it matter since Im 26. I highly value myself as a woman and I really changed..Its been 13 years and its still something that seems to be haunting me is my past. Im constantly judged.. Any Advice