I have a 10 month old daughter and a boyfriend that has been convicted of 1st degree CSC can my child be taken?

I was with a man that was convicted of 1st degree CSC in1998 he is about to be getting released from prison. I have a daughter that is almost 11 months old, I am in love with this man that I feel has never been guilty of this crime. I need to know would I be in danger of losing my child even if there is no abuse and this man and I live together?