Nar-Anon Chat™

Hi I'm here to find hope. I feel that in f2f meetings I may be judged for something I didn't know what wrong.
I met my ALO a couple months back, he never lied about his addiction or sugar coated anything, I know all of it. Cumulative total clean time is over 3 years, however he detoxed from his last relapse feb 29th of this year and had been clean since. It all began when I invited him to church and he came which was awesome. After church we sat and talked for hours and hours. I shared my story and testimony and he told me a lot about his past, I mean a lot and how he had almost lost his life multiple times due to using and the last time was the last time, which I took with a grain of salt I mean I didn't even know him that well. Anyways the next night he called me and said hey wanna go to na with me, i really think it would be a good thing for you so you can better understand me and what I'm going through in my recovery. Sure, why not. We go it's great, his sponsor is all excited to meet this awesome chick. Short story we started a relationship before he hit a year. So now down the road I'm getting grief from other sponsors, my pastor, other addicts that we need can't be together. But he never told me that so now I'm emotionally invested, and I'm just trying to make the steps to protect myself from myself getting hurt by wanting to help him.
It's complicated on the outside but actually very simple