Plasterer - worried about the dust I've been exposed to

Hi I’ve been doing some recent research and come to my knowledge that dust from my job can be dangerous I’ve recently bought a mask with filters and been using it in just worried now that I’ve ruined myslef for the future im 23 and been on and of the job for 7 years I’d say I’ve done 3 to 4 years on the job obviously with year brakes in between when I’ve gone to other jobs like working in shops and carpet cleaning but im a plasterer and been exposed to all sorts of dusts with no mask on it’s making me wanna get a new job but now im actually a plasterer I love my job I only hated it while I was a labourer so dunno what to do? Does anyone think I’ve ruined myslef before I’ve begone or will I be okay I’ve asked other plasterers and there’s people who have been on the job for 45 years with no mask and there okay my boss is 60 and he’s okay im just worried really don’t know what to do nobody told me to wear a mask when I was younger