I worked right next to a board of asbestos yesterday under a stair case in a small closet I didn't touch or fiddle with it once but I'm scared I could die in so many years now and I cannot sleep
l am happy to confirm that it is highly likely that you will die in so many years from old age,not from an odd chance encounter of asbestos,it would take regular contact over a good number of years for this to be the case.it is more likely that you will have an aircraft land on top of you that is being flown by a cow,so you are safe to get some sleep,
This is a question that pops up from time to time, and as [@gruntifen] says an odd one-off encounter with some asbestos isn't going to be your death sentence. Most people who get asbestos related disease have had repeated and long term exposure, and smokers are at special risk. That doesn't mean that asbestos is safe, but there's no need for undue panic when you encounter the stuff.
From your user name I'm guessing that you are in a job that means you'll be going from house to house and you'll never be sure what conditions you're likely to meet. Perhaps it would be wise to get some training in asbestos awareness? If you're self-employed then paying for a course could be a good investment; if you're a paid employee, maybe your employer would consider sending you on a course.
I don't know enough about the topic to recommend a course, but I'd advise you to steer clear of anything that looks like a cowboy outfit and/or guarantees 100% pass rate! The HSE has some information on training here: Asbestos information, instruction and training.
