Like airplanes and Ferraris, high explosives are undoubtedly dangerous. Using these things wrong or using them carelessly will definitely result in a Darwin Award. Or, worse yet, could result in the death of an innocent person. You've got to go beyond just token "cautious" with these kind of things. It requires expert knowledge and relentless self discipline. Your life is (quite literally) on the line.
That said, just as with planes and Ferraris, with training and knowledge, and proper safety precautions, playing with things that go boom can be made reasonably safe. Particularly if you pick something like Tannerite, whose two parts need to be mixed before they can become explosive. It's not going to explode in storage (unless your house is already on fire) the US Post Office doesn't consider it a dangerous substance to be sent through the mail in the unmixed form, and it needs a really hard impact to set it off. Dropping it on the ground is not enough. Even some handgun bullets aren't powerful enough to set it off. You need a 2500+ feet per second rifle round to do the job.
On a philosophical note, life is about the choice and management of risks. I chose to ride a motorcycle, even though it is considerably riskier than driving a car. I choose to own a sword and possibly in the future may again own a gun, even though these things are risky as well. Other people may well consider this level of risk too much - they would not tolerate it. That's perfectly fine, everyone should be allowed to choose their own level of risk. I choose one that is perhaps higher than average. Other people may choose one that is lower than average. But as long as you don't hurt or endanger anyone else, I firmly believe that we need to be allowed that choice. Because to ban people from doing something simply because it might be dangerous... that's the first step toward the ultimate destruction of freedom. If freedom means anything, it means being allowed to take risks that other people don't want to. As long as you don't hurt anyone else in the process."What the hell am I doing? I'm living my life. So either hand me that shaped charge, or get out of the way."