I think it depends on where you live as well.
Most suburban areas just see the odd huntsman/Redbacks/White tips.
Try living a little more rural like we do.
We do see the odd snake in summer, one actually visited inside the house a few years ago
Huntsman spider don't really do any harm,they are just scary looking.
As I was harvesting the olive grove last week I had one fall onto my face as I was in the tree!!I could not wipe it off as I was holding on - try blowing away a big hairy Huntsman that is clinging to your nostrils!!!!
I do think that you become used to such things pretty quickly.
Nothing is aggressive here - just use common sense like wear gloves when gardening and don't leave clothes piled up on the floor (White Tip spiders love climbing in!)