I would like to suggest these places/suburbs Richmond, Toorak, South Yarra, Prahran, St Kilda. These are places I think that covers what you need. As it only requires few minutes t travel time from CBD as well as family suburbs. No suburbs can guarantee 100% crime free, so better look for lowest crime rate suburbs. Hopefully I could help you with your question.