Hi Sarah,
I echo the advice of other members - if in doubt, don't.
Re the issue of getting permission to leave Australia with your children should you come here - I am in a similar situation and consulted a family lawyer in Melbourne last year to understand what legal issues I would face. Getting a Family Relocation Order isn't impossible, but it is an expensive and lengthy process. Average time in Victoria is 18 months from application to grant, and cost is between $50,000 and $60,000. There is no right of appeal over an FRO either - so if the judge didn't find in your favour, you would be stuck here if you didn't want to leave your children.
Best of luck,
Clare