Turns out, there is different form for Non-Resident citizens which doesn't require any proof at all. I applied this a month before with wrong door number. I can ATO and talk for a while and got my TFN. The application goes through Post Office is for PR and Australian Citizens and doesn't apply for Non-Resident like me.
Thanks again