I'm similar in a way. When I first went to Land's End in Cornwall, back in 1982 on a Uni climbing course, I felt some attachment to the area, even though I'd not visited there before.
I managed to live there for 10 years and still own a house there.
I'm returning to live in Blighty, and will not return to the area I was born, as I feel no connection to it.
I will move back to Land's End, and not just because we have a house there.