I like it all, and think it was a good idea to make the "house" square.
As far as I remember, the adjective "squarry" always represented a bad comment when describing a map. And everybody will be agreeing on the fact that squarry mapping is bad mapping, and I won't be the one saying the contrary.
But, in some rare occasions, like this one, where the map is clearly NOT square, except the house, we can ask ourselves what kind of style it gaves to the map.
Don't look at the square house, look at the map at all.
I think the squarry house perfectly support the theme of the map. Kinda desert, lots of rocks. Rude, strong, perseverant, solid.
I like it. I wouldn't change anything.
Sincerely,
Sawyer.