The background in the Kramden's window changes. Sometimes there are windows and fire escapes. Other times the fire escapes aren't there. This happens within episodes, not just from one episode to another.
The background behind the stove and the window were actually curtains. There are a few episodes in which the corner (where the two meet) would separate and you could see a little of what was behind it.