Does giving the player instructions count as breaking the fourth wall? Because telling the player to press X or something is addressing them. I suppose it only counts as breaking the fourth wall if it's said by an ingame character, so it's safe to have an omnipresent and invisible narrator completely external from the game. All objects can either interact with the player or with the game, and only the player can bridge the gap between these two with controlling a character?
You can give the player instructions in different ways without breaking the fourth wall. Example: Paintings that depict button presses. Honestly as long as it doesn't come from a character's mouth, I probably won't care.