No, some neighborhoods have covenants with which you must abide. Chances are, if that's the only one you break, your neighbors and whatnot will turn a blind eye (especially on the backside of the house), but if you break enough of them, they tend to itemize everything you've ever done wrong. (I actually know someone on the receiving end of a law suit right now.)