Gasoline Alley Oop

A news reporter this morning used the phrase "back alley".  Are there ever alleys in front?  I suppose there could be alleys on the side.  Maybe the phrase comes from where I grew up in NJ, where it seemed that every bowling alley was the rear building in a shopping center?