I think there might be regional differences in how the word is used. Where I’m from “backyard” and “frontyard” are the general terms for areas around someone’s house, and “garden” is more specific (referring to something more than a patch of lawn).
Sorry for the confusion, it does seem your view is more in line with how the OSM tag is used 