We're in a similar situation as you OP...the house we're renting has a very similar built in wine rack in the kitchen.
My solution: I use it to hold jars of dried beans, grains, rice, pastas, etc. For me, it makes things easily accessible and clears up a little shelf space in my pantry. I made labels that are on the lids, so I can see what I need and just grab it.