The only thing I can think of is if a water pipe breaks, or they have to dig up lines for some reason, my garden will get destroyed. But I'm curious if there are any other reasons why this might be a bad idea.
I'm considering this because this particular part of our yard (running along the side of our driveway) just happens to be the only spot on our entire property that gets full sun all day in the summer. I already have beds on the other side of the driveway- in the main part of the front yard- but they lose sun by about 3pm. So I was thinking I could put a narrow bed on that side of the driveway and put my tomatoes and peppers and stuff over there.