Well, if it hadn't been tilled in a few years, I don't think one tilling would be the worst things - especially if it was grass/pasture. If you have aged manure, now would be a good time to add it. If you have hot manure, it should go on in the fall. And keep in mind cow manure is better than horse because horses don't completely digest all the seeds in hay...it's okay if it's really really old, and you can use it for tea, but otherwise probably not a good idea unless you want to grow hay!

Compost would be good to add if you have it. Your local mastergardeners or extension office should offer a soil test so you know if there is any specific thing you should add like ash or lime, etc. I would in the mean time get it covered with landscaping tarp or newspaper w/ straw on top. This will keep your soil from washing away.
Good luck!