I have a Meyer Lemon and a mexican lime in half barrels. We protect them from frost by stringing them with christmas lights. I got almost fifty lemons last year! My lime is just a baby but has three fruits this winter.
I think you could probably also grow Giant Cape Gooseberry in containers.