I would remove it and keep the starter if the starter smells good.
If the starter ends up being a problem, I would make a starter using yeast (basically flour, water, yeast and about 12 hours) and use that in the sourdough recipes. Perfect the other stages of bread-making, then experiment with starters.
Two cups flour
One packet of dry yeast stirred in to flour
Add enough lukewarm water (~body temperature) to make a thick batter
Place your starter...