Check out your local dollar store for seeds and plastic planters. Even if you live in an apartment with little room, you can still start a small windowsill planter with fresh herbs such as parsley and basil for your kitchen. Empty cat litter buckets make great porch and balcony planters for no cost to grow tomatoes and peppers in. Even if you don't have a cat, chances are someone you know does - just ask them to keep an empty bucket or two. (I know we are swimming in them!) You can even ask on Freecycle or Craigslist!
One or two tomato plants at a cost of around $2 for a planter, a small bag of dirt, and a package of seeds could take care of your tomato or pepper needs all summer long!