The City of Columbia has a great homeownership assistance program for first time buyers.  The big news is that the program now applies anywhere within the city limits -- not just in the central city area -- and the amount of the assistanceship has been increased from the previous cap of $4,000. 

The definition of the central area has also been widened to include the area north of Broadway up to Business 70 between Stadium Blvd on the west and Old 63 on the east. 

The program provides assistance of up to $5,000 (or 5% of the purchase price, whichever is less) for downpayment and closing costs as a 5-year loan that is foregivable over 5 years.  Qualification is relatively simple, most of it can be handled through your lender.  You will need to take a homeownership class (at least 4 hours long) in order to qualify. 

There are some income limits that are detailed on the city's website.  Homebuying 101 is offered through the public library on the 3rd Saturday of each month for a nominal $10 fee.