I host most of my sites with a crowd called hosterio.com. Their plans start at 11 bucks US per year and these guys have everything already in place that any site could possibly need, all done using the Fantastico one-click installation system. For example, if you want a PHP/MySQL-based forum or shopping cart on your site, you just install one from a list of available scripts, which includes the following:
Blogs:
b2evolution, Nucleus, WordPress
Classifieds:
Noahs Classifieds
Content Management:
Drupal, Geeklog, Joomla 1.5, Joomla, Mambo, PHP-Nuke, phpWCMS, phpWebSite, Siteframe, TYPO3, Xoops, Zikula
Customer Relationship:
Crafty Syntax Live Help, Help Center Live, osTicket, PerlDesk, PHP Support Tickets, Support Logic Helpdesk, Support Services Manager
Discussion Boards:
phpBB, SMF
E-Commerce:
CubeCart, OS Commerce, Zen Cart
F.A.Q.:
FAQMasterFlex
Hosting Billing:
AccountLab Plus, phpCOIN
Image Galleries:
4Images Gallery, Coppermine Photo Gallery
Mailing Lists:
PHPlist
Polls and Surveys:
Advanced Poll, LimeSurvey, phpESP
Project Management:
dotProject, PHProjekt
Site Builders:
Soholaunch Pro Edition, Templates Express
Wiki:
TikiWiki CMS/Groupware, PhpWiki
Other Scripts:
Dew-NewPHPLinks, Moodle, Open-Realty, OpenX, PHPauction, phpFormGenerator, WebCalendar
Extras:
Language, Side menu appearance, Email notifications, Installations overview
If you get all this for that kind of dough, it doesn't make sense to me to bother coding anything when it is all right there at the click of a mouse button. While it might not suit everyone, for the range of sites I work with I haven't found this hosting company wanting for anything.
This is not an advertisement and I am not affiliated with hosterio or get a kickback for signing anyone up, I only mention this as an option for setting up a reasonably-priced and turn-key site along with all the other ideas posted here.
Cheers.