Albert hit the nail on the head. And your response that you still want to go ahead is great. So below I'm going to list some jargon/links and more for the heck of it.
I'm not a coder per se myself. But I can read it and know my way around the web.
Jargon to get familiar with:
HTML
CSS(Cascading Style Sheets - These tell the browser how the font should look and what color the background should be etc.)
Drupal, Joomla, Wordpress(These are called Content Management Systems(CMS). They are there to make your web programming easier. Depending on what you want to do with your site)
PHP & MySQL (Advanced) - These let you do what's called server-side scripting and database calls.
SEO(Search Engine Optimization - this is trying to get your website a good rank on Google, Yahoo, MSN, Ask.com)
Programs:
Cpanel(This is a hosting control panel - when you have a domain name and host selected)
Dreamweaver - This is if you don't decide to go with a CMS listed above. You can create and edit sites in this.
FrontPage - Same as Dreamweaver, recently though I haven't heard as much about using it.
Forums to spend many, many hours in:
SitePoint Forums: Resources, Design, HTML, CSS, PHP, ASP, MySQL and more for your web site. WebmasterWorld News and Discussion for the Web Professional Webmaster Forum - Internet Marketing & Search Engine Forums
This is probably a bit of overload. But I'm a big believer in why test the waters, mine as well jump in.
-OJ