.php vs .html

Hi, I running win2K with Personal Web Manager v5.0. I just installed php using the windows installer. It seems to be working for files with the .php extension, but not for .htm or .html. How do I set this up? This is just my local working/test machine, not my real server. Also, I'm /not/ a big server administrator, so I know only the most basic stuff about setting up the server. The notes said something about editing .htaccess or httd.conf, but those files don't seem to exist on my machine. I suspect they're apache oriented. Thanks, Micah