Thank you. I thought I need to create the configuration file, configure virtual hosts and URL rewriting etc. even when I don't use them.
If you are installing from the package managers, the packages that are meant for the distro, would have a default configuration setup just to at least serve static pages, and probably minimally CGI.
Even if you will to compile from the sources, the configurator to produce the makefile should give a working default system most of the time.
The basics of a web server do not need to involve virtual hosting, any URL rewriting or more to serve static files.