C# Download all files in HTTP directory

Question

How do I download all files in a directory and all subdirectories on an HTTP server?

Answer 1

By using a command-line tool like wget rather than reinventing the wheel.