How to Set Up Caddy Web Server with Automatic HTTPS on Ubuntu VPS

Introduction to Architecture & Core Concepts

Caddy is a modern, enterprise-ready web server written in Go. Its defining feature is absolutely frictionless, automatic HTTPS. By default, Caddy autonomously provisions, renews, and manages TLS certificates via Let’s Encrypt and ZeroSSL using the ACME protocol, eliminating the need for cron jobs or external certbot dependencies. Its architecture excels at serving as a secure reverse proxy for internal microservices.

Under the Hood: Process Threading and Socket Architecture

When engineering high-availability topologies, administrators must comprehend how the host processes system calls, threading, and asynchronous I/O interfaces like io_uring or epoll. Standard monolithic software architectures block I/O operations, meaning a single network delay freezes an entire execution thread. Modern software paradigms inherently bypass this limitation. By multiplexing thousands of non-blocking sockets onto a handful of active CPU event loops, the underlying runtime engine ensures that network latency never impacts processing throughput. Furthermore, allocating specific NUMA (Non-Uniform Memory Access) nodes strictly to isolated processes guarantees that CPU cache thrashing is minimized. In distributed Linux environments, this micro-level tuning differentiates an amateur deployment from a truly resilient, carrier-grade service.

Consider the impact of the C-groups (Control Groups) v2 implementation in modern systemd environments. By strictly partitioning CPU quotas and enforcing hard memory limits at the hypervisor or container runtime layer, we completely neutralize noisy-neighbor scenarios. If a specific subprocess experiences a memory leak or a catastrophic thread starvation event, the kernel aggressively terminates the offending control group, instantly shielding the underlying host operating system from kernel panics.

Hardware Sizing & Prerequisite Checklist

Before embarking on the installation phase, verify your hardware capabilities. Insufficient resource allocation is the leading cause of random process termination.

System Performance & Benchmark Comparison

Before moving workloads to production, consider the hardware scaling matrices and expected latency overheads across varied compute configurations.

Storage subsystem IOPS dictates ultimate database throughput. While CPU dictates parsing speed, write-heavy architectures inherently bottleneck at the block-storage layer. Always provision PCIe 4.0 NVMe storage block devices rather than legacy SSDs for heavy infrastructural components.

Advanced Linux Kernel Tuning for High-Performance Workloads

To extract the absolute maximum performance from your Linux VPS, standard kernel parameters often fall short, particularly for high-throughput or connection-heavy services. The default settings prioritize general-purpose desktop stability over aggressive server performance. We must modify the sysctl configuration to optimize the TCP/IP stack, file descriptors, and virtual memory subsystem.

# Edit /etc/sysctl.d/99-custom-server.conf
# Maximize file descriptors for heavy network sockets
fs.file-max = 2097152
fs.nr_open = 2097152

# TCP BBR Congestion Control for reduced latency
net.core.default_qdisc = fq
net.ipv4.tcp_congestion_control = bbr

# TCP keepalive tuning for stale connection termination
net.ipv4.tcp_keepalive_time = 300
net.ipv4.tcp_keepalive_intvl = 30
net.ipv4.tcp_keepalive_probes = 5

# Ephemeral port exhaustion prevention
net.ipv4.ip_local_port_range = 1024 65535
net.ipv4.tcp_max_syn_backlog = 65535
net.core.somaxconn = 65535

# Swap reduction for database stability
vm.swappiness = 1
vm.dirty_ratio = 15
vm.dirty_background_ratio = 5

Apply these changes immediately across the system architecture without requiring a hard reboot by running sysctl --system. The BBR congestion control algorithm significantly reduces packet loss queuing over long-distance WAN links, which is critical for geographically distributed users accessing your infrastructure. Concurrently, dropping vm.swappiness prevents the Linux Out-Of-Memory (OOM) killer from prematurely evicting vital application memory pages to slow disk-based swap space.

Step-by-Step Linux Installation & Configuration

Because Caddy is a statically compiled Go binary, installation is trivial. However, leveraging the official APT repository ensures seamless systemd integration and automatic binary updates.

apt install -y debian-keyring debian-archive-keyring apt-transport-https
curl -1sLf 'https://dl.cloudsmith.io/public/caddy/stable/gpg.key' | gpg --dearmor -o /usr/share/keyrings/caddy-stable-archive-keyring.gpg
curl -1sLf 'https://dl.cloudsmith.io/public/caddy/stable/debian.deb.txt' | tee /etc/apt/sources.list.d/caddy-stable.list
apt update
apt install caddy -y

The core configuration occurs within the /etc/caddy/Caddyfile. This file uses a deeply intuitive, block-based syntax that compiles down into a robust JSON configuration under the hood.

# Example /etc/caddy/Caddyfile
api.yourdomain.com {
    # Automatically proxy requests to an internal Node.js app
    reverse_proxy 127.0.0.1:3000
    
    # Enable gzip/zstd compression
    encode zstd gzip
    
    # Inject security headers
    header {
        Strict-Transport-Security "max-age=31536000; includeSubDomains; preload"
        X-Content-Type-Options "nosniff"
        X-Frame-Options "DENY"
    }
}

Apply changes without dropping active TCP connections by invoking caddy reload --config /etc/caddy/Caddyfile. Monitor the systemd journal (journalctl -u caddy -f) to observe the ACME automated certificate provisioning handshake in real-time.

Enterprise-Grade Security Hardening & UFW Firewall Implementation

Deploying public-facing infrastructure demands a rigorous approach to network security. The Uncomplicated Firewall (UFW) acts as your primary network defense perimeter. Furthermore, we mandate the usage of Fail2Ban to parse systemd journal logs and dynamically ban malicious IP subnets attempting brute-force authentication attacks.

# Enforce default drop policies at the kernel level
ufw default deny incoming
ufw default allow outgoing

# Whitelist strictly necessary administrative and web ports
ufw allow 22/tcp  # SSH (Consider moving to a non-standard port like 2222)
ufw allow 80/tcp  # HTTP ACME challenges
ufw allow 443/tcp # HTTPS TLS traffic

# Reload and enable the ruleset
ufw enable
ufw status numbered

Beyond port filtering, secure the internal UNIX socket permissions. Ensure that the application daemon operates under a dedicated, non-root service account (e.g., useradd -r -s /bin/false app_svc). Avoid utilizing root for any operational binary execution. For cryptographic transit security, integrate Let’s Encrypt TLS 1.3 certificates via Certbot or Caddy, disabling legacy TLS 1.0/1.1 protocols entirely in your reverse proxy configuration.

Real-World Troubleshooting FAQ

Q: How does Caddy handle automatic certificate renewal?

A: Caddy has an internal background scheduler. When a certificate has approximately 30 days remaining in its validity period, Caddy automatically reaches out to the Certificate Authority, answers the HTTP-01 or TLS-ALPN-01 challenge, downloads the new certificate, and performs a hot-swap in memory with zero downtime.

Q: Can Caddy serve static files effectively?

A: Absolutely. While famous as a reverse proxy, the file_server directive makes Caddy a blazingly fast static file server. Combining file_server with encode zstd delivers statically built React/Vue frontends with exceptional compression ratios and minimal configuration.