Skip to content

Latest commit

 

History

History
221 lines (153 loc) · 12 KB

README.md

File metadata and controls

221 lines (153 loc) · 12 KB

OpenSASE

License GitHub commit activity Libraries.io dependency status for GitHub repo pre-commit.ci status OpenSSF Scorecard OpenSSF Best Practices

flake-check release-images pages Dependency Review GitHub Release

Open, self-hosted Secure Access Service Edge components built from OSS tooling, declared end-to-end with Nix.

OpenSASE is a TLS-inspection edge. Clients connect over OpenVPN; an mitmproxy addon decrypts and re-encrypts traffic per a URL-category policy; every payload is scanned by ClamAV; every verdict is written to a JSONL decision log. Run it from a Raspberry Pi to a rack server, for a team or for a household.

Two halves, one codebase:

  1. The SASE edge — policy-driven inspection for teams and servers.
  2. The home appliance — install it like a Pi-hole and every family device routes through it: per-device policy and blocking, full traffic visibility, and malware verdicts on what you choose to decrypt. Planned additions — agent (MCP) inspection, DNS-layer policy, short-lived certs, chat (XMPP) with attachment scanning — are tracked in Future and on the roadmap board.

The stack is modular by design: the bare-minimum decrypt edge (dnsmasq + openvpn + mitmproxy + policy) stands alone; scanning and future modules layer on as opt-ins (compose profiles are tracked on the roadmap; today the full compose file below is the one deployment).

Two deployment paths, one source of truth:

  1. Containers — pull the Nix-built OCI images from GHCR and docker compose up on Linux, macOS, or Windows.
  2. Nix / NixOS appliance — the same stack as stock NixOS modules: build a QEMU VM, nixos-rebuild a physical or remote host.

Architecture

flowchart LR
    client["VPN client<br/>(any)"]
    subgraph edge["OpenSASE edge"]
        vpn["openvpn<br/>udp/5443"]
        mitm["mitmproxy<br/>tcp/8080 explicit · TPROXY 80/443 transparent<br/>splice or bump per URL category"]
        clam["clamav (clamd)<br/>tcp/3310 INSTREAM"]
        dns["dnsmasq<br/>udp+tcp/53"]
        log[("decision log<br/>decisions.jsonl")]
    end
    net((Internet))

    client -- "OpenVPN (TLS 1.2, tls-crypt)" --> vpn
    vpn --> dns
    vpn -- "HTTP/HTTPS" --> mitm
    mitm -- "clamd INSTREAM scan" --> clam
    mitm -- "Every verdict" --> log
    mitm -- "clean traffic" --> net
    mitm -. "INFECTED: blocked + logged" .-> client
Loading

Verdict order: passlist (splice, no decrypt) → bumplist (decrypt + scan) → default bump. Every verdict — splice, bump, clean, INFECTED — is written to /data/log/decisions.jsonl. The addon speaks clamd's INSTREAM protocol directly.

Release artifacts

All images are built by Nix — no Dockerfile builds. CI (.github/workflows/release-images.yml) builds each image with dockerTools.buildLayeredImage from the flake and pushes to GHCR on v* tags, with an SPDX SBOM per image:

  • ghcr.io/shsingh/opensase-dnsmasq — DNS for VPN clients
  • ghcr.io/shsingh/opensase-clamav — clamd scanner (DB bootstraps on first run, SKIP_FRESHCLAM=1 to skip)
  • ghcr.io/shsingh/opensase-mitmproxy — decrypt/re-encrypt core; addon + policy lists baked into the image
  • ghcr.io/shsingh/opensase-openvpn — VPN server (config + certs supplied by you)

The same images build locally: nix run .#load-images.

Releases

Releases are GPG-signed tags. The release workflow verifies the tag (git tag -v) and refuses to publish unsigned material:

VERSION=v0.1.1

git tag -s $VERSION -m "OpenSASE $VERSION: release summary"
git push origin $VERSION

CI matrix-builds the four images on Linux runners, publishes to GHCR (:latest + version), and opens a draft release with generated notes: image-digest table, commit changelog since the previous tag, SPDX SBOMs as assets, and a compose deploy snippet. Review and publish the draft.

Quick start — Docker (no Nix required)

Any OCI runtime: Docker Engine / Docker Desktop on Linux, macOS, Windows, or Podman.

git clone https://github.com/shsingh/opensase && cd opensase
docker compose -p opensase up -d

The OpenVPN server requires a PKI before it starts:

nix run .#vpn-init     # one-time CA bootstrap into ./state/openvpn

Copy ./state/openvpn/* into the openvpn_priv volume and restart the openvpn service. Point a client at udp/5443 and an explicit proxy at <host>:8080.

Quick start — Nix / NixOS

Install Nix on any Linux distribution, or run NixOS:

git clone https://github.com/shsingh/opensase && cd opensase

# 1. Bootstrap the OpenVPN CA + certs (gitignored ./state)
nix run .#vpn-init

# 2a. QEMU VM (Linux host):
nix build .#vm-x86_64 && ./result/bin/run-opensase-vm      # aarch64: .#vm-aarch64

# 2b. Real machine or remote host:
nixos-rebuild switch --flake .#opensase
nixos-rebuild switch --flake .#opensase --target-host root@<ip>

# 2c. Container stack from locally built images:
nix run .#load-images && docker compose -p opensase up -d

To add the edge to an existing NixOS host, import nix/appliance.nix — it composes stock modules (services.clamav, services.dnsmasq, services.openvpn) plus the services.opensase module.

Kubernetes

Declarative base manifests are committed: k8s/manifests.cue is the single service model (rendered to k8s/manifests.yaml by nix run .#k8s-manifests, or cue export ./k8s -e list --out yaml — apply with kubectl apply -f k8s/manifests.yaml). The service contract:

Container Image Capabilities Persistent volume
dnsmasq opensase-dnsmasq — RWO for /var/lib/misc
clamav opensase-clamav — RWO for /var/lib/clamav (signature DB)
mitmproxy opensase-mitmproxy — RWO for /data (decision log)
openvpn opensase-openvpn NET_ADMIN RWO for /data-priv (server.conf + PKI)

Deployment requirements:

  • PKI distribution: server.conf, ca.crt, server.crt/key, ta.key must exist under /data-priv before openvpn starts. Inject via Secret + pod postStart copy, or mount from a SecurityContext-protected volume. Current images check no paths; the k8s follow-up adds a strict readiness gate.
  • LoadBalancer / NodePort for udp/5443 (VPN) and tcp/53 (DNS); mitmproxy 8080 is ClusterIP for explicit-proxy clients or LoadBalancer for TPROXY testing.
  • Transparent mode on k8s: unsupported. TPROXY policy routing inside a container network was unreliable in the original design and remains docker/compose-only as explicit proxy. On Kubernetes, run mitmproxy explicit (8080) behind a Service; transparent interception needs CNI-level support (e.g. a Layer 7 plugin or patched sidecar).
  • clamd scale: one replica; the signature DB bootstraps on first start — attach a PVC to avoid re-download on restart.

Module options

services.opensase.enable = true;
services.opensase.mitmMode = "regular";   # or "transparent" (TPROXY 80/443)
services.opensase.listenPort = 8080;
services.opensase.policyPass = ./my/pass.txt;
services.opensase.policyBump  = ./my/bump.txt;
services.opensase.decisionLog = "/var/lib/opensase/log/decisions.jsonl";

Policy

  • nix/policy/pass.txt — domains spliced through, never decrypted
  • nix/policy/bump.txt — domains always decrypted and scanned

Both are types.path NixOS options, overridable at rebuild time. In the container images they are baked in per tag; to change policy, rebuild the image or mount your own lists into the mitmproxy container.

Client setup

Windows

  • Copy the generated .ovpn profile into OpenVPN's config directory; connect as Administrator (the tunnel requires it).
  • Trust the mitmproxy CA: double-click the .crt, install for the current user, into Trusted Root Certification Authorities. Chrome and Edge read this store; Firefox has its own (Settings → Certificates).

macOS

  • Import the profile into OpenVPN Connect or Tunnelblick; trust the mitmproxy CA in the System keychain.

iOS

  • OpenVPN Connect → import the .ovpn; CA: open the .crt from Files and trust it in the profile.

Verify

With the tunnel up:

ping <appliance>          # tunnel reachable
curl -x http://<appliance>:8080 https://example.com   # explicit-proxy path

Download the EICAR test file over HTTPS: the download is blocked and the decision log records INFECTED.

Security notes

  • One process per container; the appliance runs services under dedicated non-root users.
  • The VPN CA lives in its own volume — protect it.
  • TLS 1.2, elliptic-curve certificates, DHE, tls-crypt.
  • Not for production as-is — this is a lab/testing appliance. TLS interception is a high-value target; review bump/splice policy before extending.

Troubleshooting

Start at TROUBLESHOOTING.md — a stages ladder (tunnel → DNS → HTTP flow → verdicts → scanning) with tcpdump/tshark/jq commands at each stage, what the decision log should show, and the cert-trust gotchas (device clocks, CA installation, the #3 HMAC family).

Docs

Full documentation site (architecture, deployment, policy, CI, roadmap, troubleshooting, future directions): https://opensase.kalatopi.sh/ — Quarto, built from docs/.

Contributing & security

See CONTRIBUTING.md for branching, conventional signed commits, and the acceptance suite; SECURITY.md for reporting a vulnerability (never as a public issue); CODE_OF_CONDUCT.md.

Status

  • NixOS flake: appliance + QEMU VMs, nix flake check --all-systems clean
  • Nix-built OCI images for all four services + GHCR release workflow
  • Compose deployment for non-Nix users (Linux/macOS/Windows)
  • Quarto docs site → GitHub Pages
  • OpenSSF Scorecard workflow + badge; OpenSSF Best Practices project 15121
  • Kubernetes base manifests, declarative: k8s/manifests.cue (CUE) → nix run .#k8s-manifests
  • Kubernetes: hardening overlay (PKI Secret + readiness gate) on the CUE base
  • First release: v0.1.1 — images on GHCR (:latest + :0.1.1), release published, SBOMs attached
  • VM closure build + boot smoke test (CI, linux runner)
  • Live verdict verification (EICAR over HTTPS)

Credits

Inspired by @sweitzel's docker-vpnbox.

License

GPL-3.0 (inherited from the original project).