bcbd1bdb22
Integ / changes (push) Has been skipped
Pre-commit / pre-commit (push) Failing after 1s
CLI exit codes / changes (push) Has been skipped
Test (Install) / changes (push) Has been skipped
Test (Python) / changes (push) Has been skipped
Test (TypeScript) / changes (push) Has been skipped
CLI exit codes / cli-gate (push) Has been cancelled
Test (Install) / test-install-gate (push) Has been cancelled
Integ / integ-gate (push) Has been cancelled
Test (Python) / test-python-gate (push) Has been cancelled
Test (TypeScript) / test-typescript-gate (push) Has been cancelled
Test (Install) / python-minimal (3.12) (push) Has been cancelled
Test (Install) / python-minimal (3.11) (push) Has been cancelled
Test (Install) / python-extra (agno, mirage.agents.agno) (push) Has been cancelled
Test (Install) / python-extra (chroma, mirage.resource.chroma) (push) Has been cancelled
Test (Install) / python-extra (pdf, mirage.core.filetype.pdf) (push) Has been cancelled
Integ / integ (push) Has been cancelled
Integ / integ-database (push) Has been cancelled
Integ / integ-database-ts (push) Has been cancelled
Integ / integ-data (push) Has been cancelled
Integ / integ-ssh (push) Has been cancelled
Integ / integ-ssh-ts (push) Has been cancelled
Test (Python) / audit (push) Has been cancelled
Test (TypeScript) / test (push) Has been cancelled
Test (TypeScript) / python-fs-shim (push) Has been cancelled
CLI exit codes / Python CLI (push) Has been cancelled
CLI exit codes / TypeScript CLI (push) Has been cancelled
CLI exit codes / Cross-language snapshot interop (push) Has been cancelled
Test (Python) / test (push) Has been cancelled
Test (Python) / import-isolation (deepagents, openai, mirage.agents.openai_agents) (push) Has been cancelled
Test (Python) / import-isolation (deepagents, pydantic-ai, mirage.agents.pydantic_ai) (push) Has been cancelled
Integ / integ-ts (push) Has been cancelled
Integ / integ-fuse (push) Has been cancelled
Test (Install) / python-extra (databricks, mirage.resource.databricks_volume) (push) Has been cancelled
Test (Install) / python-extra (deepagents, mirage.agents.langchain) (push) Has been cancelled
Test (Install) / python-extra (email, mirage.resource.email) (push) Has been cancelled
Test (Install) / python-extra (fuse, mirage.fuse.mount) (push) Has been cancelled
Test (Install) / python-extra (hdf5, mirage.core.filetype.hdf5) (push) Has been cancelled
Test (Install) / python-extra (hf, mirage.resource.hf_buckets) (push) Has been cancelled
Test (Install) / python-extra (lancedb, mirage.resource.lancedb) (push) Has been cancelled
Test (Install) / python-extra (langfuse, mirage.resource.langfuse) (push) Has been cancelled
Test (Install) / python-extra (mongodb, mirage.resource.mongodb) (push) Has been cancelled
Test (Install) / python-extra (nextcloud, mirage.resource.nextcloud) (push) Has been cancelled
Test (Install) / python-extra (openai, mirage.agents.openai_agents) (push) Has been cancelled
Test (Install) / python-extra (openhands, mirage.agents.openhands, 3.12) (push) Has been cancelled
Test (Install) / python-extra (parquet, mirage.core.filetype.parquet) (push) Has been cancelled
Test (Install) / python-extra (postgres, mirage.resource.postgres) (push) Has been cancelled
Test (Install) / python-extra (pydantic-ai, mirage.agents.pydantic_ai) (push) Has been cancelled
Test (Install) / python-extra (qdrant, mirage.resource.qdrant) (push) Has been cancelled
Test (Install) / python-extra (redis, mirage.resource.redis) (push) Has been cancelled
Test (Install) / python-extra (s3, mirage.resource.s3) (push) Has been cancelled
Test (Install) / python-extra (ssh, mirage.resource.ssh) (push) Has been cancelled
Test (Install) / ts-minimal (push) Has been cancelled
85 lines
3.2 KiB
Markdown
85 lines
3.2 KiB
Markdown
# Microsandbox + Mirage FUSE
|
|
|
|
Run an untrusted [Microsandbox](https://microsandbox.dev) microVM that reads S3
|
|
through a host-side Mirage FUSE mount. Mirage FUSE-mounts S3 on the **host**;
|
|
Microsandbox bind-mounts that path into the microVM over virtio-fs. The guest
|
|
reads `/s3` natively, with no S3 credentials and no network of its own.
|
|
|
|
## How it works
|
|
|
|
```
|
|
microVM guest --virtio-fs /s3--> host FUSE mountpoint --> Mirage --> S3
|
|
(msb / libkrun) (fuse3)
|
|
```
|
|
|
|
1. `microsandbox_fuse.py` (host) FUSE-mounts an `S3Resource` at a temp mountpoint.
|
|
1. It boots a microVM with `Volume.bind(<mountpoint>, readonly=True)` mapped to
|
|
`/s3`, so the guest's `/s3` is backed by the host FUSE mount over virtio-fs.
|
|
1. `remote/guest.py` runs inside the microVM: it `os.listdir('/s3')` and reads
|
|
`/s3/data/example.jsonl` as if they were local files.
|
|
|
|
The microVM guest has no `/dev/fuse`, so Mirage can't run in the guest; the host
|
|
mount is shared in instead.
|
|
|
|
## Prerequisites
|
|
|
|
- **Microsandbox Python SDK**: `uv pip install microsandbox` (tested with 0.5.10).
|
|
- **`msb` runtime** (provides libkrunfw): `curl -sSfL https://get.microsandbox.dev | sh`.
|
|
On Apple Silicon this also pulls the libkrun HVF backend; x86_64 macOS is not
|
|
supported by Microsandbox.
|
|
- **Host FUSE**: Linux `fuse3` (see platform note below for macOS).
|
|
- **AWS credentials** in `.env.development` at the repo root:
|
|
`AWS_S3_BUCKET`, `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY`, and optionally
|
|
`AWS_DEFAULT_REGION`.
|
|
- The bucket must contain `data/example.jsonl` (any text/JSONL file works; the
|
|
guest just counts lines containing `mirage`).
|
|
|
|
The SDK 0.5.10 embeds the runtime in-process, so there is **no separate `msb server` to start** (just run the example).
|
|
|
|
## Run
|
|
|
|
From the repo root (so `.env.development` loads):
|
|
|
|
```bash
|
|
./python/.venv/bin/python examples/python/runtimes/microsandbox/microsandbox_fuse.py
|
|
```
|
|
|
|
Expected tail:
|
|
|
|
```
|
|
=== guest output ===
|
|
--- os.listdir('/s3') ---
|
|
data
|
|
...
|
|
--- read /s3/data/example.jsonl through virtio-fs -> FUSE -> Mirage -> S3 ---
|
|
5766 lines, 5678 containing 'mirage'
|
|
|
|
Mirage served N ops, ... bytes to the sandbox
|
|
```
|
|
|
|
## Platform note: Linux only
|
|
|
|
This example runs on **Linux**. On **macOS it does not work**: libkrun's virtio-fs
|
|
cannot re-export a macFUSE-backed directory into the microVM. Booting the VM
|
|
fails at the bind-mount with:
|
|
|
|
```
|
|
failed to start "mirage-fuse": mount s3_<hash>: Operation not permitted (os error 1)
|
|
```
|
|
|
|
This is a libkrun + macFUSE interaction, not a Mirage or Microsandbox bug:
|
|
|
|
- It reproduces with both S3-backed and RAM-backed FUSE mounts (the trigger is the
|
|
macFUSE filesystem type, not the backend).
|
|
- A plain (non-FUSE) host directory bind-mounts and reads fine inside the same
|
|
microVM, so virtio-fs itself works on macOS.
|
|
- Mounting the FUSE filesystem with `allow_other` does not help; the failure is
|
|
`EPERM` (not `EACCES`), from a macOS-specific VFS operation libkrun's host-side
|
|
virtio-fs server issues during share setup that macFUSE rejects.
|
|
|
|
On macOS, use the sibling [`wasmer`](../wasmer/README.md) example instead: it maps
|
|
the same host FUSE mount into a WASIX guest with `--mapdir` and works on macOS.
|
|
|
|
Not run in CI. It needs the Microsandbox runtime, host FUSE, and live AWS
|
|
credentials.
|