426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
109 lines
4.7 KiB
TypeScript
109 lines
4.7 KiB
TypeScript
/**
|
|
* E2E provisioning helper (Apps / Product 2) — host-side half of the real
|
|
* container↔isolated-DB verification (see verify-e2e-container-db.sh).
|
|
*
|
|
* Drives the REAL composed stack (makeTenantDbProvisioning -> ClusterPool ->
|
|
* tenantDbClustersRepository -> SqlTenantDbProvisioner -> DirectPgExecutor)
|
|
* against a throwaway tenant Postgres, then prints the two tenants' DSNs as JSON
|
|
* so the bash orchestrator can run real app containers that connect with them.
|
|
*
|
|
* Env:
|
|
* ADMIN_DSN superuser admin DSN the host-side provisioner connects with
|
|
* (host-published, e.g. postgresql://postgres:pw@localhost:55444/postgres?sslmode=disable)
|
|
* CLUSTER_HOST the in-docker-network address the APP CONTAINER uses to reach
|
|
* the same PG (e.g. apps-tenant-pg:5432) — becomes the DSN host
|
|
* DATABASE_URL must equal ADMIN_DSN so the repository's dbWrite hits this PG
|
|
*/
|
|
|
|
import { randomBytes } from "node:crypto";
|
|
import { readFileSync } from "node:fs";
|
|
import { Client } from "pg";
|
|
import { tenantDbClustersRepository } from "../src/db/repositories/tenant-db-clusters";
|
|
import { makeTenantDbProvisioning } from "../src/lib/services/tenant-db/make-tenant-db-provisioning";
|
|
import { deriveTenantIdent } from "../src/lib/services/tenant-db/tenant-db-provisioner";
|
|
|
|
const ADMIN_DSN = process.env.ADMIN_DSN!;
|
|
const CLUSTER_HOST = process.env.CLUSTER_HOST!;
|
|
const APP_A = "aaaaaaaa-aaaa-4aaa-8aaa-aaaaaaaaaaaa";
|
|
const APP_B = "bbbbbbbb-bbbb-4bbb-8bbb-bbbbbbbbbbbb";
|
|
|
|
async function adminExec(sql: string): Promise<void> {
|
|
const c = new Client({ connectionString: ADMIN_DSN });
|
|
await c.connect();
|
|
try {
|
|
await c.query(sql);
|
|
} finally {
|
|
await c.end();
|
|
}
|
|
}
|
|
|
|
// 1. Apply migration 0140 to the throwaway tenant PG (idempotent).
|
|
const migration = readFileSync("./src/db/migrations/0140_tenant_db_clusters.sql", "utf8");
|
|
for (const stmt of migration.split("--> statement-breakpoint")) {
|
|
if (stmt.trim()) await adminExec(stmt.trim());
|
|
}
|
|
await adminExec("DELETE FROM tenant_db_clusters");
|
|
|
|
// 1b. Apply the app_databases schema the real composer writes through.
|
|
//
|
|
// makeTenantDbProvisioning() resolves claimPlacement/clearPlacement to
|
|
// appDatabasesRepository.{claim,clear}TenantDbPlacementForApp, which INSERT /
|
|
// SELECT FOR UPDATE / UPDATE the `app_databases` table (the durable app->cluster
|
|
// placement record). Migration 0140 only creates `tenant_db_clusters`, so without
|
|
// this block provisionForApp crashes with `relation "app_databases" does not exist`.
|
|
//
|
|
// This is the hermetic subset the provisioner needs, mirroring
|
|
// db/schemas/app-databases.ts (and migrations 0019 enum / 0048-0049 create /
|
|
// 0148 legacy-col drops / 0151 tenant-cluster placement). The apps(id) FK is
|
|
// intentionally omitted: this throwaway PG has no `apps` table and the
|
|
// provisioner never reads it. All DDL is idempotent so the script is re-runnable.
|
|
const APP_DATABASES_SCHEMA_DDL = [
|
|
`DO $$ BEGIN
|
|
CREATE TYPE "user_database_status" AS ENUM ('none', 'provisioning', 'ready', 'error');
|
|
EXCEPTION WHEN duplicate_object THEN NULL; END $$`,
|
|
`CREATE TABLE IF NOT EXISTS "app_databases" (
|
|
"id" uuid PRIMARY KEY DEFAULT gen_random_uuid() NOT NULL,
|
|
"app_id" uuid NOT NULL,
|
|
"user_database_uri" text,
|
|
"user_database_region" text DEFAULT 'aws-us-east-1',
|
|
"user_database_status" "user_database_status" DEFAULT 'none' NOT NULL,
|
|
"user_database_error" text,
|
|
"tenant_db_cluster_id" uuid REFERENCES "tenant_db_clusters"("id") ON DELETE SET NULL,
|
|
"created_at" timestamp DEFAULT now() NOT NULL,
|
|
"updated_at" timestamp DEFAULT now() NOT NULL,
|
|
CONSTRAINT "app_databases_app_id_unique" UNIQUE("app_id")
|
|
)`,
|
|
];
|
|
for (const stmt of APP_DATABASES_SCHEMA_DDL) await adminExec(stmt);
|
|
await adminExec("DELETE FROM app_databases");
|
|
|
|
// 2. Seed a cluster whose host is the CONTAINER-reachable address; the admin DSN
|
|
// (host-published) is what DirectPgExecutor connects with to run the DDL.
|
|
await tenantDbClustersRepository.create({
|
|
provider: "direct_pg",
|
|
host: CLUSTER_HOST,
|
|
admin_dsn_encrypted: ADMIN_DSN, // passthrough decrypt below
|
|
max_databases: 100,
|
|
database_count: 0,
|
|
is_active: true,
|
|
});
|
|
|
|
// 3. Provision two tenants through the real composer.
|
|
const provisioning = makeTenantDbProvisioning({
|
|
decrypt: async (x) => x,
|
|
genPassword: () => randomBytes(18).toString("base64url"),
|
|
});
|
|
const a = await provisioning.provisionForApp(APP_A);
|
|
const b = await provisioning.provisionForApp(APP_B);
|
|
|
|
const identA = deriveTenantIdent(APP_A);
|
|
const identB = deriveTenantIdent(APP_B);
|
|
|
|
process.stdout.write(
|
|
`${JSON.stringify({
|
|
a: { dsn: a.dsn, role: identA.roleName, db: identA.dbName },
|
|
b: { dsn: b.dsn, role: identB.roleName, db: identB.dbName },
|
|
})}\n`,
|
|
);
|
|
process.exit(0);
|