Files
engineering/VALIDATION.md

48 lines
3.1 KiB
Markdown

# S19 validation — 2026-11-08
- Bootstrap and project generator: **7 tests passed**. Covers deterministic
regeneration, modified/added/missing files, moved tags, obsolete-file removal,
project-file preservation, symlinks, existing destinations, all three component
selections and actual Maven regeneration with generated/ absent.
- Formatter integration: passed read-only checks, formatting, import cleanup,
UTF-8, idempotence, parser failures and discovery of newly added files.
- Shared CI behavior: **19 tests passed**, including optional components,
configuration precedence, path containment, publication gates, existing-tag
preservation, architecture checks and bounded process execution.
- Shared release behavior: **34 tests passed**, including recovery, ambiguous
outcomes, locking, actual remote shell, digest checks and readiness timeouts.
- Generated recipe-demo: backend verification, standards and coverage, frontend
lint/tests/build and both prebuilt Docker images passed using the common recipe.
- Real isolated deployment test: pushed uniquely named example images to the
internal Gitea registry, prepared digests, deployed two synthetic revisions,
rolled back, and verified both container revision labels. Temporary local
Compose containers were removed. Registry test images remain as evidence.
- Agile Dancers consumer: full pipeline passed with **73 backend tests**,
**32 frontend tests**, **4 browser tests**, **19 standards regression tests**,
both prebuilt images and combined backend coverage **1771/1841 (96.20%)**.
- Agile Dancers standalone Docker source builds: backend and frontend passed.
Backend verification used a disposable PostgreSQL instance and BuildKit secrets;
no production database or deployment was involved.
No production deployment was performed. Live NAS SSH connectivity, production
credentials and production rollback across existing retained releases remain
operational validation limits. Legacy release-state JSON remains compatible;
pre-S19 retained releases use current health/settings as documented in README.md.
## S19 review follow-up — 2026-11-10
- Skills relocated unchanged to landscape/skills/ with upstream revision records,
attribution and licenses. New consumers reference landscape workflows.
- Eight bootstrap/generator tests passed, including actual Maven bootstrap with
generated/ absent, all component selections and the CLI's default mini-pc label.
- Twenty-one CI tests passed, including shared runner scope/identity and preflight
rejection of missing, offline or differently labelled runners.
- Thirty-four release behavior tests passed against the actual remote shell.
- Formatter integration passed; changed Java helpers formatted with the pinned engine.
- User-scoped mini-pc runner registered and online; repository-level API runner
listings exclude inherited user runners, so preflight checks the selected scope
and verifies that the repository owner matches for user scope.
Consumer builds and actual remote workflow results are recorded in the consuming
repositories. No production deployment is part of this follow-up.