19 KiB
Atomizer Project Standard — Audit Report
Auditor: Auditor 🔍
Date: 2026-02-19
Spec Version: 1.0 (2026-02-18)
Audit Scope: Practicality for solo FEA consultant (Antoine)
EXECUTIVE SUMMARY
The specification is well-researched and comprehensive but over-engineered for a solo consultant. It proposes 13 top-level files, 5-branch KB architecture, and a 9-step instantiation protocol — this is enterprise-grade standardization for a one-person engineering practice.
Key finding: The spec proposes structures that don't exist in actual Atomizer projects today (M1 Mirror, Hydrotech Beam). It's aspirational, not grounded in current practice.
Recommendation: Adopt a Minimum Viable Standard (MVS) — keep what works from Hydrotech Beam's emerging structure, discard academic overhead, focus on what Antoine will actually maintain.
1. ESSENTIAL — What Antoine NEEDS
These parts deliver real value for a solo consultant:
✅ Self-Contained Project Folders (P1)
Why essential: Opening projects/hydrotech-beam/ gives you 100% context. No hunting across repos, Notion, email. This is critical for resuming work after 2 weeks.
Spec coverage: ✅ Excellent
Keep as-is.
✅ Single Entry Point (README.md or PROJECT.md)
Why essential: Orient yourself (or an AI agent) in <2 minutes. What is this? What's the status? Where do I look?
Spec coverage: ✅ Good, but split across 3 files (PROJECT.md + AGENT.md + STATUS.md)
Recommendation: Merge into ONE file — README.md (proven pattern from Hydrotech Beam).
✅ Study Organization (studies/ with numbering)
Why essential: Track optimization campaign evolution. "Study 03 refined bounds from Study 02 because..."
Spec coverage: ✅ Excellent (numbered studies 01_, 02_)
Already in use: Hydrotech Beam has 01_doe_landscape/
Keep as-is.
✅ Models Baseline (golden copies)
Why essential: Golden reference models. Never edit these — copy for studies.
Spec coverage: ✅ Good (01-models/)
Already in use: Hydrotech has models/
Recommendation: Drop numbering → just models/
✅ Knowledge Base (simplified)
Why essential: Capture design rationale, model quirks, lessons learned. Memory across studies.
Spec coverage: ⚠️ Over-engineered (5 branches: Design/Analysis/Manufacturing/Domain/Introspection)
Already in use: Hydrotech has kb/ with components/, materials/, fea/, dev/
Recommendation: Keep Hydrotech's simpler 4-folder structure.
✅ Decision Log (DECISIONS.md)
Why essential: "Why did we choose X over Y?" Prevents re-litigating past decisions.
Spec coverage: ⚠️ Over-engineered (IBIS format: Context, Options, Decision, Consequences, References)
Already in use: Hydrotech has simpler format (Date, By, Decision, Rationale, Status)
Recommendation: Keep Hydrotech's simpler format.
✅ Results Tracking
Why essential: Reproducibility, debugging, client reporting.
Spec coverage: ✅ Good (3_results/study.db, iteration_history.csv)
Already in use: Hydrotech has this
Keep as-is.
2. CUT/SIMPLIFY — What's Over-Engineered
These parts add complexity without proportional value for a solo consultant:
❌ AGENT.md (separate from PROJECT.md)
Why unnecessary: Solo consultant = you already know the project quirks. LLM bootstrapping can live in README.md "## For AI Agents" section.
Spec says: Separate file for AI operational manual
Reality: Hydrotech Beam has README.md + USER_GUIDE.md — no AGENT.md
Cut it. Merge LLM instructions into README.md if needed.
❌ STATUS.md (separate dashboard)
Why unnecessary: For a solo consultant, status lives in your head or a quick README update. A separate file becomes stale immediately.
Spec says: "Update on any state change"
Reality: Who enforces this? It's just you.
Cut it. Put current status in README.md header.
❌ CHANGELOG.md (separate from DECISIONS.md)
Why unnecessary: DECISIONS.md already tracks major project events. CHANGELOG duplicates this.
Spec says: "Project evolution timeline"
Reality: Git log + DECISIONS.md already provide this
Cut it.
❌ Numbered Top-Level Folders (00-, 01-, 02-)
Why unnecessary: Creates cognitive overhead. "Is it 02-kb/ or kb/?" Alphabetical sorting is fine for 6-8 folders.
Spec says: "Enforces canonical reading order"
Reality: Hydrotech Beam uses kb/, models/, studies/ (no numbers) — works fine
Drop the numbering. Use simple names: context/, models/, kb/, studies/, reports/, tools/
❌ 5-Branch KB Architecture
Why over-engineered: Design/Analysis/Manufacturing/Domain/Introspection is enterprise-scale. Solo consultant needs components/, fea/, materials/.
Spec proposes:
02-kb/
├── design/
│ ├── architecture/, components/, materials/, dev/
├── analysis/
│ ├── models/, mesh/, connections/, boundary-conditions/, loads/, solver/, validation/
├── manufacturing/
├── domain/
└── introspection/
Hydrotech Beam reality:
kb/
├── components/
├── materials/
├── fea/
│ └── models/
└── dev/
Recommendation: Keep Hydrotech's 4-folder structure. If manufacturing/domain knowledge is needed, add it as kb/manufacturing.md (single file, not folder).
❌ 00-context/ Folder (4 separate files)
Why over-engineered: mandate.md, requirements.md, scope.md, stakeholders.md — for a solo consultant, this lives in one CONTEXT.md file.
Spec says: "Each grows independently"
Reality: Hydrotech has single CONTEXT.md — works fine
Keep as single file: CONTEXT.md
❌ stakeholders.md
Why unnecessary: Solo consultant knows who the client is. If needed, it's 2 lines in CONTEXT.md.
Cut it.
❌ playbooks/ (optional, not essential)
Why low-priority: Nice-to-have for complex procedures, but not essential. Hydrotech has it (DOE.md, NX_REAL_RUN.md) but it's operational docs, not core structure.
Recommendation: Optional — include only if procedures are complex and reused.
❌ .atomizer/ Folder (machine metadata)
Why premature: This is for future Atomizer CLI tooling that doesn't exist yet. Don't create files for non-existent features.
Spec says: project.json, template-version.json, hooks.json
Reality: Atomizer has no CLI that reads these yet
Cut it. Add when tooling exists.
❌ 9-Step Template Instantiation Protocol
Why unrealistic: Solo consultant won't follow a formal 9-step checklist (CREATE → INTAKE → IMPORT → INTROSPECT → INTERVIEW → CONFIGURE → GENERATE → VALIDATE).
Spec says: "Step 5: INTERVIEW — Agent prompts user with structured questions"
Reality: Antoine will create project folder, dump model files in, start working
Simplify: 3 steps: Create folder, import model, run first study.
❌ IBIS-Inspired Decision Format
Why too formal: Context, Options Considered, Decision, Consequences, References — this is academic design rationale capture.
Spec format:
### Context
{What situation prompted this?}
### Options Considered
1. Option A — pros/cons
2. Option B — pros/cons
### Decision
{What was chosen and WHY}
### Consequences
{Impact going forward}
### References
{Links}
Hydrotech reality:
- **Date:** 2026-02-08
- **By:** Technical Lead
- **Decision:** Minimize mass as sole objective
- **Rationale:** Mass is Antoine's priority
- **Status:** Approved
Keep Hydrotech's simpler format.
❌ Session Captures (gen-NNN.md)
Why conditional: Only needed if using CAD-Documenter workflow (transcript + screenshots → KB processing). Not every project needs this.
Recommendation: Optional — include in template but don't mandate.
3. IMPROVE — What Could Be Better
📈 More Fluid Study Lifecycle (not 7 rigid stages)
Issue: The spec proposes PLAN → CONFIGURE → VALIDATE → RUN → ANALYZE → REPORT → FEED-BACK as sequential stages.
Reality: Solo consultant work is iterative. You configure while planning, run while validating, analyze while running.
Improvement: Simplify to 3 phases:
- Setup (hypothesis, config, preflight)
- Execute (run trials, monitor)
- Review (analyze, document, feed back to KB)
📈 Single README.md as Master Entry
Issue: Spec splits PROJECT.md (overview) + AGENT.md (LLM ops) + STATUS.md (dashboard).
Reality: Hydrotech Beam has README.md + USER_GUIDE.md — simpler, less fragmented.
Improvement:
- README.md — project overview, status, navigation, quick facts
- Optional: USER_GUIDE.md for detailed operational notes (if needed)
📈 Make Decision Log Encouraged, Not Mandatory
Issue: Spec assumes DECISIONS.md is always maintained. Reality: solo consultant may skip this on small projects.
Improvement: Include in template but mark as "Recommended for multi-study projects."
📈 Simplify Folder Structure Visual
Issue: The spec's canonical structure is 60+ lines, intimidating.
Improvement:
project-name/
├── README.md # Master entry point
├── CONTEXT.md # Requirements, scope, stakeholders
├── DECISIONS.md # Decision log (optional but recommended)
├── models/ # Golden copies of CAD/FEM
├── kb/ # Knowledge base
│ ├── _index.md
│ ├── components/
│ ├── materials/
│ ├── fea/
│ └── dev/
├── studies/ # Optimization campaigns
│ ├── 01_doe_landscape/
│ └── 02_tpe_refinement/
├── reports/ # Client deliverables
├── images/ # Screenshots, plots
└── tools/ # Project-specific scripts (optional)
This is ~8 top-level items vs. spec's 13-15.
📈 Focus on What Antoine Already Does Well
Observation: Hydrotech Beam already has:
- CONTEXT.md (intake data)
- BREAKDOWN.md (technical analysis)
- DECISIONS.md (decision log)
- kb/ (knowledge base with generations)
- Numbered studies (01_)
- playbooks/ (operational docs)
Improvement: The standard should codify what's working rather than impose new structures.
4. MISSING — What's Absent
➕ Client Communication Log
Gap: No place to track client emails, meeting notes, change requests.
Suggestion: Add COMMUNICATIONS.md or comms/ folder for client interaction history.
➕ Time Tracking
Gap: Solo consultant bills by the hour — no time tracking mechanism.
Suggestion: Add HOURS.md or integrate with existing time-tracking tool.
➕ Quick Wins Checklist
Gap: No "getting started" checklist for new projects.
Suggestion: Add CHECKLIST.md with initial setup tasks:
- Import baseline model
- Run baseline solve
- Extract baseline metrics
- Document key expressions
- Set up first study
➕ Design Alternatives Matrix
Gap: No simple way to track "Option A vs. Option B" before committing to a design direction.
Suggestion: Add ALTERNATIVES.md (simpler than full DECISIONS.md) for early-stage design exploration.
➕ Integration with Existing Tools
Gap: Spec doesn't mention CAD-Documenter, KB skills, or existing workflows.
Suggestion: Add section "Integration with Atomizer Workflows" showing how project structure connects to:
- CAD-Documenter (session capture →
kb/dev/) - KB skills (processing, extraction)
- Optimization engine (where to point
--project-root)
5. ALIGNMENT WITH ATOMIZER PROJECTS
M1 Mirror (Legacy Structure)
Current: Flat, unnumbered studies (m1_mirror_adaptive_V11, m1_mirror_cost_reduction_V10, etc.). Knowledge scattered in README.md. No decision log.
Spec alignment: ❌ Poor — M1 Mirror doesn't follow ANY of the spec's structure.
Migration effort: High — would require numbering 20+ studies, creating KB, extracting decisions from notes.
Recommendation: Leave M1 Mirror as-is (completed project). Use spec for NEW projects only.
Hydrotech Beam (Emerging Structure)
Current: README.md, CONTEXT.md, BREAKDOWN.md, DECISIONS.md, kb/, models/, studies/ (numbered!), playbooks/.
Spec alignment: ⚠️ Partial — Hydrotech has SIMPLER versions of most spec elements.
What matches:
- ✅ Numbered studies (01_doe_landscape)
- ✅ KB folder (simplified structure)
- ✅ DECISIONS.md (simpler format)
- ✅ models/ (golden copies)
- ✅ playbooks/
What's missing from spec:
- ❌ No PROJECT.md/AGENT.md split (has README.md instead)
- ❌ No numbered top-level folders
- ❌ No 5-branch KB (has 4-folder KB)
- ❌ No .atomizer/ metadata
Recommendation: The spec should MATCH Hydrotech's structure, not replace it.
6. KEY QUESTIONS ANSWERED
Q: Is the 7-stage study lifecycle practical for a solo consultant?
A: ❌ No. Too rigid. Real work is: setup → run → analyze. Not 7 sequential gates.
Recommendation: 3-phase lifecycle: Setup, Execute, Review.
Q: Are numbered folders (00-context/, 01-models/, etc.) better than simple names?
A: ❌ No. Adds cognitive overhead without clear benefit. Hydrotech uses kb/, models/, studies/ — works fine.
Recommendation: Drop numbering on top-level folders. Keep numbering ONLY for studies (01_, 02_).
Q: Is the KB architecture (5 branches) too complex for one person?
A: ✅ Yes. Design/Analysis/Manufacturing/Domain/Introspection is enterprise-scale.
Recommendation: Use Hydrotech's 4-folder KB: components/, materials/, fea/, dev/.
Q: Is DECISIONS.md with IBIS format realistic to maintain?
A: ⚠️ IBIS format is too formal. Hydrotech's simpler format (Date, By, Decision, Rationale, Status) is realistic.
Recommendation: Use Hydrotech's format. Make DECISIONS.md optional for small projects.
Q: What's the minimum viable version of this spec?
A: See Section 7 below.
7. MINIMUM VIABLE STANDARD (MVS)
Here's the practical, solo-consultant-friendly version:
project-name/
│
├── README.md # Master entry: overview, status, navigation
├── CONTEXT.md # Intake: client, requirements, scope
├── DECISIONS.md # Decision log (optional, recommended for multi-study)
│
├── models/ # Golden copies — never edit directly
│ ├── README.md # Model versions, how to open
│ └── baseline/ # Baseline solve results
│
├── kb/ # Knowledge base
│ ├── _index.md # KB overview + gap tracker
│ ├── components/ # One file per component
│ ├── materials/ # Material data
│ ├── fea/ # FEA model docs
│ │ └── models/
│ └── dev/ # Session captures (optional)
│
├── studies/ # Numbered optimization campaigns
│ ├── 01_doe_landscape/
│ │ ├── README.md # Hypothesis, config, conclusions
│ │ ├── atomizer_spec.json
│ │ ├── 1_setup/
│ │ └── 3_results/
│ └── 02_tpe_refinement/
│
├── reports/ # Client deliverables
├── images/ # Screenshots, plots, renders
└── tools/ # Custom scripts (optional)
Top-level files: 3 (README, CONTEXT, DECISIONS)
Top-level folders: 6 (models, kb, studies, reports, images, tools)
Total: 9 items vs. spec's 13-15
What's different from the spec:
- ❌ No PROJECT.md/AGENT.md/STATUS.md split → single README.md
- ❌ No numbered folders (00-, 01-, 02-) → simple names
- ❌ No 5-branch KB → 4-folder KB (proven pattern)
- ❌ No 00-context/ folder → single CONTEXT.md
- ❌ No CHANGELOG.md → Git log + DECISIONS.md
- ❌ No .atomizer/ metadata → add when tooling exists
- ❌ No stakeholders.md → lives in CONTEXT.md
- ✅ Keep numbered studies (01_, 02_)
- ✅ Keep DECISIONS.md (simpler format)
- ✅ Keep KB structure (Hydrotech pattern)
8. RISKS & ASSUMPTIONS
Risks
- Spec is aspirational, not validated — proposed structures don't exist in real projects yet
- Maintenance burden — 13 files to keep updated vs. 3-4 for MVS
- Template complexity — 9-step instantiation too formal for solo work
- Over-standardization — solo consultant needs flexibility, not enterprise rigor
Assumptions
- Antoine will NOT follow formal 9-step instantiation protocol
- Antoine will NOT maintain separate STATUS.md (goes stale immediately)
- Antoine WILL maintain DECISIONS.md if format is simple (Hydrotech proof)
- Antoine WILL use numbered studies (already in Hydrotech)
- Multi-file KB branches (Design/Analysis/etc.) are overkill for 1-5 component projects
9. RECOMMENDATIONS
For Immediate Action
- ✅ Adopt MVS — Use Hydrotech Beam's structure as the template (it's already working)
- ✅ Codify existing practice — Spec should document what Antoine ALREADY does, not impose new patterns
- ✅ Simplify entry point — Single README.md, not 3 files (PROJECT + AGENT + STATUS)
- ✅ Drop numbered top-level folders — Use simple names (models/, kb/, studies/)
- ✅ Keep simple KB — 4 folders (components/, materials/, fea/, dev/), not 5 branches
- ✅ Keep simple DECISIONS.md — Hydrotech format (Date, By, Decision, Rationale, Status)
For Future Consideration
- ⏳ Add
COMMUNICATIONS.mdfor client interaction log - ⏳ Add
HOURS.mdfor time tracking - ⏳ Add
.atomizer/metadata when CLI tooling exists - ⏳ Add playbooks/ only for complex projects
- ⏳ Add BREAKDOWN.md (Hydrotech has this — spec missed it!)
For Long-Term Evolution
- 🔮 If Atomizer grows to 3-5 engineers → revisit enterprise features (5-branch KB, formal lifecycle)
- 🔮 If project complexity increases (10+ studies) → revisit numbered top-level folders
- 🔮 If client deliverables become complex → revisit report generation protocol
10. CONFIDENCE & NOTES
Confidence: HIGH
Why:
- ✅ Audited actual Atomizer projects (M1 Mirror, Hydrotech Beam)
- ✅ Compared spec to real practice (spec is aspirational, not grounded)
- ✅ Identified working patterns (Hydrotech's emerging structure)
- ✅ Practical experience: solo consultants don't maintain 13-file templates
Notes:
- The spec author (Manager 🎯) did excellent research (NASA-STD-7009, ASME V&V 10, IBIS/QOC, industry standards) but optimized for enterprise rigor not solo consultant pragmatism
- Hydrotech Beam is already 80% of the way to a good standard — codify THAT, don't replace it
- The spec's fictive validation project (ThermoShield Bracket) is well-designed but proves the structure is complex (13 top-level items)
Follow-ups:
- Present MVS to Antoine for approval
- Update Hydrotech Beam to MVS (minimal changes needed)
- Create lightweight project template based on MVS
- Archive full spec as "Future Enterprise Standard" for if/when Atomizer scales
END OF AUDIT