Files
Atomizer/optimization_engine/plugins/pre_solve/optimization_logger.py
Anto01 0a7cca9c6a feat: Complete Phase 2.5-2.7 - Intelligent LLM-Powered Workflow Analysis
This commit implements three major architectural improvements to transform
Atomizer from static pattern matching to intelligent AI-powered analysis.

## Phase 2.5: Intelligent Codebase-Aware Gap Detection 

Created intelligent system that understands existing capabilities before
requesting examples:

**New Files:**
- optimization_engine/codebase_analyzer.py (379 lines)
  Scans Atomizer codebase for existing FEA/CAE capabilities

- optimization_engine/workflow_decomposer.py (507 lines, v0.2.0)
  Breaks user requests into atomic workflow steps
  Complete rewrite with multi-objective, constraints, subcase targeting

- optimization_engine/capability_matcher.py (312 lines)
  Matches workflow steps to existing code implementations

- optimization_engine/targeted_research_planner.py (259 lines)
  Creates focused research plans for only missing capabilities

**Results:**
- 80-90% coverage on complex optimization requests
- 87-93% confidence in capability matching
- Fixed expression reading misclassification (geometry vs result_extraction)

## Phase 2.6: Intelligent Step Classification 

Distinguishes engineering features from simple math operations:

**New Files:**
- optimization_engine/step_classifier.py (335 lines)

**Classification Types:**
1. Engineering Features - Complex FEA/CAE needing research
2. Inline Calculations - Simple math to auto-generate
3. Post-Processing Hooks - Middleware between FEA steps

## Phase 2.7: LLM-Powered Workflow Intelligence 

Replaces static regex patterns with Claude AI analysis:

**New Files:**
- optimization_engine/llm_workflow_analyzer.py (395 lines)
  Uses Claude API for intelligent request analysis
  Supports both Claude Code (dev) and API (production) modes

- .claude/skills/analyze-workflow.md
  Skill template for LLM workflow analysis integration

**Key Breakthrough:**
- Detects ALL intermediate steps (avg, min, normalization, etc.)
- Understands engineering context (CBUSH vs CBAR, directions, metrics)
- Distinguishes OP2 extraction from part expression reading
- Expected 95%+ accuracy with full nuance detection

## Test Coverage

**New Test Files:**
- tests/test_phase_2_5_intelligent_gap_detection.py (335 lines)
- tests/test_complex_multiobj_request.py (130 lines)
- tests/test_cbush_optimization.py (130 lines)
- tests/test_cbar_genetic_algorithm.py (150 lines)
- tests/test_step_classifier.py (140 lines)
- tests/test_llm_complex_request.py (387 lines)

All tests include:
- UTF-8 encoding for Windows console
- atomizer environment (not test_env)
- Comprehensive validation checks

## Documentation

**New Documentation:**
- docs/PHASE_2_5_INTELLIGENT_GAP_DETECTION.md (254 lines)
- docs/PHASE_2_7_LLM_INTEGRATION.md (227 lines)
- docs/SESSION_SUMMARY_PHASE_2_5_TO_2_7.md (252 lines)

**Updated:**
- README.md - Added Phase 2.5-2.7 completion status
- DEVELOPMENT_ROADMAP.md - Updated phase progress

## Critical Fixes

1. **Expression Reading Misclassification** (lines cited in session summary)
   - Updated codebase_analyzer.py pattern detection
   - Fixed workflow_decomposer.py domain classification
   - Added capability_matcher.py read_expression mapping

2. **Environment Standardization**
   - All code now uses 'atomizer' conda environment
   - Removed test_env references throughout

3. **Multi-Objective Support**
   - WorkflowDecomposer v0.2.0 handles multiple objectives
   - Constraint extraction and validation
   - Subcase and direction targeting

## Architecture Evolution

**Before (Static & Dumb):**
User Request → Regex Patterns → Hardcoded Rules → Missed Steps 

**After (LLM-Powered & Intelligent):**
User Request → Claude AI Analysis → Structured JSON →
├─ Engineering (research needed)
├─ Inline (auto-generate Python)
├─ Hooks (middleware scripts)
└─ Optimization (config) 

## LLM Integration Strategy

**Development Mode (Current):**
- Use Claude Code directly for interactive analysis
- No API consumption or costs
- Perfect for iterative development

**Production Mode (Future):**
- Optional Anthropic API integration
- Falls back to heuristics if no API key
- For standalone batch processing

## Next Steps

- Phase 2.8: Inline Code Generation
- Phase 2.9: Post-Processing Hook Generation
- Phase 3: MCP Integration for automated documentation research

🚀 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-16 13:35:41 -05:00

130 lines
4.5 KiB
Python

"""
Optimization-Level Logger Hook
Creates a high-level optimization log file that tracks the overall progress
across all trials. This complements the detailed per-trial logs.
Hook Point: pre_solve
"""
from pathlib import Path
from datetime import datetime
from typing import Dict, Any, Optional
import logging
logger = logging.getLogger(__name__)
def log_optimization_progress(context: Dict[str, Any]) -> Optional[Dict[str, Any]]:
"""
Log high-level optimization progress to optimization.log.
This hook creates/appends to a main optimization log file that shows:
- Trial start with design variables
- High-level progress tracking
- Easy-to-scan overview of the optimization run
Args:
context: Hook context containing:
- trial_number: Current trial number
- design_variables: Dict of variable values
- sim_file: Path to simulation file
- config: Full optimization configuration
Returns:
None (logging only)
"""
trial_num = context.get('trial_number', '?')
design_vars = context.get('design_variables', {})
sim_file = context.get('sim_file', 'unknown')
config = context.get('config', {})
# Get the output directory from context (passed by runner)
output_dir = Path(context.get('output_dir', 'optimization_results'))
# Main optimization log file
log_file = output_dir / 'optimization.log'
# Create header on first trial
if trial_num == 0:
output_dir.mkdir(parents=True, exist_ok=True)
with open(log_file, 'w') as f:
f.write("=" * 100 + "\n")
f.write(f"OPTIMIZATION RUN - Started {datetime.now().strftime('%Y-%m-%d %H:%M:%S')}\n")
f.write("=" * 100 + "\n")
f.write(f"Simulation File: {sim_file}\n")
f.write(f"Output Directory: {output_dir}\n")
# Optimization settings
opt_settings = config.get('optimization_settings', {})
f.write(f"\nOptimization Settings:\n")
f.write(f" Total Trials: {opt_settings.get('n_trials', 'unknown')}\n")
f.write(f" Sampler: {opt_settings.get('sampler', 'unknown')}\n")
f.write(f" Startup Trials: {opt_settings.get('n_startup_trials', 'unknown')}\n")
# Design variables
design_vars_config = config.get('design_variables', [])
f.write(f"\nDesign Variables:\n")
for dv in design_vars_config:
name = dv.get('name', 'unknown')
bounds = dv.get('bounds', [])
units = dv.get('units', '')
f.write(f" {name}: {bounds[0]:.2f} - {bounds[1]:.2f} {units}\n")
# Objectives
objectives = config.get('objectives', [])
f.write(f"\nObjectives:\n")
for obj in objectives:
name = obj.get('name', 'unknown')
direction = obj.get('direction', 'unknown')
units = obj.get('units', '')
f.write(f" {name} ({direction}) [{units}]\n")
# Constraints
constraints = config.get('constraints', [])
if constraints:
f.write(f"\nConstraints:\n")
for cons in constraints:
name = cons.get('name', 'unknown')
cons_type = cons.get('type', 'unknown')
limit = cons.get('limit', 'unknown')
units = cons.get('units', '')
f.write(f" {name}: {cons_type} {limit} {units}\n")
f.write("\n" + "=" * 100 + "\n")
f.write("TRIAL PROGRESS\n")
f.write("=" * 100 + "\n\n")
# Append trial start
with open(log_file, 'a') as f:
timestamp = datetime.now().strftime('%H:%M:%S')
f.write(f"[{timestamp}] Trial {trial_num:3d} START | ")
# Write design variables in compact format
dv_str = ", ".join([f"{name}={value:.3f}" for name, value in design_vars.items()])
f.write(f"{dv_str}\n")
return None
def register_hooks(hook_manager):
"""
Register this plugin's hooks with the manager.
This function is called automatically when the plugin is loaded.
"""
hook_manager.register_hook(
hook_point='pre_solve',
function=log_optimization_progress,
description='Create high-level optimization.log file',
name='optimization_logger',
priority=100 # Run early to set up log file
)
# Hook metadata
HOOK_NAME = "optimization_logger"
HOOK_POINT = "pre_solve"
ENABLED = True
PRIORITY = 100 # Run early to set up log file