fetch_ml/internal/worker
Jeremie Fraeys 8271277dc3
feat: implement research-grade maintainability phases 2, 5, 8, 10
Phase 2: Deterministic Manifests
- Add manifest.Validator with required field checking
- Support Validate() and ValidateStrict() modes
- Integrate validation into worker executor before execution
- Block execution if manifest missing commit_id or deps_manifest_sha256

Phase 5: Pinned Dependencies
- Add hermetic.dockerfile template with pinned system deps
- Frozen package versions: libblas3, libcudnn8, etc.
- Support for deps_manifest.json and requirements.txt with hashes
- Image tagging strategy: deps-<first-8-of-sha256>

Phase 8: Tests as Specifications
- Add queue_spec_test.go with executable scheduler specs
- Document priority ordering (higher first)
- Document FIFO tiebreaker for same priority
- Test cases for negative/zero priorities

Phase 10: Local Dev Parity
- Create root-level docker-compose.dev.yml
- Simplified from deployments/ for quick local dev
- Redis + API server + Worker with hot reload volumes
- Debug ports: 9101 (API), 6379 (Redis)
2026-02-18 15:34:28 -05:00
..
execution refactor: Phase 7 - TUI cleanup - reorganize model package 2026-02-17 20:22:04 -05:00
executor feat: implement research-grade maintainability phases 2, 5, 8, 10 2026-02-18 15:34:28 -05:00
integrity refactor: Phase 7 - TUI cleanup - reorganize model package 2026-02-17 20:22:04 -05:00
interfaces refactor: Phase 1 - Extract worker interfaces 2026-02-17 14:10:03 -05:00
lifecycle refactor: Implement TaskExecutorAdapter and Worker.runningCount() 2026-02-17 16:15:41 -05:00
artifacts.go perf: add profiling benchmarks and parallel Go baseline for C++ optimization 2026-02-12 12:04:02 -05:00
config.go refactor: replace panic with error returns and update maintenance 2026-02-18 14:44:21 -05:00
factory.go refactor(phase7): Initialize JobRunner in factory.go 2026-02-17 16:40:03 -05:00
gpu_detector.go feat(worker): add integrity checks, snapshot staging, and prewarm support 2026-01-05 12:31:13 -05:00
hash_selector.go feat: Implement all worker stub methods with real functionality 2026-02-17 17:37:56 -05:00
native_bridge.go feat: implement C++ native libraries for performance-critical operations 2026-02-16 20:38:04 -05:00
native_bridge_libs.go refactor(internal): update native bridge and queue integration 2026-02-18 12:45:59 -05:00
native_bridge_nocgo.go feat: add native library bridge and queue integration 2026-02-16 20:38:30 -05:00
snapshot_store.go refactor: Phase 6 - Complete migration, remove legacy files 2026-02-17 14:39:48 -05:00
testutil.go refactor: Phase 7 - TUI cleanup - reorganize model package 2026-02-17 20:22:04 -05:00
worker.go chore: remove unused runningCount method from worker 2026-02-17 20:43:16 -05:00