fetch_ml/internal/queue
Jeremie Fraeys 8271277dc3
feat: implement research-grade maintainability phases 2, 5, 8, 10
Phase 2: Deterministic Manifests
- Add manifest.Validator with required field checking
- Support Validate() and ValidateStrict() modes
- Integrate validation into worker executor before execution
- Block execution if manifest missing commit_id or deps_manifest_sha256

Phase 5: Pinned Dependencies
- Add hermetic.dockerfile template with pinned system deps
- Frozen package versions: libblas3, libcudnn8, etc.
- Support for deps_manifest.json and requirements.txt with hashes
- Image tagging strategy: deps-<first-8-of-sha256>

Phase 8: Tests as Specifications
- Add queue_spec_test.go with executable scheduler specs
- Document priority ordering (higher first)
- Document FIFO tiebreaker for same priority
- Test cases for negative/zero priorities

Phase 10: Local Dev Parity
- Create root-level docker-compose.dev.yml
- Simplified from deployments/ for quick local dev
- Redis + API server + Worker with hot reload volumes
- Debug ports: 9101 (API), 6379 (Redis)
2026-02-18 15:34:28 -05:00
..
filesystem refactor: Phase 6 - Queue Restructure 2026-02-17 13:41:06 -05:00
redis refactor: Phase 6 - Queue Restructure 2026-02-17 13:41:06 -05:00
sqlite refactor: Phase 6 - Queue Restructure 2026-02-17 13:41:06 -05:00
backend.go feat(core): API, worker, queue, and manifest improvements 2026-02-12 12:05:17 -05:00
errors.go refactor: extract domain types and consolidate error system (Phases 1-2) 2026-02-17 12:34:28 -05:00
event_store.go feat: implement research-grade maintainability phases 1,3,4,7 2026-02-18 15:27:50 -05:00
filesystem_queue.go refactor: extract domain types and consolidate error system (Phases 1-2) 2026-02-17 12:34:28 -05:00
keys.go refactor: Phase 3 - fix config/storage boundaries 2026-02-17 12:49:53 -05:00
metrics.go refactor: extract domain types and consolidate error system (Phases 1-2) 2026-02-17 12:34:28 -05:00
native_queue.go refactor(internal): update native bridge and queue integration 2026-02-18 12:45:59 -05:00
native_queue_stub.go feat: add native library bridge and queue integration 2026-02-16 20:38:30 -05:00
queue.go refactor: Phase 3 - fix config/storage boundaries 2026-02-17 12:49:53 -05:00
queue_spec_test.go feat: implement research-grade maintainability phases 2, 5, 8, 10 2026-02-18 15:34:28 -05:00
sqlite_queue.go refactor: extract domain types and consolidate error system (Phases 1-2) 2026-02-17 12:34:28 -05:00
task.go refactor: Phase 3 - fix config/storage boundaries 2026-02-17 12:49:53 -05:00