fetch_ml/internal/worker
Jeremie Fraeys 0b5e99f720
refactor(scheduler,worker): improve service management and GPU detection
Scheduler enhancements:
- auth.go: Group membership validation in authentication
- hub.go: Task distribution with group affinity
- port_allocator.go: Dynamic port allocation with conflict resolution
- scheduler_conn.go: Connection pooling and retry logic
- service_manager.go: Lifecycle management for scheduler services
- service_templates.go: Template-based service configuration
- state.go: Persistent state management with recovery

Worker improvements:
- config.go: Extended configuration for task visibility rules
- execution/setup.go: Sandboxed execution environment setup
- executor/container.go: Container runtime integration
- executor/runner.go: Task runner with visibility enforcement
- gpu_detector.go: Robust GPU detection (NVIDIA, AMD, Apple Silicon, CPU fallback)
- integrity/validate.go: Data integrity validation
- lifecycle/runloop.go: Improved runloop with graceful shutdown
- lifecycle/service_manager.go: Service lifecycle coordination
- process/isolation.go + isolation_unix.go: Process isolation with namespaces/cgroups
- tenant/manager.go: Multi-tenant resource isolation
- tenant/middleware.go: Tenant context propagation
- worker.go: Core worker with group-scoped task execution
2026-03-08 13:03:15 -04:00
..
errors feat(worker): integrate scheduler endpoints and security hardening 2026-02-26 12:06:16 -05:00
execution refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
executor refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
integrity refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
interfaces feat(worker): integrate scheduler endpoints and security hardening 2026-02-26 12:06:16 -05:00
lifecycle refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
plugins feat(worker): add Jupyter/vLLM plugins and process isolation 2026-02-26 12:03:59 -05:00
process refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
tenant refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
artifacts.go feat(worker): integrate scheduler endpoints and security hardening 2026-02-26 12:06:16 -05:00
config.go refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
factory.go feat(worker): integrate scheduler endpoints and security hardening 2026-02-26 12:06:16 -05:00
gpu_detector.go refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00
gpu_macos.go feat(worker): integrate scheduler endpoints and security hardening 2026-02-26 12:06:16 -05:00
gpu_macos_stub.go feat: native GPU detection and NVML bridge for macOS and Linux 2026-02-21 17:59:59 -05:00
gpu_nvml_native.go feat: native GPU detection and NVML bridge for macOS and Linux 2026-02-21 17:59:59 -05:00
gpu_nvml_stub.go feat(worker): integrate scheduler endpoints and security hardening 2026-02-26 12:06:16 -05:00
native_bridge.go refactor(worker): update worker tests and native bridge 2026-02-23 18:04:22 -05:00
native_bridge_libs.go feat(security): Artifact ingestion caps enforcement 2026-02-23 19:43:28 -05:00
native_bridge_nocgo.go refactor(worker): update worker tests and native bridge 2026-02-23 18:04:22 -05:00
snapshot_store.go refactor(worker): update worker tests and native bridge 2026-02-23 18:04:22 -05:00
worker.go refactor(scheduler,worker): improve service management and GPU detection 2026-03-08 13:03:15 -04:00