fetch_ml

Author	SHA1	Message	Date
Jeremie Fraeys	57787e1e7b	feat(scheduler): implement capability-based routing and hub v2 Add comprehensive capability routing system to scheduler hub: - Capability-aware worker matching with requirement/offer negotiation - Hub v2 protocol with structured message types and heartbeat management - Worker capability advertisement and dynamic routing decisions - Orphan recovery for disconnected workers with state reconciliation - Template-based job scheduling with capability constraints Add extensive test coverage: - Unit tests for capability routing logic and heartbeat mechanics - Unit tests for orphan recovery scenarios - E2E tests for capability routing across multiple workers - Hub capabilities integration tests - Scheduler fixture helpers for test setup Protocol improvements: - Define structured protocol messages for hub-worker communication - Add capability matching algorithm with scoring - Implement graceful worker disconnection handling	2026-03-12 12:00:05 -04:00
Jeremie Fraeys	c74e91dd69	test: update test suite and remove deprecated privacy middleware Test improvements: - fixtures/: Updated mocks, fixtures with group context, SSH server, TUI driver - integration/: WebSocket queue and handler tests with groups - e2e/: WebSocket and TLS proxy end-to-end tests - unit/api/ws_test.go: WebSocket API tests - unit/scheduler/service_templates_test.go: Service template tests - benchmarks/scheduler_bench_test.go: Performance benchmarks Cleanup: - Remove privacy middleware (replaced by audit system) - Remove privacy_test.go	2026-03-08 13:03:55 -04:00
Jeremie Fraeys	da104367d6	feat: add Plugin GPU Quota implementation and tests Some checks failed Build Pipeline / Build Binaries (push) Failing after 1m59s Details Build Pipeline / Build Docker Images (push) Has been skipped Details Build Pipeline / Sign HIPAA Config (push) Has been skipped Details Build Pipeline / Generate SLSA Provenance (push) Has been skipped Details Checkout test / test (push) Successful in 5s Details CI Pipeline / Test (ubuntu-latest on self-hosted) (push) Failing after 1s Details CI Pipeline / Dev Compose Smoke Test (push) Has been skipped Details CI Pipeline / Security Scan (push) Has been skipped Details CI Pipeline / Test Scripts (push) Has been skipped Details CI Pipeline / Test Native Libraries (push) Has been skipped Details CI Pipeline / Native Library Build Matrix (push) Has been skipped Details Documentation / build-and-publish (push) Failing after 35s Details CI Pipeline / Trigger Build Workflow (push) Failing after 0s Details Security Scan / Security Analysis (push) Has been cancelled Details Security Scan / Native Library Security (push) Has been cancelled Details Verification & Maintenance / V.1 - Schema Drift Detection (push) Has been cancelled Details Verification & Maintenance / V.4 - Custom Go Vet Analyzers (push) Has been cancelled Details Verification & Maintenance / V.7 - Audit Chain Integrity (push) Has been cancelled Details Verification & Maintenance / V.6 - Extended Security Scanning (push) Has been cancelled Details Verification & Maintenance / V.10 - OpenSSF Scorecard (push) Has been cancelled Details Verification & Maintenance / Verification Summary (push) Has been cancelled Details - Add plugin_quota.go with GPU quota management for scheduler - Update scheduler hub and protocol for plugin support - Add comprehensive plugin quota unit tests - Update gang service and WebSocket queue integration tests	2026-02-26 14:35:05 -05:00
Jeremie Fraeys	43e6446587	feat(scheduler): implement multi-tenant job scheduler with gang scheduling Add new scheduler component for distributed ML workload orchestration: - Hub-based coordination for multi-worker clusters - Pacing controller for rate limiting job submissions - Priority queue with preemption support - Port allocator for dynamic service discovery - Protocol handlers for worker-scheduler communication - Service manager with OS-specific implementations - Connection management and state persistence - Template system for service deployment Includes comprehensive test suite: - Unit tests for all core components - Integration tests for distributed scenarios - Benchmark tests for performance validation - Mock fixtures for isolated testing Refs: scheduler-architecture.md	2026-02-26 12:03:23 -05:00

4 commits