Jeremie Fraeys
|
6866ba9366
|
refactor(queue): integrate scheduler backend and storage improvements
Update queue and storage systems for scheduler integration:
- Queue backend with scheduler coordination
- Filesystem queue with batch operations
- Deduplication with tenant-aware keys
- Storage layer with audit logging hooks
- Domain models (Task, Events, Errors) with scheduler fields
- Database layer with tenant isolation
- Dataset storage with integrity checks
|
2026-02-26 12:06:46 -05:00 |
|
Jeremie Fraeys
|
48d00b8322
|
feat: integrate native queue backend into worker and API
- Add QueueBackendNative constant to backend.go
- Add case for native queue in NewBackend() switch
- Native queue uses same FilesystemPath config
- Build tag -tags native_libs enables native implementation
Native library integration now complete:
- dataset_hash: Worker (hash_selector), CLI (verify auto-hash)
- queue_index: Worker/API (backend selection with 'native' type)
|
2026-02-21 14:11:10 -05:00 |
|
Jeremie Fraeys
|
2e701340e5
|
feat(core): API, worker, queue, and manifest improvements
- Add protocol buffer optimizations (internal/api/protocol.go)
- Add filesystem queue backend (internal/queue/filesystem_queue.go)
- Add run manifest support (internal/manifest/run_manifest.go)
- Worker and jupyter task refinements
- Exported test wrappers for benchmarking
|
2026-02-12 12:05:17 -05:00 |
|
Jeremie Fraeys
|
6ff5324e74
|
refactor(storage,queue): split storage layer and add sqlite queue backend
|
2026-01-05 12:31:02 -05:00 |
|