Jeremie Fraeys
b4f2b3e785
ci: auto-install cmake and build dependencies
CI with Native Libraries / Build and Test Native Libraries (push) Blocked by required conditions
CI with Native Libraries / Build Release Libraries (push) Blocked by required conditions
Test / test (push) Waiting to run
Checkout test / test (push) Successful in 5s
CI with Native Libraries / Check Build Environment (push) Successful in 12s
Documentation / build-and-publish (push) Has been cancelled
2026-02-12 13:35:48 -05:00
Jeremie Fraeys
06b388d692
ci: add timeouts and pre-flight checks to native CI
Test / test (push) Waiting to run
Checkout test / test (push) Successful in 4s
CI with Native Libraries / Check Build Environment (push) Failing after 1s
CI with Native Libraries / Build and Test Native Libraries (push) Has been skipped
CI with Native Libraries / Build Release Libraries (push) Has been skipped
Documentation / build-and-publish (push) Has been cancelled
2026-02-12 13:32:59 -05:00
Jeremie Fraeys
d408a60eb1
ci: push all workflow updates
Documentation / build-and-publish (push) Waiting to run
Test / test (push) Waiting to run
Checkout test / test (push) Successful in 5s
CI with Native Libraries / test-native (push) Has been cancelled
CI with Native Libraries / build-release (push) Has been cancelled
2026-02-12 13:28:15 -05:00
Jeremie Fraeys
06690230e2
ci: add native library CI workflow
Checkout test / test (push) Waiting to run
Documentation / build-and-publish (push) Waiting to run
CI with Native Libraries / test-native (push) Failing after 5m35s
CI with Native Libraries / build-release (push) Has been skipped
Test / test (push) Successful in 1s
2026-02-12 13:21:37 -05:00
Jeremie Fraeys
d3f1a1841a
ci: fix invalid secrets syntax in job-level if
Checkout test / test (push) Waiting to run
Documentation / build-and-publish (push) Waiting to run
Test / test (push) Successful in 1s
2026-02-12 13:18:59 -05:00
Jeremie Fraeys
19853dbdf6
ci: add test workflow and ignore Instruments traces
Test / test (push) Successful in 1s
Checkout test / test (push) Has been cancelled
Documentation / build-and-publish (push) Has been cancelled
2026-02-12 13:13:24 -05:00
Jeremie Fraeys
9a9c411bc9
ci: trigger workflows after runner updates
Checkout test / test (push) Waiting to run
Documentation / build-and-publish (push) Waiting to run
2026-02-12 13:11:27 -05:00
Jeremie Fraeys
75faba70fa
ci: trigger workflows after runner updates
Documentation / build-and-publish (push) Has been cancelled
Checkout test / test (push) Has been cancelled
2026-02-12 13:08:53 -05:00
Jeremie Fraeys
2854d3df95
chore(cleanup): remove legacy artifacts and add tooling configs
...
Documentation / build-and-publish (push) Has been cancelled
Checkout test / test (push) Has been cancelled
- Remove .github/ directory (migrated to .forgejo/)
- Remove .local-artifacts/ benchmark results
- Add AGENTS.md for coding assistants
- Add .windsurf/rules/ for development guidelines
- Update .gitignore
2026-02-12 12:06:09 -05:00
Jeremie Fraeys
1dcc1e11d5
chore(build): update build system, scripts, and additional tests
...
- Update Makefile with native build targets (preparing for C++)
- Add profiler and performance regression detector commands
- Update CI/testing scripts
- Add additional unit tests for API, jupyter, queue, manifest
2026-02-12 12:05:55 -05:00
Jeremie Fraeys
2209ae24c6
chore(config): update configurations and deployment scripts
...
- Update API server and worker config schemas
- Refine Docker Compose configurations (dev/prod)
- Update deployment scripts and documentation
2026-02-12 12:05:37 -05:00
Jeremie Fraeys
5144d291cb
docs: comprehensive documentation updates
...
- Add architecture, CI/CD, CLI reference documentation
- Update installation, operations, and quick-start guides
- Add Jupyter workflow and queue documentation
- New landing page and research runner plan
2026-02-12 12:05:27 -05:00
Jeremie Fraeys
2e701340e5
feat(core): API, worker, queue, and manifest improvements
...
- Add protocol buffer optimizations (internal/api/protocol.go)
- Add filesystem queue backend (internal/queue/filesystem_queue.go)
- Add run manifest support (internal/manifest/run_manifest.go)
- Worker and jupyter task refinements
- Exported test wrappers for benchmarking
2026-02-12 12:05:17 -05:00
Jeremie Fraeys
8e3fa94322
feat(cli): enhance Zig CLI with new commands and improved networking
...
- Add new commands: annotate, narrative, requeue
- Refactor WebSocket client into modular components (net/ws/)
- Add rsync embedded binary support
- Improve error handling and response packet processing
- Update build.zig and completions
2026-02-12 12:05:10 -05:00
Jeremie Fraeys
df5d872021
ci: migrate from GitHub to Forgejo/Gitea
...
- Add Forgejo workflow files (.forgejo/workflows/)
- Add Gitea templates (.gitea/ISSUE_TEMPLATE/, .gitea/PULL_REQUEST_TEMPLATE.md)
- Remove legacy .github/ workflows and templates
2026-02-12 12:05:00 -05:00
Jeremie Fraeys
72b4b29ecd
perf: add profiling benchmarks and parallel Go baseline for C++ optimization
...
Add comprehensive benchmarking suite for C++ optimization targets:
- tests/benchmarks/dataset_hash_bench_test.go - dirOverallSHA256Hex profiling
- tests/benchmarks/queue_bench_test.go - filesystem queue profiling
- tests/benchmarks/artifact_and_snapshot_bench_test.go - scanArtifacts/extractTarGz profiling
- tests/unit/worker/artifacts_test.go - moved from internal/ for clean separation
Add parallel Go implementation as baseline for C++ comparison:
- internal/worker/data_integrity.go: dirOverallSHA256HexParallel() with worker pool
- Benchmarks show 2.1x speedup (3.97ms -> 1.90ms) vs sequential
Exported wrappers for testing:
- ScanArtifacts() - artifact scanning
- ExtractTarGz() - tar.gz extraction
- DirOverallSHA256HexParallel() - parallel hashing
Profiling results (Apple M2 Ultra):
- dirOverallSHA256Hex: 78% syscall overhead (target for mmap C++)
- rebuildIndex: 96% syscall overhead (target for binary index C++)
- scanArtifacts: 87% syscall overhead (target for fast traversal C++)
- extractTarGz: 95% syscall overhead (target for parallel gzip C++)
Related: C++ optimization strategy in memory 5d5f0bb6
2026-02-12 12:04:02 -05:00
Jeremie Fraeys
eba4b4f766
testing checkout on docker
Checkout test / test (push) Successful in 36s
2026-01-19 14:51:38 -05:00
Jeremie Fraeys
9832fc6f1d
testing checkout on docker
Checkout test / test (push) Failing after 17s
2026-01-19 14:48:15 -05:00
Jeremie Fraeys
28c1c14d4a
testing checkout on docker
Checkout test / test (push) Successful in 7s
2026-01-19 14:31:52 -05:00
Jeremie Fraeys
890c632fa7
testing checkout on docker
Checkout test / test (push) Successful in 46s
2026-01-19 14:09:10 -05:00
Jeremie Fraeys
fc5bee5076
retry actions
Checkout test / test (push) Waiting to run
2026-01-19 14:04:19 -05:00
Jeremie Fraeys
9a990d2805
testing checkout
Checkout test / test (push) Waiting to run
2026-01-19 13:12:44 -05:00
Jeremie Fraeys
d6c8ca66d0
first commit
Documentation / build (push) Has been cancelled
License Check / license-check (push) Has been cancelled
Documentation / deploy (push) Has been cancelled
2026-01-18 22:16:16 -05:00
Jeremie Fraeys
3fa4f6ae51
docs: update architecture/queue pages and remove legacy development setup
2026-01-05 13:26:39 -05:00
Jeremie Fraeys
f6e506a632
chore(docs): remove legacy Jekyll docs/_pages after Hugo migration
2026-01-05 12:41:09 -05:00
Jeremie Fraeys
3d58387207
chore(compose): remove deprecated root docker-compose files (moved to deployments/)
2026-01-05 12:41:04 -05:00
Jeremie Fraeys
1aed78839b
docs(dev): document validate workflow, CLI/TUI UX contract, and consolidate dev/testing docs
2026-01-05 12:37:46 -05:00
Jeremie Fraeys
8157f73a70
docs(ops): consolidate deployment and performance monitoring docs for Caddy-based setup
2026-01-05 12:37:40 -05:00
Jeremie Fraeys
c0eeeda940
feat(experiment): improve experiment lifecycle and update first-experiment guide
2026-01-05 12:37:34 -05:00
Jeremie Fraeys
6b771e4a50
feat(jupyter): improve runtime management and update security/workflow docs
2026-01-05 12:37:27 -05:00
Jeremie Fraeys
94112f0af5
ci: align workflows, build scripts, and docs with current architecture
2026-01-05 12:34:23 -05:00
Jeremie Fraeys
dab680a60d
feat(tracking): add pluggable tracking backends and audit support
2026-01-05 12:33:57 -05:00
Jeremie Fraeys
a8287f3087
test: expand unit/integration/e2e coverage for new worker/api behavior
2026-01-05 12:31:36 -05:00
Jeremie Fraeys
f726806770
chore(ops): reorganize deployments/monitoring and remove legacy scripts
2026-01-05 12:31:26 -05:00
Jeremie Fraeys
5ef24e4c6d
feat(cli): add validate/info commands and improve protocol handling
2026-01-05 12:31:20 -05:00
Jeremie Fraeys
82034c68f3
feat(worker): add integrity checks, snapshot staging, and prewarm support
2026-01-05 12:31:13 -05:00
Jeremie Fraeys
add4a90e62
feat(api): refactor websocket handlers; add health and prometheus middleware
2026-01-05 12:31:07 -05:00
Jeremie Fraeys
6ff5324e74
refactor(storage,queue): split storage layer and add sqlite queue backend
2026-01-05 12:31:02 -05:00
Jeremie Fraeys
e901ddd810
chore(repo): add dockerignore, changelog, and ignore local artifacts
2026-01-05 12:30:57 -05:00
Jeremie Fraeys
17e5b9b71a
docs: migrate to Hugo Book theme and publish via GitHub Pages
2026-01-05 12:22:24 -05:00
Jeremie Fraeys
cd5640ebd2
Slim and secure: move scripts, clean configs, remove secrets
...
- Move ci-test.sh and setup.sh to scripts/
- Trim docs/src/zig-cli.md to current structure
- Replace hardcoded secrets with placeholders in configs
- Update .gitignore to block .env*, secrets/, keys, build artifacts
- Slim README.md to reflect current CLI/TUI split
- Add cleanup trap to ci-test.sh
- Ensure no secrets are committed
2025-12-07 13:57:51 -05:00
Jeremie Fraeys
b75bd24bba
Add CLI jupyter command for transparent Jupyter management
...
- Add jupyter.zig command with start/stop/status actions
- Update main.zig to include jupyter command in CLI
- CLI now handles all Jupyter setup transparently
- Data scientists only need: ml jupyter start
- Auto-detects container runtime (Podman/Docker)
- Manages container lifecycle automatically
- Provides clear status and error messages
2025-12-06 16:07:09 -05:00
Jeremie Fraeys
9dd4261873
Add Jupyter workflow documentation to docs/
...
- Create comprehensive Jupyter Workflow Integration guide
- Include ML tools usage examples (MLflow, Streamlit, Dash, Panel, Bokeh)
- Add CLI integration instructions and troubleshooting
- Update docs index to reference new workflow guide
- Provide complete setup and usage instructions
2025-12-06 16:02:49 -05:00
Jeremie Fraeys
7312451cfe
Test and verify CLI-Jupyter workflow integration
...
- Successfully tested Jupyter notebook server with ML tools
- Verified all 6 ML tools working: MLflow 3.7.0, Streamlit 1.52.1, Dash 3.3.0, Panel 1.8.4, Bokeh 3.8.1
- MLflow experiment tracking working (created run ID: 25e6b467101845f1ab577c9cfe553c9c)
- CLI integration helper copied to workspace
- Fixed Jupyter permission issues with proper directory setup
2025-12-06 16:01:03 -05:00
Jeremie Fraeys
34c632dcde
Create CLI-Jupyter integration workflow
...
- Add jupyter_launcher.sh script to start Jupyter with ML tools
- Create cli_integration.py helper for CLI operations
- Add sample notebook structure for experiments
- Create workflow documentation for seamless data science integration
2025-12-06 15:59:08 -05:00
Jeremie Fraeys
5cf16ac27d
Clean up podman directory and verify Jupyter integration
...
- Remove redundant requirements file
- Test and verify Jupyter notebook 7.5.0 works
- ML tools container successfully built with all tools
- All 6 ML tools (MLflow, WandB, Streamlit, Dash, Panel, Bokeh) working
2025-12-06 15:56:01 -05:00
Jeremie Fraeys
3178cdf575
Enable ML tools integration for data scientists
...
- Add MLflow, WandB, Streamlit, Dash, Panel, Bokeh to environment.yml
- Update security policy to allow network access for ML tools
- Modify secure_runner.py to check tool permissions
- Add test script and usage guide
- Enable localhost network access for dashboard tools
2025-12-06 15:49:21 -05:00
Jeremie Fraeys
69dc9e6af4
Clean up README files and enhance testing documentation
...
- Remove 14 duplicate README files from test fixtures
- Clean up and restructure docs/src/testing.md with comprehensive testing guide
- Update main README.md to highlight testing and reference docs/ structure
- Remove empty .new files
- Keep only valuable, directory-specific README files (reduced from 34 to 20)
2025-12-06 15:43:51 -05:00
Jeremie Fraeys
605829dfc3
Update documentation for new features and fix outdated references
...
- Update deployment.md to reference new deployments/ directory structure
- Update CLI reference with new multi-user authentication system
- Add roles and permissions examples to configuration
- Fix docker-compose paths in testing documentation
- Remove references to non-existent docker-compose.test.yml
- Update troubleshooting with correct test commands
- Remove misplaced README files from test directories
2025-12-06 13:46:40 -05:00
Jeremie Fraeys
03cead6319
Organize docker-compose files and fix test output paths
...
- Move docker-compose.prod.yml and docker-compose.homelab-secure.yml to deployments/
- Create deployments/README.md with usage instructions
- Update test scripts to use new deployment paths
- Fix performance regression detection to output to tests/bin/
- All test outputs now properly organized in tests/bin/
2025-12-06 13:45:05 -05:00
