Skip to content

RELEASE_GATES_CHECKLIST.md

Latest commit

 

History

History
141 lines (111 loc) · 4.32 KB

RELEASE_GATES_CHECKLIST.md

File metadata and controls

141 lines (111 loc) · 4.32 KB

Release Gates & Regression Tests - v1.7.2

Date: October 9, 2025
Branch: feature/mlx-native-support
Status: Ready for testing

📋 ACTUAL REGRESSION TEST FILES (User-Reported Issues)

Core Regression Suite

  • tests/regression_tests.rs - Main comprehensive regression suite
    • Model registry operations
    • Model discovery functionality
    • Template rendering (ChatML, Llama3)
    • OpenAI API compatibility
    • Qwen model ChatML detection (Issue #13)
    • Custom model directories (Issue #12)
    • Error handling robustness

User-Reported Issue Regression Tests

  1. tests/packaging_regression_test.rs - crates.io packaging (Issue #60, #83)
  2. tests/mlx_support_regression_test.rs - MLX in macOS binaries (Issue #68)
  3. tests/template_compilation_regression_test.rs - Template files (Issue #83)
  4. tests/model_discovery_regression_test.rs - Model discovery issues
  5. tests/streaming_regression_test.rs - Streaming functionality
  6. tests/version_regression_test.rs - Version validation
  7. tests/compilation_regression_test.rs - Compilation issues
  8. tests/apple_silicon_detection_test.rs - GPU detection (Issue #87)

Release Gate Integration

  • tests/release_gate_integration.rs - Release gate system validation
    • Gate 1: Core Build Validation
    • Gate 2: CUDA Build Timeout Detection (Issue #59)
    • Gate 3: Template Packaging Protection (Issue #60)
    • Gate 4: Binary Size Constitutional Limit (20MB)
    • Gate 5: Test Suite Validation
    • Gate 6: Documentation Validation

🚀 TEST EXECUTION COMMANDS

Run ALL Regression Tests (User Issues)

cargo test --test regression_tests
cargo test --test packaging_regression_test
cargo test --test mlx_support_regression_test
cargo test --test template_compilation_regression_test
cargo test --test model_discovery_regression_test
cargo test --test streaming_regression_test
cargo test --test version_regression_test
cargo test --test compilation_regression_test
cargo test --test apple_silicon_detection_test

Run Release Gates

cargo test --test release_gate_integration

Run Everything

cargo test --all-features

✅ TEST STATUS

Building

  • [⏳] Core build (--features huggingface) - IN PROGRESS
  • Full build (--all-features)
  • MLX build (--features mlx)
  • GPU build (--features gpu)

Regression Tests (User Issues)

  • Main regression suite (regression_tests.rs)
  • Packaging regression (Issue #60, #83)
  • MLX support regression (Issue #68)
  • Template compilation regression (Issue #83)
  • Model discovery regression
  • Streaming regression
  • Version regression
  • Compilation regression
  • Apple Silicon detection (Issue #87)

Release Gates

  • Gate 1: Core Build Validation
  • Gate 2: CUDA Timeout Detection (Issue #59)
  • Gate 3: Template Packaging (Issue #60)
  • Gate 4: Binary Size Limit (20MB)
  • Gate 5: Test Suite Validation
  • Gate 6: Documentation Validation

🔧 PRE-RELEASE CHECKLIST

Code Quality

  • cargo fmt -- --check (formatting)
  • cargo clippy --all-features (no warnings)
  • cargo deny check (license check)
  • No compilation warnings

Documentation

  • README.md updated with MLX + MOE features
  • CHANGELOG.md has v1.7.2 entry
  • All new features documented

Version Management

  • Cargo.toml version bumped to 1.7.2
  • Git tag created for v1.7.2
  • Release notes prepared

🎯 CURRENT BLOCKERS

  1. Build in progress - Waiting for cargo build to complete
  2. Need to run full test suite - Once build completes
  3. Need to fix Cargo.toml dependency - ✅ DONE (using published shimmy-llama-cpp-2)

📝 NOTES

What Changed

  • ✅ Merged PR #97 (MOE CPU offloading)
  • ✅ Merged main into MLX branch
  • ✅ Fixed Cargo.toml to use published crates.io packages
  • ✅ Disabled pre-commit hooks
  • ✅ MLX workflow passing on GitHub Actions

Known Issues Fixed

  • Git dependency issue → Now using published shimmy-llama-cpp-2 v0.1.123
  • Package name mismatch → Corrected with package = "shimmy-llama-cpp-2"

Next Action: Wait for build to complete, then run full test suite