Skip to content

Conversation

@ryankert01
Copy link
Member

Purpose of PR

  • Implement BenchmarkStats dataclass with: mean, std, min, max, median, p5, p25, p75, p95, p99
  • Implement StatisticalRunner class that:
    • Accepts a callable benchmark function
    • Runs configurable warmup iterations (default: 3)
    • Runs configurable measurement iterations (default: 10)
    • Returns BenchmarkStats object
  • Add outlier detection (IQR-based) with optional filtering
  • Unit tests for statistics calculations

Related Issues or PRs

Closes #816
Related to #772

Changes Made

  • Bug fix
  • New feature
  • Refactoring
  • Documentation
  • Test
  • CI/CD pipeline
  • Other

Breaking Changes

  • Yes
  • No

Checklist

  • Added or updated unit tests for all changes
  • Added or updated documentation for all changes
  • Successfully built and ran all unit tests or manual tests locally
  • PR title follows "MAHOUT-XXX: Brief Description" format (if related to an issue)
  • Code follows ASF guidelines

Signed-off-by: Hsien-Cheng Huang <ryankert01@gmail.com>
@400Ping
Copy link
Contributor

400Ping commented Jan 14, 2026

Can you split this PR into smaller parts?

@ryankert01 ryankert01 self-assigned this Jan 15, 2026
@ryankert01
Copy link
Member Author

I'll start submit PRs once I have a demo version

@ryankert01 ryankert01 closed this Jan 15, 2026
@ryankert01 ryankert01 deleted the benchmark/add-statistial-measurement branch January 15, 2026 10:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Create Statistical Measurement Framework

2 participants