fishy.analysis.statistical

Statistical analysis tools for experiment results.

Functions

fishy.analysis.statistical.display_statistical_summary(df: DataFrame, show_significance: bool = True)

Displays a pretty table grouped by dataset.

fishy.analysis.statistical.perform_significance_test(model_results: List[float], baseline_results: List[float], alpha: float = 0.05) → Dict[str, Any]

Performs a paired t-test between model and baseline results.

fishy.analysis.statistical.summarize_results(results_map: Dict[str, List[Dict[str, Any]]], baseline_model: str | None = None)

Summarizes results and calculates significance for both Train and Test.

s