Issues

• tied scores break top-k ranks for RecomType.SCORE: average rank truncated to int

  evidentlyai/evidently#1975 · Filter by author ptimizeroracle opened on Oct 25, 2026

• import evidently fails with pandas 3.1.0: infer_dtype_from_object was removed

  evidentlyai/evidently#1974 · Filter by author ptimizeroracle opened on Oct 22, 2026

• TextMatch word_boundaries=True still matches substrings inside words

  evidentlyai/evidently#1971 · Filter by author March-7 opened on Oct 22, 2026

• chi_stat_test treats the reference sample as exact expected frequencies, inflating false drift

  evidentlyai/evidently#1969 · Filter by author astroknot-sheep opened on Oct 21, 2026

• [Security] Automated static analysis findings for evidentlyai/evidently (academic research)

  evidentlyai/evidently#1968 · Filter by author fcas opened on Oct 21, 2026

• psi, kl_div, jensenshannon and hellinger miss a clear drift when current has one outlier (equal width bins over both samples)

  evidentlyai/evidently#1962 · Filter by author ptimizeroracle opened on Oct 20, 2026
  2

• TopK recsys metrics crash with KeyError when k exceeds recommendations per user

  evidentlyai/evidently#1960 · Filter by author YashwanthNomula opened on Oct 16, 2026

• mannw drift test is one-sided: a downward shift is never reported as drift

  evidentlyai/evidently#1958 · Filter by author ptimizeroracle opened on Oct 15, 2026

• Hellinger stat test mutates input Series by dropping missing values in place

  evidentlyai/evidently#1952 · Filter by author Ayushdevo opened on Oct 7, 2026

• [Feature Request]: Add Average Precision metric for classification

  evidentlyai/evidently#1942 · Filter by author ShubhanKamat opened on Sep 26, 2026
  3

• OpenAIFeature._postprocess_response inverts the judge verdict when one possible_values label is a substring of another (e.g. 'correct' in 'incorrect')

  evidentlyai/evidently#1937 · Filter by author shaurya416 opened on Sep 23, 2026

• TestSummaryInfo.has_all checks any_column: default TestSummary emits no aggregation metric, success_any alone crashes the report

  evidentlyai/evidently#1930 · Filter by author feiiiiii5 opened on Sep 18, 2026

• chi_stat_test / g_test return p_value = nan on single-category categorical features

  evidentlyai/evidently#1929 · Filter by author warter666 opened on Sep 18, 2026

• New metric: sequential drift detection on time-ordered batch data

  evidentlyai/evidently#1927 · Filter by author ygs1629 opened on Sep 15, 2026
  1

• Example proposal: validate image augmentation drift through metadata and embeddings

  evidentlyai/evidently#1918 · Filter by author ternaus opened on Aug 28, 2026
  1

• evidently-openeval-adapter: convert evaluation DataFrames/Datasets to/from EvalPort

  evidentlyai/evidently#1915 · Filter by author adhabnr-ux opened on Aug 16, 2026
  2

• G-test raises ValueError when reference and current datasets have different sample sizes

  evidentlyai/evidently#1914 · Filter by author devendrakushwah80 opened on Aug 9, 2026

• [Compatibility Issue] litestar.contrib.pydantic removed in litestar 3.0

  evidentlyai/evidently#1910 · Filter by author xyf5432 opened on Aug 5, 2026
  1

• Generic test helpers drop alias= for metric-level tests

  evidentlyai/evidently#1907 · Filter by author CTWalk opened on Jul 30, 2026

• Examples README links to examples/tutorials/, which does not exist

  evidentlyai/evidently#1905 · Filter by author ankitranjan-dsai opened on Jul 27, 2026
  1

• [Feature Request]: Expected Calibration Error (ECE) metric and Reliability Diagrams

  evidentlyai/evidently#1902 · Filter by author Dikshant-Neupane opened on Jul 23, 2026
  1

• Divergence stat tests crash or silently return wrong results on edge case inputs

  evidentlyai/evidently#1900 · Filter by author KunalG67 opened on Jul 15, 2026
  4

• Documentation issue: missing OpenAI dependency for DeclineLLMEval in LLM quickstart

  evidentlyai/evidently#1898 · Filter by author AdrienSkr opened on Jul 9, 2026
  6

• Add BrierScore and ECE as classification calibration metrics

  evidentlyai/evidently#1895 · Filter by author bhargavi1045 opened on Jul 4, 2026
  1

• Set Heatmap color in Report from ClassificationPreset - evidently.options module not found in version 0.7.21. How to fix following code?

  evidentlyai/evidently#1893 · Filter by author sjain777 opened on Jul 1, 2026