Wheelodex » Projects » continuous-eval

continuous-eval

View on PyPI — Reverse Dependencies (2)

0.3.14.post2 continuous_eval-0.3.14.post2-py3-none-any.whl

Wheel Details

Project: continuous-eval
Version: 0.3.14.post2
Filename: continuous_eval-0.3.14.post2-py3-none-any.whl
Download: [link]
Size: 80083
MD5: 73b5a8097ac79154d91240dd870315f5
SHA256: faa857991a75595c68dd44bfaf4c2387304de9c30bcd647f7af7962ae44d6f76
Uploaded: 2025-01-06 15:30:50 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.1
Name: continuous-eval
Version: 0.3.14.post2
Summary: Open-Source Evaluation for GenAI Applications.
Author: Yi Zhang
Author-Email: yi[at]relari.ai
License: Apache-2.0
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<3.13
Requires-Dist: anthropic (<0.41.0,>=0.40.0); extra == "anthropic"
Requires-Dist: appdirs (<2.0.0,>=1.4.4)
Requires-Dist: azure-ai-inference (<2.0.0,>=1.0.0b6); extra == "azure"
Requires-Dist: boto3 (<2.0.0,>=1.35.77); extra == "bedrock"
Requires-Dist: cohere (<6.0.0,>=5.13.3); extra == "cohere"
Requires-Dist: google-generativeai (<0.9.0,>=0.8.3); extra == "google"
Requires-Dist: jinja2 (<4.0.0,>=3.1.4)
Requires-Dist: json-repair (<0.32.0,>=0.31.0)
Requires-Dist: munkres (<2.0.0,>=1.1.4)
Requires-Dist: nltk (<4.0.0,>=3.9.1)
Requires-Dist: openai (<2.0.0,>=1.58.1)
Requires-Dist: pandas (<3.0.0,>=2.2.3); extra == "semantic"
Requires-Dist: posthog (<4.0.0,>=3.7.4)
Requires-Dist: python-dotenv (<2.0.0,>=1.0.0)
Requires-Dist: pyyaml (<7.0.0,>=6.0.1)
Requires-Dist: requests (<3.0.0,>=2.31.0)
Requires-Dist: rouge (<2.0.0,>=1.0.1)
Requires-Dist: scikit-learn (<2.0.0,>=1.6.0)
Requires-Dist: sentence-transformers (<4.0.0,>=3.3.1); (python_version >= "3.11" and python_version < "4.0") and extra == "semantic"
Requires-Dist: sentencepiece (<0.3.0,>=0.2.0); extra == "semantic"
Requires-Dist: sqlglot (<27.0.0,>=26.0.0)
Requires-Dist: tenacity (<9.0.0,>=8.1.0)
Requires-Dist: thefuzz (<0.23.0,>=0.22.1)
Requires-Dist: tiktoken (<0.9.0,>=0.8.0)
Requires-Dist: torch (<3.0.0,>=2.1.1); (python_version >= "3.11" and python_version < "4.0") and extra == "semantic"
Requires-Dist: tqdm (<5.0.0,>=4.66.1)
Requires-Dist: transformers (<5.0.0,>=4.47.1); extra == "semantic"
Provides-Extra: anthropic
Provides-Extra: azure
Provides-Extra: bedrock
Provides-Extra: cohere
Provides-Extra: google
Provides-Extra: semantic
Description-Content-Type: text/markdown
[Description omitted; length: 10674 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
continuous_eval/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
continuous_eval/data_downloader.py sha256=tZ5uhKrmtO47bsDdXIXr_tsp0bIj40f5SKuPhgEpMRg 4588
continuous_eval/eval/__init__.py sha256=6-AOIS8OCYYQGbwuepsEap9cYB9jiIQiThHLJI2pbR0 295
continuous_eval/eval/dataset.py sha256=0-EQesJZM_h5vsgN-3OIWyPp0DwvfO-iyaA_T0HVqm8 8885
continuous_eval/eval/logger.py sha256=DRzAM4IvZlmQ3a1DP9w8tm_IsYZ9AvYpbCnIiFmPeTk 3101
continuous_eval/eval/modules.py sha256=Tprxkm1UE98yzozI8e_qGFuvriR23g-JGu4LupWG55w 3196
continuous_eval/eval/pipeline.py sha256=6_rB2R3xCMmoA7Rs8rdGmj3O-aeka9BQ7F5AR-pb-Q0 5188
continuous_eval/eval/result_types.py sha256=mPocoUfMoa2pU2l06Ux1wzE7lYsfu9Q3PEhlcPzHdU4 7440
continuous_eval/eval/runner.py sha256=IyRfa27R6JyP8qNFF6FAtKqVuu2QD20P4Q3CvxHOFzA 6100
continuous_eval/eval/tests.py sha256=fnhEGo_VIKkaXgktBkWxRMVF7s-SgVGnjkN6wanN8G8 1581
continuous_eval/eval/types.py sha256=U1Ua5DP0ULi9bmFMthJ4knJVvWUa7Bhwi1KAUOD_duo 288
continuous_eval/llms/__init__.py sha256=C-_3MVyrAaq-sm3t1cZIqREmBT6VGpjZtPJJoQ0oNso 104
continuous_eval/llms/anthropic.py sha256=VI0syJaB-NGP4mmuLtMO-L31IWa6kpndV19iBgu25AQ 1590
continuous_eval/llms/anthropic_bedrock.py sha256=RkFOq855ei8SG1M9NLqIu8VAdt6JF2bB94JE94m_sr8 1931
continuous_eval/llms/azure.py sha256=QWKXYUKNNySwwLeHjcBhtjf8GZScnIbbWbnnmzNMXXo 2457
continuous_eval/llms/azure_openai.py sha256=W-j0EhiD4Njz0j_c7FGrxtg8LYbFj_VdZD5aenasGNU 4643
continuous_eval/llms/base.py sha256=mYSGDqarz-GJniczy7kYp_EpUpM52CNhn44qRJqAPts 1500
continuous_eval/llms/bedrock.py sha256=Z75L5ijojYjKpZbSluCf-PU4uSIJI01H0kkmc4gVepI 1723
continuous_eval/llms/cohere.py sha256=P5Mios-vB8QDlOM3kbOvFQt_6rDk5HAggiLikUvLsVQ 1482
continuous_eval/llms/google.py sha256=3uvSnSKR2ioV1nIrVk3GtdxFXBPSmqzNrp4t-jGd0DU 2049
continuous_eval/llms/openai.py sha256=Rr3PZasaDCGFai-oDTCOVCzaizbYd1TlLI7zO-8NNjU 1242
continuous_eval/metrics/__init__.py sha256=FHXdlaQTVvuvX7kjwrNyRah-_8OgI8NNQKr-WvZbPIo 48
continuous_eval/metrics/base/__init__.py sha256=zG286c0ZxAYUGQrfY-K-65N77etxQr8re8M91sOXvxg 72
continuous_eval/metrics/base/llm.py sha256=bZFzRFIM3TtxejVRZZlGQQ-JB3OKgB4tllfTT6leyu8 2816
continuous_eval/metrics/base/metric.py sha256=Sw5X7NyeY5HBFNsyFSLQ-N_EGjsPSo7JzeiGui4A6hc 7872
continuous_eval/metrics/base/probabilistic.py sha256=Efm_M_HLFuN8qhJWLxyW9S73cRMracHwC_IOSa3Nkfs 6585
continuous_eval/metrics/base/prompt.py sha256=QuZLM-FwCWofX0vWIm46zQAWHkZRZiOCtJhwyKJhffA 6174
continuous_eval/metrics/base/response_type.py sha256=HiW2_I5cGTkpNxQxuNVNW8AaISG0IOj_eX68zBQvl_I 7675
continuous_eval/metrics/classification/__init__.py sha256=HKgf9_q5Ed-1vRHi0eWzegwOtDNyaOIWMThsOgz8D4s 101
continuous_eval/metrics/classification/classification.py sha256=3qvp8IycTotIe1XKRqBj8VSeI6Nf9Qg1kegpElqaVv8 3257
continuous_eval/metrics/code/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
continuous_eval/metrics/code/python/__init__.py sha256=4Zf1j9YBLHpLHy4N2xs8IG4cATzljkizncYCY9oSzTM 77
continuous_eval/metrics/code/python/code_deterministic_metrics.py sha256=yDbvD6TR-mOjl43bGLyFW_dRJciNSpSv9nSOExum1_E 13502
continuous_eval/metrics/code/sql/__init__.py sha256=IFtSJ0GWJZ9v2jc71gd9mVdv4wb28_bAMVilkdZi_jY 92
continuous_eval/metrics/code/sql/deterministic.py sha256=GTpUqrXjh3x2PyH0PtBsfaMI1rNJ1zcJivTZrW_tytM 6352
continuous_eval/metrics/code/sql/llm.py sha256=dWiXKJhvrlewHD1a-fB2EbVgRVDWSYfRUnz_n8iFOqM 2615
continuous_eval/metrics/code/sql/prompts/sql_correctness_sys.jinja2 sha256=tD7oLmT22kKfGjDQ-oaGmD1eK1T9x1PunvCWr6-xAiE 1774
continuous_eval/metrics/code/sql/prompts/sql_correctness_user.jinja2 sha256=ADOmJIKFaANaRkRQGAOAQgYAbDGMXkksn9bAIOdHQsI 568
continuous_eval/metrics/custom/__init__.py sha256=_KK-7zeLf7uwSEMeKDInam5nzQJHe3XguQT4Nl-VdNc 75
continuous_eval/metrics/custom/custom_metric.py sha256=fOD-ayPxCJStsnHp9ehE7yZFgw0BTeKYpiyf9Uztfhw 3756
continuous_eval/metrics/custom/custom_metric_sys.jinja2 sha256=kkJhDi07aN3TDGWWVNyqYghEZt-F2BcMEaGO2Pf5S7w 758
continuous_eval/metrics/custom/custom_metric_sys_probabilistic.jinja2 sha256=8pBOP8wM-v_AQa-p0GhM0KHfTKmLP9UR05bbTxZpN9w 507
continuous_eval/metrics/custom/custom_metric_user.jinja2 sha256=0ELguNdp7HlC55aJHVmhrwzNEyeVv45qBRM1qkyW14g 98
continuous_eval/metrics/generation/text/__init__.py sha256=4tM2Qs95ThY7wKLg8a7bKELH4_9NBpu3QozoHtuQfFg 513
continuous_eval/metrics/generation/text/bert.py sha256=LFiLAb5a7s_g0_v7xJZBLi43xa9aNhZIm9vrU9PYGZA 4327
continuous_eval/metrics/generation/text/deterministic.py sha256=Iz7qduVTaGRWkhzV6cTgFxy-eij_e6iXDn-uECZOnb8 7976
continuous_eval/metrics/generation/text/llm_based.py sha256=-I7hHHMCdciv9Th8HIj6-DLjqIcVzzziPydP7efwGV4 8495
continuous_eval/metrics/generation/text/prompts/ans_correctness_sys.jinja2 sha256=suqmFN76T8FQLzVTpY_bDz1Fgjw50BfY8XmjgdHPKf8 1905
continuous_eval/metrics/generation/text/prompts/ans_correctness_user.jinja2 sha256=_TuSlOYBTzTOSTuKkjXMlC5ph64tPfsJFq1Pd9iYhwg 285
continuous_eval/metrics/generation/text/prompts/ans_relevance_sys.jinja2 sha256=wZZUC3-NcCfVM8hN7MrBrw0g5gJNAqmKeLg2BsDtAf4 1065
continuous_eval/metrics/generation/text/prompts/ans_relevance_user.jinja2 sha256=jhpmhrd5xqxyAVB10RUm54pOL6RsHYA1lNaZ3WXI0hE 73
continuous_eval/metrics/generation/text/prompts/faithfulness_sys.jinja2 sha256=GbRDw0Bu09J8ARPzUsl0NpUbiFWx-xJA3301_JZ06xo 1411
continuous_eval/metrics/generation/text/prompts/faithfulness_user.jinja2 sha256=al87eY-L-n_lyrJ_55sskJfkWBJuVNNv0ZzyjAhInIc 61
continuous_eval/metrics/generation/text/prompts/style_consistency_sys.jinja2 sha256=Qs9rWKl_BBU_YU8CVY6CzM8tF4sE0Cad_uXt9k4qYl8 1525
continuous_eval/metrics/generation/text/prompts/style_consistency_user.jinja2 sha256=t4YyFB3pYyRHmw4QGK-MBLsGt_kk04skXHgvp4ZHCfE 252
continuous_eval/metrics/generation/text/semantic.py sha256=2iuylEIx0FdB6jepe7UANlpDEMaZbLWAZ1NAXvsmyhI 7388
continuous_eval/metrics/generation/text/utils.py sha256=zb0Dv1zUFNnH6J6x_Wp-WWNJ5x26QxxLeqQxU-11bxs 2913
continuous_eval/metrics/retrieval/__init__.py sha256=6iiPZnjXAzgUU4Xn3OYW1AhJyqgXN84AjjBM6AR1JJY 643
continuous_eval/metrics/retrieval/llm_based.py sha256=3jfseNVjOKmGSDiOgGZMaP5l6g57gjh-WxGBcg6xtvU 5568
continuous_eval/metrics/retrieval/matching_strategy.py sha256=EMDi_zUwQstW2E4Y7HzD0EyPxl09suBDDjjjAqVXIu8 3145
continuous_eval/metrics/retrieval/precision_recall_f1.py sha256=L4SrspobKFdp-Uxsz6-HgRdgPufcDsCyOC9k73sj6lg 3095
continuous_eval/metrics/retrieval/prompts/context_coverage_sys.jinja2 sha256=zie8mx85ziTMd5qppyXz5qDyHuIHkkBeq4LpGPoROxc 1374
continuous_eval/metrics/retrieval/prompts/context_coverage_user.jinja2 sha256=_eoSGWRNQEOLM1AXuzt0yztEshclEmH3aowYOA1RxYc 121
continuous_eval/metrics/retrieval/prompts/context_precision_sys.jinja2 sha256=gRCah7C6WxcQo-jjOFBbN2ejJVzSGlSNu_h3g7gYHCE 706
continuous_eval/metrics/retrieval/prompts/context_precision_user.jinja2 sha256=15qyogeafASUDDGmI6kMHvcjvqrk2f62UVZzvSQQ1qw 62
continuous_eval/metrics/retrieval/ranked.py sha256=12fusYi0U1vcjEbdDu7X7O4nDFRNjfCvns5nXngiI74 4196
continuous_eval/metrics/retrieval/simple_tokenizer.py sha256=ukw5aHO9A7_1D4YyAgHkjYkicK5C3gw76cjPAxB7lHw 1692
continuous_eval/metrics/retrieval/tokens.py sha256=mqw3QTVLgU4ieEBZj7d6j6rRK-LbtKQp050Jlndj-xg 2241
continuous_eval/metrics/tools/match.py sha256=RH2RwSd6OfpLuxPqdcdYhmyMZR9NPAxWGgnJRw3BYHY 2397
continuous_eval/utils/generic.py sha256=Gf9UzW5ziVkUhil--1VPfwK5RrwYClLvNjlyUK3f2Tk 90
continuous_eval/utils/telemetry.py sha256=VSGkRn68-NZGVHW2kzAUkhzVDCkVz9uWaH2pZDdKNI8 3441
continuous_eval/utils/types.py sha256=0WBMYZm-866BzBHSv_Ikv6N4otAJpFCBJilte23bak8 2955
continuous_eval-0.3.14.post2.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
continuous_eval-0.3.14.post2.dist-info/METADATA sha256=E0DOg5aD9Nstta4cfUe8TKXZHNLJBRUMl1skEw7hSI0 12822
continuous_eval-0.3.14.post2.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
continuous_eval-0.3.14.post2.dist-info/RECORD — —