lastmile-eval

View on PyPIReverse Dependencies (1)

0.0.81 lastmile_eval-0.0.81-py3-none-any.whl

Wheel Details

Project: lastmile-eval
Version: 0.0.81
Filename: lastmile_eval-0.0.81-py3-none-any.whl
Download: [link]
Size: 2691457
MD5: d0fd7e2dc2b1af1bd6489c55e4650a53
SHA256: 06a96feef8c98b08d2718fb677c675d39401d11b54ce1b21d81a9360d1dbc7c2
Uploaded: 2024-09-03 15:32:12 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: lastmile-eval
Version: 0.0.81
Summary: An API to measure evaluation criteria (ex: faithfulness) of generative AI outputs
Author: LastMile AI
Project-Url: Homepage, https://github.com/lastmile-ai/eval
Project-Url: Bug Tracker, https://github.com/lastmile-ai/eval/issues
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.10
Requires-Dist: requests
Requires-Dist: python-dotenv
Requires-Dist: pydantic (>=2.1)
Requires-Dist: result
Requires-Dist: lastmile-utils
Requires-Dist: evaluate (>=0.4.1)
Requires-Dist: numpy (<2.0.0)
Requires-Dist: arize-phoenix-evals (>=0.5.0)
Requires-Dist: pandas (>=2.1.2)
Requires-Dist: instructor
Requires-Dist: openai (>=1.0.0)
Requires-Dist: rouge-score
Requires-Dist: opentelemetry-api
Requires-Dist: opentelemetry-sdk
Requires-Dist: opentelemetry-exporter-otlp
Requires-Dist: opentelemetry-semantic-conventions
Requires-Dist: openinference-semantic-conventions
Requires-Dist: packaging
Requires-Dist: proto-plus (>=1.24.0)
Requires-Dist: fastapi (==0.110.1); extra == "ui"
Requires-Dist: jinja2; extra == "ui"
Requires-Dist: uvicorn; extra == "ui"
Requires-Dist: email-validator (==2.1.1); extra == "ui"
Requires-Dist: python-aiconfig (>=1.1.34); extra == "ui"
Provides-Extra: ui
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 7105 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (74.1.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
lastmile_eval/utils.py sha256=CPkNLD2g--3RHCNTcCC6WVqLGx0W6rgs05PjuhvT1ZM 2465
lastmile_eval/api/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
lastmile_eval/api/auth_config.py sha256=bveBCcnLymq3MJO6kWOZh4O_W8bEXz58j_rhAJdg6N4 304
lastmile_eval/api/evaluations.py sha256=7KIhB03tQXHDNnM9bCrNOqstzdihWQ3lOQHkyyjuJ9k 3143
lastmile_eval/common/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
lastmile_eval/common/types.py sha256=xd45i5_v12-Bt7AuYQL9ogA1-AXa38chLDBrdasVjRg 73
lastmile_eval/common/utils.py sha256=BYYyPcc4yTDrp0uRDa5ztLeo0AUecSYGl7VyswYkBBw 1050
lastmile_eval/examples/rag.py sha256=DxiKAKtSTo9OzZuIvq8dblDDK8tyzfba2qVl-VVB77I 2363
lastmile_eval/examples/text.py sha256=zlZ1GWfvn2MbP4NevVLuHMwFAcZIlSmrZV4rr1B01Ik 3413
lastmile_eval/examples/rag_debugger/run_llm.py sha256=SOyuGplETe5iS--YurDckn101D2ReUjQ1-6s40BriZk 951
lastmile_eval/examples/rag_debugger/tracing/tracing.py sha256=nqLGT2VP_parMDfEXo_3IMgmH9tD326MrBPqf5txpqM 12353
lastmile_eval/rag/__init__.py sha256=yNpIlMCrMIGuqk9DYiZTyDG9AtxZxH_0nDaUX-TXQ34 111
lastmile_eval/rag/debugger/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
lastmile_eval/rag/debugger/app.py sha256=8cujCBs6JWhiVHFH-8crHNurvlDOX2bB7TlWqelSGVY 26409
lastmile_eval/rag/debugger/app_utils.py sha256=LQcau2IuBAXU_xxxycprz0efTJi-wQrBxBSQoCrkOn0 3290
lastmile_eval/rag/debugger/server.py sha256=b0BVMShBndiukQy3omZLDSmNQKqu2UABP_IU-zksxT8 2892
lastmile_eval/rag/debugger/api/__init__.py sha256=km3wMl7Vm_T3J3gbzWyKu455R4N-S2oBhEeIwD_M2zY 454
lastmile_eval/rag/debugger/api/add_rag_event_interface.py sha256=TbyCv-plDcuXm9knmqjO_s2mPxsTicugBWRSMMbODHs 16538
lastmile_eval/rag/debugger/api/evaluation.py sha256=TSUYr-gUMURb6e1L2oy44qclnyhySGWhGGoAWs5kXl8 23718
lastmile_eval/rag/debugger/api/manage_params_interface.py sha256=fNQva03SNv8CAOQZFX7GRCN0MOSBcTJohDMCxy6BFjM 9803
lastmile_eval/rag/debugger/api/tracing.py sha256=cGUcZmZlsYTR0LhMT9emuEHQxNGCa8CKoJh6fwiU2yg 12379
lastmile_eval/rag/debugger/client/build/asset-manifest.json sha256=tiO_lvpzkwbwhC_iGN8SkbZUBduXmbZxJ2QuFJA9sMQ 805
lastmile_eval/rag/debugger/client/build/index.html sha256=paq5W2nuPrwt_gxoj8imsr7wRZPArHQTdc7ThZoLfzw 651
lastmile_eval/rag/debugger/client/build/manifest.json sha256=zQEeIaSznx22z3I0a-zHNVJRKiikS2uBPgqhqjfpvUA 182
lastmile_eval/rag/debugger/client/build/robots.txt sha256=kNJLw79pisHhc3OVAimMzKcq3x9WT6sF9IS4xI0crdI 67
lastmile_eval/rag/debugger/client/build/static/css/main.c0f29cce.css sha256=e7nuWc7BSXOmYoSnTDdpgxMbAIA_tQ76iLxyo4LtF38 1175
lastmile_eval/rag/debugger/client/build/static/css/main.c0f29cce.css.map sha256=MN7uOF2p8095ZfZMzuUZyzes5nQIxyem-m0cXU86QVM 2000
lastmile_eval/rag/debugger/client/build/static/js/2.664b25cd.chunk.js sha256=-itInh_qqoaGonok5EDUs7A1yQPUjhHUD-_E3Fwgpqo 288702
lastmile_eval/rag/debugger/client/build/static/js/2.664b25cd.chunk.js.map sha256=s4yChK2CRVxM9AJw3o8_b83vKZqB7Uc1ZNxF4hUX-bI 712990
lastmile_eval/rag/debugger/client/build/static/js/732.c19b7ab1.chunk.js sha256=1I7KNvC58d4R-EgZ9sU7JAY84FYw-jzOWFe62tGrTJU 1460
lastmile_eval/rag/debugger/client/build/static/js/732.c19b7ab1.chunk.js.map sha256=4usZ1wa9Keq4ufXL9Si365DshDfLPZUKPyi_1_IWfiE 5167
lastmile_eval/rag/debugger/client/build/static/js/821.cb385427.chunk.js sha256=8WLNziNT_5rfBk3IR2xiRORVofhQtsPfRD7u9ywv2Mk 10707
lastmile_eval/rag/debugger/client/build/static/js/821.cb385427.chunk.js.map sha256=yt_-vBN6hDYTJU7g39AnqzXD8JfAVe0q4Cj15ApVkZU 34550
lastmile_eval/rag/debugger/client/build/static/js/main.fba7430e.js sha256=2KnHnfIA9G6G-XDveCuALTyz4ZrQ4UDbpLC4GC0bFI8 1575445
lastmile_eval/rag/debugger/client/build/static/js/main.fba7430e.js.LICENSE.txt sha256=WZtaVHq8fAVbEwLpNhT5WDAJfO0S7UTj0V6OVJq0prQ 4199
lastmile_eval/rag/debugger/client/build/static/js/main.fba7430e.js.map sha256=MhSZcQxktuHxiV5SV_-DWhZwRI738DrLdPyelKiCoBw 7146485
lastmile_eval/rag/debugger/common/core.py sha256=kbOU0MQ7onIXJib_X7LpWY9IBvRTPf_RfFf4DicFBF4 11836
lastmile_eval/rag/debugger/common/general_functional_utils.py sha256=KpFvkD3m_BbVapg90WnrhAtX-h7wIBv96JhquVyLyA0 2680
lastmile_eval/rag/debugger/common/types.py sha256=R2lcCbLyuHR1n7eSoZZTSf_5IMH4hsrvspwOnPMAiXI 1601
lastmile_eval/rag/debugger/common/utils.py sha256=TdgoII0qlKMfT_KwUY87MhQSHrrubED03OHBcCG5za0 11052
lastmile_eval/rag/debugger/common/www_translation.py sha256=2hta8uLgjVjZEFRDFWL_NGyG3I8lyYSLyHFQY6BY2xM 630
lastmile_eval/rag/debugger/model_settings_schemas/openai_model_settings_schema.py sha256=jD9DD2NCDLe2fw2yIpA9ue0E12lfHTdyT9dCKbHowMo 3257
lastmile_eval/rag/debugger/model_settings_schemas/prompt_model_settings_schema.py sha256=jw6AhTYn3b5cIaFfVM4ALlfPd_pCE3cUb7adzSkS97A 664
lastmile_eval/rag/debugger/offline_evaluation/__init__.py sha256=jvqjCMSy_Nt3pj7mL76MiSOz3Uce3641W2KTpNRRFVk 382
lastmile_eval/rag/debugger/offline_evaluation/default_metrics.py sha256=jQ9S6r9ZBOQY89a5crrrydNcKFAMW1THrJRjgUp1gDQ 1767
lastmile_eval/rag/debugger/offline_evaluation/evaluation_lib.py sha256=cIGyCTY1PKJa9dlJX5qC3FGvxe_4gTPhFv4Jy11Tt1U 55695
lastmile_eval/rag/debugger/offline_evaluation/utils/random_words.py sha256=qXPc4muAnjrFvHq_X6FWj8iHvO8dW9YYZ6rnFTzM8uI 4977
lastmile_eval/rag/debugger/prompt_iteration/run_user_llm_script.py sha256=scJnkn6pNIDnV16V3rf7caa4KIELQGTL0zXgaWHk6v4 3481
lastmile_eval/rag/debugger/scripts/cli.py sha256=BW0loKOxskmZspDhbRrM_7RBaSrM97QFFDy1tgFC4X4 3190
lastmile_eval/rag/debugger/scripts/run_aiconfig_prompt_container.py sha256=_3dD5AI5edoXYchGHSuxIY2w_FwC7xZjY0seaz2TrG0 4827
lastmile_eval/rag/debugger/scripts/test_async_decorator.py sha256=E7GzPGqd1mQH6IZL8JcB0gfGZz0csQ0V4tTUoRAd3h8 805
lastmile_eval/rag/debugger/scripts/test_few_shot_synthetic_data.py sha256=LRPyD_0pQlPGKPUqO74skjmcM13VHg_DD1G3_dWSC-A 3770
lastmile_eval/rag/debugger/scripts/test_openai_tracing.py sha256=8U07kzWO4DnxguiBs1MND3Bi-VJagkorUNv1TaLERgM 1017
lastmile_eval/rag/debugger/scripts/test_run_eval_api.py sha256=Q0XbzjUSNNGwLKXF5DZJiiW3ZV5L9x-S_GfjZ1SP_Do 7986
lastmile_eval/rag/debugger/scripts/util.py sha256=fMY3YaqWFiie6sEUyvzjsqmhX8ic2l8QQKAVGmh0aW0 3631
lastmile_eval/rag/debugger/tracing/__init__.py sha256=hdgZMwqKf1wFoTxp4rE5FUPDzRP2ABLEzoIxg86_Iys 723
lastmile_eval/rag/debugger/tracing/decorators.py sha256=IBXve18B2ElYIX8e1Q04NKhVt6FSRhbg_bwymh57Fjg 1172
lastmile_eval/rag/debugger/tracing/lastmile_tracer.py sha256=wrX2R4Df5R1kaRYmBdRSNyOOBOxQuLt-F8HULP8s6so 32090
lastmile_eval/rag/debugger/tracing/manage_params_impl.py sha256=p1TckLtJWHtkLGOzfUwhWjq3qQUSqF4MCrzGFNrDcT8 4368
lastmile_eval/rag/debugger/tracing/sdk.py sha256=ClijwPZ5eCwwuUK3tQrbB6n9w-kuFpvdlV9FCU0lOXQ 14391
lastmile_eval/rag/debugger/tracing/trace_data_singleton.py sha256=O5RUfzbke74dXmQ2Z046XbWqo9bwMa_SJPr9OK4AQMY 25456
lastmile_eval/rag/debugger/tracing/utils.py sha256=7S0KP7oxCMArd4HszaI2589FpKZDrC9rFlzTtqUk4ZQ 6989
lastmile_eval/rag/debugger/tracing/exporters/__init__.py sha256=KTOOpEcb03OX9i-ECNV8Ba1T__JwAgd1_Fptykay18Y 354
lastmile_eval/rag/debugger/tracing/exporters/lastmile_console_exporter.py sha256=Dv_N2VCMolFVOMmXKT8i6K7p9FuzuBMZf_opVQ6M5mQ 2072
lastmile_eval/rag/debugger/tracing/exporters/lastmile_otlp_exporter.py sha256=63-jezyOW8jgm3mh8yLxBzq2CFkJ5YmGZFqc0eKutbY 2405
lastmile_eval/rag/debugger/tracing/sdk_utils/endpoints.py sha256=OEQjHI2EqHd-x4rOTLkRbJuGPBXi2MqDWaxuRgEnkhc 3035
lastmile_eval/text/__init__.py sha256=dBLJgodQtxHwHlR3r8aM348GKUdeV-2VMNO4lBcqyAU 862
lastmile_eval/text/batch_lib.py sha256=Gn7AQA2FNPkWxPrVMsS_t791doBd-Av9RaDc85G_GFo 1824
lastmile_eval/text/metrics.py sha256=F7y13WY8Fjkfvohih-lk5XECZUwVKiSmndbbwyRNUa8 15593
lastmile_eval/text/metrics_lib.py sha256=Vw5ChVTe8MT_2Hb8lXaDXlI-pcbd5Zr6pIPG1zq0mJk 2643
lastmile_eval/text/openai_batch_lib.py sha256=YnGxLptAFD0NriJKvob4ICRbTX3OXDY9jSeabteUTj4 6119
lastmile_eval/text/synthetic_data/few_shot.py sha256=peNZYwU3SPFugrAcexQYif6J9uoJUjox11DXShFvPjA 5740
lastmile_eval-0.0.81.dist-info/LICENSE sha256=_949EmY0IoZUuNDBZiovAdUyKW9D3M9oFI6RYwTOW08 1055
lastmile_eval-0.0.81.dist-info/METADATA sha256=Q-AJv94Q6jcvcN0gb53ylmE-C3FTUh0kQBo9CMJL98E 8446
lastmile_eval-0.0.81.dist-info/WHEEL sha256=uCRv0ZEik_232NlR4YDw4Pv3Ajt5bKvMH13NUU7hFuI 91
lastmile_eval-0.0.81.dist-info/entry_points.txt sha256=QWN0utulSC5zEgevFzL3zjpxtS4sRVqTmvP5vks4Mgw 74
lastmile_eval-0.0.81.dist-info/top_level.txt sha256=PX5uHw5nxE9X8ItARLd8G8ZooyRr2LRlR7fX0IKUY-o 14
lastmile_eval-0.0.81.dist-info/RECORD

top_level.txt

lastmile_eval

entry_points.txt

rag-debug = lastmile_eval.rag.debugger.scripts.cli:main