Wheelodex » Projects » modelgauge

modelgauge

View on PyPI — Reverse Dependencies (1)

0.6.3 modelgauge-0.6.3-py3-none-any.whl

Wheel Details

Project: modelgauge
Version: 0.6.3
Filename: modelgauge-0.6.3-py3-none-any.whl
Download: [link]
Size: 72503
MD5: d8787fd74768ff78060ffa6c1e302a94
SHA256: a7317b1a8d39221b1ea8455cdb49c895959e57890a0254a26cc1e0ad03ad4344
Uploaded: 2024-09-13 00:19:49 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: modelgauge
Version: 0.6.3
Summary: Automatically and uniformly measure the behavior of many AI Systems.
Author: MLCommons AI Safety
Author-Email: ai-safety-engineering[at]mlcommons.org
Home-Page: https://github.com/mlcommons/modelgauge
Project-Url: Repository, https://github.com/mlcommons/modelgauge
License: Apache-2.0
Keywords: AI,GenAI,LLM,NLP,evaluate,measure,quality,testing,prompt,safety,compare,artificial,intelligence,Large,Language,Models
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Information Technology
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Natural Language :: English
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: System :: Benchmark
Classifier: Typing :: Typed
Requires-Python: >=3.10,<4.0
Requires-Dist: click (<9.0.0,>=8.1.7)
Requires-Dist: diskcache (<6.0.0,>=5.6.3)
Requires-Dist: fastapi (<0.112.0,>=0.111.1)
Requires-Dist: gdown (>=5.1.0)
Requires-Dist: jsonlines (<5.0.0,>=4.0.0)
Requires-Dist: modelgauge_demo_plugin; extra == "demo" or extra == "all-plugins"
Requires-Dist: modelgauge_huggingface; extra == "huggingface" or extra == "all-plugins"
Requires-Dist: modelgauge_openai; extra == "openai" or extra == "all-plugins"
Requires-Dist: modelgauge_perspective_api; extra == "perspective-api" or extra == "all-plugins"
Requires-Dist: modelgauge_standard_tests; extra == "standard-tests" or extra == "all-plugins"
Requires-Dist: pydantic (<3.0.0,>=2.6.0)
Requires-Dist: sqlitedict (<3.0.0,>=2.1.0)
Requires-Dist: starlette (<0.38.0,>=0.37.2)
Requires-Dist: tenacity (<9.0.0,>=8.3.0)
Requires-Dist: together (<2.0.0,>=1.2.3)
Requires-Dist: tomli (<3.0.0,>=2.0.1)
Requires-Dist: tqdm (>=4.66.1)
Requires-Dist: types-tqdm (<5.0.0.0,>=4.66.0.0)
Requires-Dist: typing-extensions (<5.0.0,>=4.10.0)
Requires-Dist: zstandard (<0.19.0,>=0.18.0)
Provides-Extra: all-plugins
Provides-Extra: demo
Provides-Extra: huggingface
Provides-Extra: openai
Provides-Extra: perspective-api
Provides-Extra: standard-tests
Description-Content-Type: text/markdown
[Description omitted; length: 1444 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
modelgauge/aggregations.py sha256=l3wT9XJWpkJNeNXN6jTa_-vsyt9lZhQZieapjqNtHxE 2709
modelgauge/annotation.py sha256=LNAFcDdfB5F87mmATjrOJNfsVp4WkPVWbORXjAwnijI 385
modelgauge/annotation_pipeline.py sha256=ReXimDbJ0G1ok7MJ1-m_nPdjfUI2O_MbKDNugdxCYfA 5767
modelgauge/annotator.py sha256=ASzu5zfXdHFKe9jrolZyeRp5ra_LnL1NDT-jEU7kjeI 1263
modelgauge/annotator_registry.py sha256=oPfb9qx7KgX3vQkq935a8aBToePks_rKqW28uHrA3eY 201
modelgauge/annotators/README.md sha256=CxXN6e6mllp4FTN6cXtd6B_zOPAZyLT5143OO1w5TCc 426
modelgauge/annotators/llama_guard_annotator.py sha256=1SNZm0OUXspc6d3LKFQSdKbxLab916pZN-kVy54LCFY 14794
modelgauge/api_server.py sha256=aQXobczvhtrkRTfqUp4AgjRDzYrL-bv_p0MtkRhkgVY 3728
modelgauge/base_test.py sha256=LIGQXs9ElzwXHLPdaNgbbSMGh_TQDIilwLSqjmzfTGw 3218
modelgauge/caching.py sha256=PBoFrpYh5SKnZQJSNPGGu9IZSWFA7AB61omYPHQtwrw 4079
modelgauge/command_line.py sha256=yJMcn-QjGTbYiPuOEk_sb0GLmX-07JcFSLeyCh-_TL8 1804
modelgauge/concurrency.py sha256=ifARsYEYf2Cy0MOYAfmeXqUX4BCZ64R5Y6u3FPkQ1Us 842
modelgauge/config.py sha256=ND1lesWNGBSlFkCY_Dc002F_T5f34S_Dw8apa64SMew 3049
modelgauge/config_templates/secrets.toml sha256=ntK0K-cKUML0plzBvdgG9gx2sFyQsdbVlTowsGMZaIY 389
modelgauge/data_packing.py sha256=-VjdXRju5pjtv4WnMlMh8LR_XTaczSXTgN91AzCHvvU 1913
modelgauge/dependency_helper.py sha256=9MCRdRhD8hmkpxIYLUCCfMRliSW7Xq6KAQ6dEoOc4kI 7451
modelgauge/dependency_injection.py sha256=4Qwp0I0m3Vbik4Qq1x6GEHhnEoGE0NuwxX6avFr18p4 3284
modelgauge/external_data.py sha256=SfmICybBL9XYIEdo_F2AKBKM8C7qStPDxWB0JenDSqQ 2515
modelgauge/general.py sha256=h8CRksKD4JmxA8Ovj6Vq8ozhP98GZTeExAUbOPb-LCk 2627
modelgauge/instance_factory.py sha256=_shOW9xixqvTaHzP6WppG0trxmFuRYmkH4ZM3H2oNco 3902
modelgauge/load_plugins.py sha256=iwzZjPM2JpUAuSsXLVRKHlyDhIIuICmYssNWRkcyH88 1467
modelgauge/main.py sha256=hg_bLBVcxp04wjzbUe35Kda-PnQgu20XUjc38-nSOes 11759
modelgauge/multiple_choice_questions.py sha256=nul0MayeNGOM1CjbjoHJxJ9T-BaxaVG2XAh3uUJjpFM 5279
modelgauge/not_implemented.py sha256=95B0zhBXSdeCX6ym9Z0IJ3Y9apY6rt4zODECUNArUmo 570
modelgauge/pipeline.py sha256=QMLjXDQNNWTSkedtEH04gSnbIsFJuJ0rsrMaNugh80w 11598
modelgauge/pipeline_runner.py sha256=auseVcMjwAoQCfBn8E8bOpvMCJFw8ME60MIQW6wQrII 3721
modelgauge/prompt.py sha256=4TyW9dV1Qgsycl6NZ8cGR9ilf8FX8zxGfGGecn2OpeQ 1843
modelgauge/prompt_formatting.py sha256=zkl8DO-nt7DZ8-o5pebmI7LIrDFM8VXzeT7txUwx3Bg 539
modelgauge/prompt_pipeline.py sha256=9WGqTFd0HdkE9iXJ6ZPUTgMSvLCARYw2KMqxJuksh2I 5414
modelgauge/record_init.py sha256=vko-69V1rL0p0kwUPK8qjGVDAxA6XM-S5_UZ3IBoXVw 1083
modelgauge/records.py sha256=_7yUhdiueGVXRAlLYgH9oshEnpebVXIniSmSE19bsCI 1527
modelgauge/runners/README.md sha256=qRsnLLnvlqg6wqMtReGWOV31FKltolkbGEQABOIqveQ 420
modelgauge/secret_values.py sha256=4rDZEracSTsSt_PT09UC9gDweWNWZnrsTcsSnvDujXI 4799
modelgauge/simple_test_runner.py sha256=sa6clDxFxMY47P0Cgz3MPbkiA15usgF2QQK7tgSil9o 7568
modelgauge/single_turn_prompt_response.py sha256=Uj_Xje6AnxFQ4kbqxUJ6Evnlj9rZd2-XidOAmoPUHGc 4307
modelgauge/sut.py sha256=hzoqLNH8mkSBYxKBP7j4QlplPJSOXunvUVgsWagyPk0 3612
modelgauge/sut_capabilities.py sha256=GvJ7yNiAgzGu8MFUzpLumEvUofD5n00pVjizTN5p8rw 1277
modelgauge/sut_capabilities_verification.py sha256=5XdxBc_qilNim6ssVnyNAARLr7riWGmPvJwLUMevkUE 1511
modelgauge/sut_decorator.py sha256=SW4opjRrj5kIWt0T-sCnquTgrCtlQAhJjmpyTDO7VFQ 3973
modelgauge/sut_registry.py sha256=BU2KnWw75agnhCnfBywoFCdBUVmNAIeaUmh0gyGCWM4 170
modelgauge/suts/README.md sha256=1_d4L4vR-BVf8g1yfG4_dCXyIb6OhR9Os1huGGdUsY8 414
modelgauge/suts/together_cli.py sha256=OlF7YN6Ho9mI4k2M4o1qxmxEods0KRAmJP0gs9bSXGE 1132
modelgauge/suts/together_client.py sha256=8cqkLIuDAaVDrC-7LH_GTvUmHQVsB1ZgI7wRbqyJUAA 16039
modelgauge/test_decorator.py sha256=iI-_aCANyI_BSdnLxZtjIJJTIvKlx9Bkcblk6EgoIzk 5253
modelgauge/test_registry.py sha256=vUfurRJKSfgqfYZhZnM4QoIvbPrBx-7ViYxO8CkB7vs 188
modelgauge/tests/README.md sha256=bULXMGAbKyJaoSJ4TLcnWUCARvv0ZaTxRzSTUEXfNwI 414
modelgauge/tests/safe.py sha256=4xmzCnVLyyxefzInHYfsILkURegJI5ZjbDVKH7NE6Tg 8101
modelgauge/tests/safe_v1.py sha256=yY-8nr0fI3mXN_A2GLTMNjE6sgt9HiZSDwt9vgYffCY 13802
modelgauge/tests/specifications/README.md sha256=M35UepUPyKmFkvENlkweeaMElheQqNoM5Emh8ADO-rs 4
modelgauge/tracked_object.py sha256=Qwx4WyeGbsEDkP5FeC9mx9h3j7FFsRtyymhFJ3y6bhc 151
modelgauge/typed_data.py sha256=m3QKPkQwWd1qm7QpKQht7lPPIT-GgB6pGHFrUvhjLy0 2476
modelgauge-0.6.3.dist-info/LICENSE.md sha256=DVQuDIgE45qn836wDaWnYhSdxoLXgpRRKH4RuTjpRZQ 10174
modelgauge-0.6.3.dist-info/METADATA sha256=dVM_Md1hjW3d4FrIYQh9HPSLOCe2nukljs4fekE7hnM 4013
modelgauge-0.6.3.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
modelgauge-0.6.3.dist-info/entry_points.txt sha256=YS1AY4Oyk2tQ8z40TGVfe8wQ4loELbU-JOwEqhHF4qE 51
modelgauge-0.6.3.dist-info/RECORD — —

entry_points.txt

[console_scripts]
modelgauge = modelgauge.main:main