Wheelodex » Projects » fmeval

fmeval

View on PyPI — Reverse Dependencies (0)

1.2.1 fmeval-1.2.1-py3-none-any.whl

Wheel Details

Project: fmeval
Version: 1.2.1
Filename: fmeval-1.2.1-py3-none-any.whl
Download: [link]
Size: 145611
MD5: 78f441505c4717413675966844dff450
SHA256: 1e508556efacaa396fe7b5a945635d0e68ace4fb53278af61400c3f23bc87b5b
Uploaded: 2024-10-17 23:54:16 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.1
Name: fmeval
Version: 1.2.1
Summary: Amazon Foundation Model Evaluations
Author: Amazon FMEval Team
Author-Email: amazon-fmeval-team[at]amazon.com
License: Apache-2.0
Classifier: Development Status :: 1 - Planning
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<4.0
Requires-Dist: IPython
Requires-Dist: aiohttp (<4.0.0,>=3.9.2)
Requires-Dist: bert-score (<0.4.0,>=0.3.13)
Requires-Dist: evaluate (<0.5.0,>=0.4.0)
Requires-Dist: grpcio (<2.0.0,>=1.60.0)
Requires-Dist: ipykernel (<7.0.0,>=6.26.0)
Requires-Dist: jiwer (<4.0.0,>=3.0.3)
Requires-Dist: markdown
Requires-Dist: matplotlib (<4.0.0,>=3.8.3)
Requires-Dist: mypy-boto3-bedrock (<2.0.0,>=1.33.2)
Requires-Dist: nltk (<4.0.0,>=3.9.0)
Requires-Dist: pandas (==2.1.4)
Requires-Dist: pyarrow
Requires-Dist: pyfunctional (==1.4.3)
Requires-Dist: ray (==2.23.0)
Requires-Dist: rouge-score (<0.2.0,>=0.1.2)
Requires-Dist: sagemaker (<3.0.0,>=2.225.0)
Requires-Dist: scikit-learn (<2.0.0,>=1.3.1)
Requires-Dist: semantic-version (==2.10.0)
Requires-Dist: testbook (<0.5.0,>=0.4.2)
Requires-Dist: torch (!=2.0.1,!=2.1.0,>=2.0.0)
Requires-Dist: transformers (<5.0.0,>=4.36.0)
Requires-Dist: urllib3 (>=2.2.2)
Description-Content-Type: text/markdown
[Description omitted; length: 13037 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
fmeval/COMMIT_HASH sha256=773hM4VZp_Efz2UCV17e3KDxD04V10tOAgrYx9TJfMc 41
fmeval/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/constants.py sha256=ntzjkMCmu3ylUdSeH8LjpTjIS-CJQO4b0yAV16aEliU 5692
fmeval/data_loaders/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/data_loaders/data_config.py sha256=GlhZZzm9F7ITIPaNdWlNqt5zfbCQDVfCxBV4FnVD9tQ 2806
fmeval/data_loaders/data_sources.py sha256=fRisciUSFUGbTG0PLXUBRC-D62yVB4NDnFPZgIZtXXo 3946
fmeval/data_loaders/jmespath_util.py sha256=eYLHQnJY4woIJjm2UH1STnkIvQHfe7gl7sPlVROudOc 1907
fmeval/data_loaders/json_data_loader.py sha256=uPzYBJJAaCPuibKnitXCAmef5-yBNHFEqy9i6g0dVTo 4292
fmeval/data_loaders/json_parser.py sha256=7PGJtSvrCX_zst5zlqjMRV1BcTz46ijsb97nDZf9a4I 13965
fmeval/data_loaders/util.py sha256=y_XW6D-ICjGuNqFdAHr_OBMpRjzOR0b15glQqgOgbY0 8073
fmeval/eval.py sha256=tfDa4njg7gUqneStKF8QK9fXxmDM41eHRC1k4YFO0EM 1424
fmeval/eval_algo_mapping.py sha256=UG9LCEw3LnPwnJyf4WmO4UuAIAA8cwUGVYqWK5IWzDE 2085
fmeval/eval_algorithms/__init__.py sha256=XLHj7moY1pCjp4mzsJO1znAnwAJyHiaI6yUjWqevyHQ 13667
fmeval/eval_algorithms/classification_accuracy.py sha256=Jx_wj7yEckRxHW8Me5QaYePI1SLYZjpq0Q5TwbZrjzM 18195
fmeval/eval_algorithms/classification_accuracy_semantic_robustness.py sha256=JI92Eo6iDj6r-JpgxPEWiIgs_9A56BJBYtnoptrg00Q 12273
fmeval/eval_algorithms/common.py sha256=fIvdKsE4JPT585FmWPxkrkDBKT2kWAHDPNilA71tTUo 7362
fmeval/eval_algorithms/eval_algorithm.py sha256=2iVKP-brOG5krW14ViR6_XgLNiBRn7fMTBn_FXx3ZFw 3637
fmeval/eval_algorithms/factual_knowledge.py sha256=HYvqG0V213VJlB-ZPqHZIaZB_Cf8HuUGmYf1I_LppoQ 16416
fmeval/eval_algorithms/general_semantic_robustness.py sha256=tWa0eq-JVpkMUAjNgzIfEeKIM9WlyYbJbflWHAGCaq0 18696
fmeval/eval_algorithms/helper_models/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/eval_algorithms/helper_models/helper_model.py sha256=gnqgleqxsWRE8HEn0iM6EKA5JizYaF3HYqXVLR5mvIA 8000
fmeval/eval_algorithms/prompt_stereotyping.py sha256=C5HsMU8cFsXRsSTdYitS3f78JdOWD3qkio_-fh8TYTA 11908
fmeval/eval_algorithms/qa_accuracy.py sha256=TEjzYjjI7TRnn9XOOJh0SnP0oQCFN_5xBzIImlzQdhM 20092
fmeval/eval_algorithms/qa_accuracy_semantic_robustness.py sha256=ioRuEtxEtl9lF47lXa6yYeBMMs2OjfGyLGVgdVGpqnc 14777
fmeval/eval_algorithms/qa_toxicity.py sha256=CPTnUL4QLhD8ZX5KOHWJUudkIWcg98m3aYj5ZtGMbh8 1614
fmeval/eval_algorithms/save_strategy.py sha256=6dFxMYcP150XIdgO2Itbd9KXLFiT9ISwjetuubr4Q60 5780
fmeval/eval_algorithms/semantic_perturbation_utils.py sha256=Tb68-Wh7twtiGpXcjpfb8SlNp38EfOwofhLCJQ1uuMg 8044
fmeval/eval_algorithms/semantic_robustness_utils.py sha256=EkPjXshdm12gEijqIM_O8RIQjZC6NWOgHTvGY8TbJ00 5758
fmeval/eval_algorithms/summarization_accuracy.py sha256=8i22vXFUt6VATKcSE0Eiv3hUMqvslBipTWIXyky9kxE 13245
fmeval/eval_algorithms/summarization_accuracy_semantic_robustness.py sha256=Je_fba06f4G7oX1DrnRiR_Sd32EFbE_AgCAMbTJyXfI 13836
fmeval/eval_algorithms/summarization_toxicity.py sha256=RX1iwwMKIVl977u6HzgI0EUXrFQwGJBhqAarq8ryyKc 1671
fmeval/eval_algorithms/toxicity.py sha256=CKO3KHmKPskJl_KA935WN6ZMCGe0iUxoTRAgJvdbZTM 8882
fmeval/eval_algorithms/util.py sha256=2F-KZZ_WCFfvdkgdrr13hohoB52YTRnzd6FSXxDTB9w 18619
fmeval/exceptions.py sha256=rH3AXS8jrqz87EmTJEmP1woQsm8jKjajr_vLmiRlx74 361
fmeval/model_runners/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/model_runners/bedrock_model_runner.py sha256=b0X3XWtns6I7sFmgH5-VVLC7us2cnZ9dTQUPyGNxR50 4238
fmeval/model_runners/composers/__init__.py sha256=x0LDSyRIQpnCld-dT_LLL9UGhBU-qSXTmSGRRPw2INs 1925
fmeval/model_runners/composers/composers.py sha256=n0Ox7qtPiHf3XF3ZWkRA21Fw7qSod7UBart26JYc0vc 4498
fmeval/model_runners/composers/jumpstart_composer.py sha256=q1VL5WPhnr4d6AtVyFwbLw_9A-uBy0-n_EPlHn_K-80 2068
fmeval/model_runners/composers/template.py sha256=0FbsIxyce2nw3YdELrDDnKgdwz7UGjP7e9Gz_VK8NwA 1381
fmeval/model_runners/extractors/__init__.py sha256=Oguu7GPVfvCIcBNHPbkNdpzbapxKBMbKoK9v4VLK_JQ 1967
fmeval/model_runners/extractors/extractor.py sha256=xPD6HkvVv8ZqYmVJZwUd3YtHGroBb7cocx0S4rohaJU 1078
fmeval/model_runners/extractors/json_extractor.py sha256=5r-guyMR_5BgHmn8BKz877jrq6V1YwjzMdHCL2yQDaU 5288
fmeval/model_runners/extractors/jumpstart_extractor.py sha256=PHx6iMqsaTQ-ptpPTgtUKNCnAJxt8z3Hms8-xxWWAAI 10874
fmeval/model_runners/model_runner.py sha256=8J_sN-F4-EJTU0k59T0_6ZffcNf0iMdyg51u0NNdkt0 2345
fmeval/model_runners/sm_jumpstart_model_runner.py sha256=-HqToOO1viMuFJ-Y7UuhlXzS97_TYH6fAcJO2Znb2rU 5943
fmeval/model_runners/sm_model_runner.py sha256=t6TBzKHWBJY7NfI4SglBMfHvmH5292D33lDbkyIHWCI 4821
fmeval/model_runners/util.py sha256=HU5qj98dNEIBpuXfII-INXUkmUD9o9TErmbEBcrHpcA 6394
fmeval/perf_util.py sha256=h_vw4yZXvRDmoQVRhnTYf5VmuWZtjzQgbip_uOBOm54 579
fmeval/reporting/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/reporting/cells.py sha256=LKCv8hoUGuIc639KsNqyq0MSXcU_HwicdmYH_cJeDX4 11536
fmeval/reporting/constants.py sha256=bgJzrITdKJjBTSVTt5aLyow9RB7DifVLz-4yqdM_Llk 18892
fmeval/reporting/eval_output_cells.py sha256=gCxf7YDfWzvTJ-lv-g5ZjKOr_cpLQjGSnTmbJpTb6qI 20790
fmeval/reporting/util.py sha256=6bYcVJ6ErTrVT91J9vJ0dyDEotpX6CHbNZB9O5nq7XI 3932
fmeval/transforms/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmeval/transforms/batched_transform.py sha256=ZgGGstVZ2p8EDq65rye6QBuLwVFOXu7oTvE-G28zcG0 1404
fmeval/transforms/common.py sha256=kiFYycY97w1WnrW-QPDJxhGLWvz8p7cMWpDaFJ1jVFc 10269
fmeval/transforms/semantic_perturbations.py sha256=etmFWOlOYJWu4sINy268GUI8YV3S7Ispj4z5hM30ClM 12300
fmeval/transforms/semantic_robustness_metrics.py sha256=lEv6vHVzDvUOqHTDIeS6RfFaoYXcSkXKqvYwwKzrcOU 6241
fmeval/transforms/summarization_accuracy_metrics.py sha256=u1ViQnUr9f_zaTqr6p4WifRf6WsUKnfjyk5sRt4Ruoo 14257
fmeval/transforms/transform.py sha256=brePXgZJTVRzldiCpD96ayEuVb5tOHXbauYzz6fDyWY 4437
fmeval/transforms/transform_pipeline.py sha256=UUZtxSrmqMqEH6su28TDz-8GCmgG0IaQ2E5iOIfcDdE 4572
fmeval/transforms/util.py sha256=9aQPqL7LEYCh5co-0QCrSxsePwRo9j3Co-S5frwtTIE 4684
fmeval/util.py sha256=tSKO9_T9bL2v77naWtNRs0OAAm5CFDuOXdUgbo-7JJY 4707
fmeval-1.2.1.dist-info/LICENSE sha256=CeipvOyAZxBGUsFoaFqwkx54aPnIKEtm9a5u2uXxEws 10142
fmeval-1.2.1.dist-info/METADATA sha256=9dFt1vHxYUBBpDfUQmBDbILCvgN2orYGeMjnPGeXcnk 14622
fmeval-1.2.1.dist-info/NOTICE sha256=1CkO1kwu3Q_OHYTj-d-yiBJA_lNN73a4zSntavaD4oc 67
fmeval-1.2.1.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
fmeval-1.2.1.dist-info/RECORD — —