air-benchmark

View on PyPIReverse Dependencies (0)

0.1.0 air_benchmark-0.1.0-py3-none-any.whl

Wheel Details

Project: air-benchmark
Version: 0.1.0
Filename: air_benchmark-0.1.0-py3-none-any.whl
Download: [link]
Size: 48050
MD5: be86ebcb9c504abb1e5a0f15df424ae1
SHA256: e619d3cfe1d9a5a434e9fad8e9dba3f0a569961e66a6a4091e49ab13e4d4f37f
Uploaded: 2024-10-17 09:46:35 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: air-benchmark
Version: 0.1.0
Summary: AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
Author-Email: BAAI <zhengliu1026[at]gmail.com>, Jina AI <research[at]jina.ai>
Project-Url: homepage, https://github.com/AIR-Bench/AIR-Bench/tree/main
Project-Url: Huggingface Organization, https://huggingface.co/AIR-Bench
Project-Url: Leaderboard, https://huggingface.co/spaces/AIR-Bench/leaderboard
License: MIT License Copyright (c) 2024 AIR-Bench Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Keywords: embedding,benchmark,air-bench,reranker,information retrieval
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Information Technology
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Requires-Python: >=3.8
Requires-Dist: datasets (>=2.19.0)
Requires-Dist: rich (>=13.7.1)
Requires-Dist: pytrec-eval
Requires-Dist: black; extra == "dev"
Requires-Dist: isort; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 7899 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.2.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
air_benchmark/__init__.py sha256=am1JVyBMO43yygqBC8fd2K7FkOyOqXqmWV1H1n_y3ag 202
air_benchmark/air_benchmark.py sha256=DBXIE9yN9CIwz2Zdat2E3k_OCHoexw3G_dor42SJwDw 8958
air_benchmark/console.py sha256=YpkWJpc_WzJZdffoxRnCsTGszxTLarzYA3k1E8W0Cik 108
air_benchmark/evaluation_utils/__init__.py sha256=dZgpWwqD2mFW7i-hKVrJlYK_0TSxV78y-cRUS-wnD4w 253
air_benchmark/evaluation_utils/data_loader.py sha256=XJj-IRtdWRw56RxX1WiId1LwfHRw7R8e4mqzqGQSXYo 2708
air_benchmark/evaluation_utils/evaluation_arguments.py sha256=8b6JYikHht7gGgDld6HGS6L6xXsQk2XIl1H33aWjb1M 1145
air_benchmark/evaluation_utils/evaluator.py sha256=91TCelKuLz_5CRH2zJNCzZPKwUghseYofu2lppyZ_Ys 19639
air_benchmark/evaluation_utils/searcher.py sha256=Pgg3KPl3ZXxY58BFrHZWoX7yK8rjjTW4G-JDyDxWLWY 3070
air_benchmark/evaluation_utils/utils.py sha256=yaN-fwpayXrZKjA06Nk06_y1QPWPUCgv-ZFZeGuTz1U 3032
air_benchmark/tasks/__init__.py sha256=zDPcldKyRABs1jkOIk4GEWAufXBwhVh2RAjcbQw854U 469
air_benchmark/tasks/tasks.py sha256=aYhyHQnw3nVLJZZcRBjOhON5pTFnLj0GBjvmIvVT3EA 5828
air_benchmark/tasks/v24_04/long_doc_tasks.py sha256=-S6bt5BblfghI5cAIZWDm4vjo8qlFfRsNLA2cLKyqU4 14826
air_benchmark/tasks/v24_04/qa_tasks.py sha256=Nc4t9zmHORCekSTd-wBfsMOPG-QqkR8Hcen3OIsnISE 13091
air_benchmark/tasks/v24_04/tasks.py sha256=KActBpL8VhaqitKqqdfqYVwQYl3x3-8JL2FDNfMr5Jg 800
air_benchmark/tasks/v24_05/long_doc_tasks.py sha256=1R-IyvOjcIRK85bkZa3bg-cBi1fv3wjTeijcUpJ3tas 14810
air_benchmark/tasks/v24_05/qa_tasks.py sha256=1di8466vtM9Rb4-gfqMroLCgRiMbeOCPCq9qvq3Qg9E 67864
air_benchmark/tasks/v24_05/tasks.py sha256=Cm6Cy6lHCJlNXIWmFKe7caltRM6Y1ESzqZMoJ6WLJxA 849
examples/evaluate_jina_model.py sha256=g8o9KyEtzguN_OHc_rl13WJKTWzCbJ2tSmE9-hZ3Ij0 5717
examples/evaluate_openai_embedding.py sha256=z0WE7j11GOzuLepgsLuI6b9jWVZ6VZHXDRtqTdY0w3s 3193
scripts/eval_dev_results.py sha256=XMIuc2q_KLFWG8SwgQ9Yd2_3yo_mT11eV2r1AUXwL1M 1924
scripts/zip_results.py sha256=0eFY0SEKaitqN5DctFMcsnVCN5ttyyGqVdZLP-LvHTI 3891
scripts/bm25/evaluate_bm25.py sha256=PeJ3sJfNUkaTChanbECzqVkneemdMQV26ICrbrvq_cc 1947
scripts/bm25/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
scripts/bm25/utils/arguments.py sha256=E7QpJKYhlwiAQzDywHmyXM9ytPQ30iTf40TBC4BMmOk 1316
scripts/bm25/utils/models.py sha256=YTNfHCqaB9-w8CaD3luV0kercM-F0TsMDiwwQtF9Hik 3730
scripts/bm25/utils/searcher.py sha256=uL3pt4bw8pN9IlcdhFgtC2BzWnBA1Lz_u8xwioG8v04 5255
scripts/hf-transformers/evaluate_hf_transformers.py sha256=KUfeUr5wDKlVS2adQi6KCFX3lG121oTzwJPXinIE1gE 4004
scripts/hf-transformers/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
scripts/hf-transformers/utils/arguments.py sha256=PxAlBCJtb7mJkfxEUj7i71vH4_vIX_r3dJPAq2SXU6k 2515
scripts/hf-transformers/utils/models.py sha256=BhO5P1sLl8awtNQy8qvsb3xeLSijp7mPVvvtLivca7o 12403
scripts/hf-transformers/utils/searcher.py sha256=P_9KvHeN2Q-7Ur_1Vl2cdROOFhmZiDkSjHrwArBQMdI 2499
scripts/sentence-transformers/evaluate_sentence_transformers.py sha256=VURmJnQoVanPMz7l1YHlC_XkxKH8F314DALYWksS9vo 3655
scripts/sentence-transformers/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
scripts/sentence-transformers/utils/arguments.py sha256=fAANIhUI-h_VQpbSixri0Ib2rK7V1ZsFoGGrUYm_SJE 2026
scripts/sentence-transformers/utils/models.py sha256=aeAET4btoMuy3DX4q3EWR01ffLLMkBeGMMqL4QNvuyM 3443
scripts/sentence-transformers/utils/searcher.py sha256=XWuagt_wxCd-CmEA3ORJXWMsVjC5_SmBND2dm1j8zxI 2563
air_benchmark-0.1.0.dist-info/LICENSE sha256=ntupsTBw6s6xGN_fKW1xDRIQc5lNDuab98KDjGJF07c 1066
air_benchmark-0.1.0.dist-info/METADATA sha256=-oyM7Iy166e4caYGtLk4hjNVgMh_0q8jwH57XfBOQrg 10321
air_benchmark-0.1.0.dist-info/WHEEL sha256=OVMc5UfuAQiSplgO0_WdW7vXVGAt9Hdd6qtN4HotdyA 91
air_benchmark-0.1.0.dist-info/entry_points.txt sha256=j4KgHXbVGbGyfTySc1ypBdERpfihO4WNjppvCdE9HjE 52
air_benchmark-0.1.0.dist-info/top_level.txt sha256=VTkVXcaeQFjmcEoRNQy2fEdME0XpKTpfBGKhw-i-c5M 31
air_benchmark-0.1.0.dist-info/RECORD

top_level.txt

air_benchmark
examples
scripts

entry_points.txt

realpython = reader.__main__:main