promptbench

View on PyPIReverse Dependencies (0)

0.0.4 promptbench-0.0.4-py3-none-any.whl

Wheel Details

Project: promptbench
Version: 0.0.4
Filename: promptbench-0.0.4-py3-none-any.whl
Download: [link]
Size: 129292
MD5: 26edb3c766901db136cdd49045ffe28f
SHA256: 6d1341582ff59b3db73d39708e5ed55cf2955d49f76db6a9dd85f0ce37740bb8
Uploaded: 2024-08-02 02:05:14 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: promptbench
Version: 0.0.4
Summary: PromptBench is a powerful tool designed to scrutinize and analyze the interaction of large language models with various prompts. It provides a convenient infrastructure to simulate **black-box** adversarial **prompt attacks** on the models and evaluate their performances.
Home-Page: https://github.com/microsoft/promptbench
Keywords: pytorch,large language models,prompt tuning,dyval,evaluation
Requires-Python: >=3.9
Requires-Dist: autocorrect (==2.6.1)
Requires-Dist: accelerate (==0.25.0)
Requires-Dist: datasets (>=2.15.0)
Requires-Dist: nltk (==3.8.1)
Requires-Dist: openai (==1.3.7)
Requires-Dist: sentencepiece (==0.1.99)
Requires-Dist: tokenizers (==0.15.0)
Requires-Dist: torch (>=2.1.1)
Requires-Dist: tqdm (==4.66.1)
Requires-Dist: transformers (==4.38.0)
Requires-Dist: Pillow (==10.3.0)
Requires-Dist: google-generativeai (==0.4.0)
Requires-Dist: dashscope (==1.14.1)
Requires-Dist: einops (==0.7.0)
Requires-Dist: transformers-stream-generator (==0.0.5)
Requires-Dist: torchvision (==0.17.0)
Requires-Dist: matplotlib (==3.8.3)
Requires-Dist: tiktoken (==0.6.0)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 13941 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
promptbench/__init__.py sha256=Ob0K_OjDr04Dzp8cF3DMir2sB3OLxh2rLktmNb1IyEQ 449
promptbench/config.py sha256=Ueb89i5ZJSBqvu343HPX0fp-EtyEQdrGqfAzSfOGJZI 18192
promptbench/dataload/__init__.py sha256=zJFBFZfTOZT2ydim4rEANC5eRz2Y5VpwaKwEMU1nLnU 120
promptbench/dataload/dataload.py sha256=Awee0QTtpwhokNITGH2N_CRh-_rHTYDl0MflI8fVkFY 3950
promptbench/dataload/dataset.py sha256=9IhZJnzqtS3OtO1GdJtyE6iN_9rNpoLcgB8vd2WoC1A 44865
promptbench/dyval/__init__.py sha256=gzY30-CiV8TTXNqDcpJiHG2mc9Cwo6h6eZbTxV-JcjI 307
promptbench/dyval/dyval_dataset.py sha256=oDhsLspVyMnD8b9CPqlZWtYR7XLnAlvoTG_XAkQY2nU 9125
promptbench/dyval/dyval_utils.py sha256=Kz90QGcXIGBXNbbepkHlbehZjlAGHqV4f43QslITc80 87066
promptbench/metrics/__init__.py sha256=hTQ5s-pLHAXFazy079cQetsUyMeYoYG8o8-t1TW7Cwo 96
promptbench/metrics/eval.py sha256=b1U93IDBOqCkeaX7nuFkVOlQ8Ymx67yIjpqn8knzYMM 5291
promptbench/models/__init__.py sha256=VJK3ImSNJmusKWumDnmryTJEicVFSACZlrTL4EtOlM8 14497
promptbench/models/models.py sha256=xBd-_N2dWG8v-S6qtXcJmKUBgZuHqe2gpC9gKk4bFxw 41614
promptbench/prompt_attack/__init__.py sha256=50pcIUoNfSksllOOjzzIiXOoiJG8c7HXqeMOXqNQhl0 2124
promptbench/prompt_attack/attack.py sha256=cFmWlYpVZZpikSBO8qgjQkcQ4dUxPJlauQOKMIkg3tY 32803
promptbench/prompt_attack/goal_function.py sha256=VdbxQDMItSqnknz_FWMaFgxx21m2-FRzYajrKYBrTCs 11173
promptbench/prompt_attack/label_constraint.py sha256=a1X8KEx11tKvoaIRBcEcBdebMZizZYZnHJC70EL6UqE 1078
promptbench/prompt_attack/search.py sha256=WCgSbC--xYSVo5c8xV0LqTh0BE71xj9VG9T1KIxD9aA 571
promptbench/prompt_attack/transformations.py sha256=iR1bp3IvkY1dLOvn3oJn782V5BAUTye8QBBAXzShu2Y 2283
promptbench/prompt_engineering/__init__.py sha256=lPXHQMhUmhMl4gWQcj_j8TsPwjaQ86vQ4U7Gen5cjr0 3232
promptbench/prompt_engineering/base.py sha256=504UlQfQc3F9lledXVml_JKdjogpYU554v5vRLUQRfQ 1543
promptbench/prompt_engineering/chain_of_thought.py sha256=xYNKNl9c6xQi1w09GEiO4p6btda-6sn98Nf50z-SCFM 4499
promptbench/prompt_engineering/emotion_prompt.py sha256=iBjzPwYjYr2L23o0heSxTem1nJMeQ_7aXRX-fKIiAWI 2187
promptbench/prompt_engineering/expert_prompting.py sha256=rSn7NOoG5gteGD6UU3qiAs44lYNuij3ORIPVdYGlEEc 2649
promptbench/prompt_engineering/generated_knowledge.py sha256=hbbDnu5_FRKlyvXXH8nx-U6ZgRsDPwDWbpsirWycZgg 3206
promptbench/prompt_engineering/least_to_most.py sha256=-lhaDIorTyBgCvCkRU63x09O-D_rn-c3zl8sGy46Fz4 2603
promptbench/prompts/__init__.py sha256=qetIEPbzKdzXFHvKZdX9UHog3dQri5_d5XTh8_0xvSo 100
promptbench/prompts/method_oriented.py sha256=Wg9Ibl9Pg5WXLLGwGjF32LEFVwai4PhqgZ-eAiHR_KM 23942
promptbench/prompts/prompt.py sha256=XjQT9z8Zicjq4rUfWjBfA6XBMSLjEteaEZO7aZKVzDw 8491
promptbench/prompts/role_oriented.py sha256=i8WYBY3Mlv2C9f4bOjfHnc3pX3PuuRCdRUUHlXYKZ3g 29239
promptbench/prompts/semantic_atk_prompts.py sha256=DYimr_ZaYQlQbxcna2gh-p-4zQhFMGWYVosoohSvjWw 215737
promptbench/prompts/task_oriented.py sha256=usVAUJhacbv_iZDyBVKytBpE05j0RZ-cGQqHsyA9vCg 24356
promptbench/utils/__init__.py sha256=gWhXqEEwF-7M6hcWLez-OFzUFFf0TlIy0BVRtTXNNo8 189
promptbench/utils/dataprocess.py sha256=4E7jKCZhjqyvds2MB4A2-kGBzLPasg-_g2TrX85qJ6A 4410
promptbench/utils/defense.py sha256=XqMtjKY5WOJqaWlZGeEzaeis-bNNG7KWkpxkWpCjh0o 655
promptbench/utils/visualize.py sha256=CrK7xmZb_0OIP8ikH9RkJAilX88IR_6F-wuYwNp8BGI 4900
promptbench-0.0.4.dist-info/LICENSE sha256=ws_MuBL-SCEBqPBFl9_FqZkaaydIJmxHrJG2parhU4M 1141
promptbench-0.0.4.dist-info/METADATA sha256=oo3EtUK12pd-uOHlmS5yqsudtEFh7vZ0yBOfUr5zaKs 15139
promptbench-0.0.4.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
promptbench-0.0.4.dist-info/top_level.txt sha256=Y_9q7p2NNgWWMvuKvtAwyG-jbaCM1reuuFqvY2HNEXA 12
promptbench-0.0.4.dist-info/RECORD

top_level.txt

promptbench