transformer-lens

View on PyPIReverse Dependencies (20)

2.11.0 transformer_lens-2.11.0-py3-none-any.whl

Wheel Details

Project: transformer-lens
Version: 2.11.0
Filename: transformer_lens-2.11.0-py3-none-any.whl
Download: [link]
Size: 177606
MD5: fdd00d97f4261f729f82f9abcadb6945
SHA256: a09cea7549220d89245938cbabd4b79424d6e345f61b609766d62747c5c2d7a2
Uploaded: 2024-12-31 02:15:59 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: transformer-lens
Version: 2.11.0
Summary: An implementation of transformers tailored for mechanistic interpretability.
Author: Neel Nanda
Author-Email: 77788841+TransformerLensOrg[at]users.noreply.github.com
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.8,<4.0
Requires-Dist: accelerate (>=0.23.0)
Requires-Dist: beartype (<0.15.0,>=0.14.1)
Requires-Dist: better-abc (<0.0.4,>=0.0.3)
Requires-Dist: datasets (>=2.7.1)
Requires-Dist: einops (>=0.6.0)
Requires-Dist: fancy-einsum (>=0.0.3)
Requires-Dist: jaxtyping (>=0.2.11)
Requires-Dist: numpy (<1.25,>=1.20); python_version >= "3.8" and python_version < "3.9"
Requires-Dist: numpy (>=1.24); python_version >= "3.9" and python_version < "3.12"
Requires-Dist: numpy (>=1.26); python_version >= "3.12" and python_version < "3.13"
Requires-Dist: pandas (>=1.1.5)
Requires-Dist: rich (>=12.6.0)
Requires-Dist: sentencepiece
Requires-Dist: torch (>=1.10); sys_platform == "linux"
Requires-Dist: torch (!=2.0,!=2.1.0,>=1.10); sys_platform != "linux"
Requires-Dist: tqdm (>=4.64.1)
Requires-Dist: transformers (>=4.37.2)
Requires-Dist: typeguard (<5.0,>=4.2)
Requires-Dist: typing-extensions
Requires-Dist: wandb (>=0.13.5)
Description-Content-Type: text/markdown
[Description omitted; length: 10751 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.5.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
transformer_lens/ActivationCache.py sha256=p2ClBVvIf7JeN39xvLvRs1lzbDMW5drWnF7PX0aGX9w 47877
transformer_lens/FactoredMatrix.py sha256=ROCO18BbJAJPpD6-_9IsZ6LI5F6gMCdbiaXDr6eu9kk 10303
transformer_lens/HookedEncoder.py sha256=YhkQCVTaIRWQ1B96Avi-qiJDlxSI7DVOAXYG9ffQC5A 15927
transformer_lens/HookedEncoderDecoder.py sha256=mxYK57y2WY2-Hr_rC9KiT8F-D4ETw2ZKI3yzDGxY528 17075
transformer_lens/HookedTransformer.py sha256=lTsP28pz4pOdBAN5T_FVbUdxTdi9eMsu7xhH1AbXq1E 121727
transformer_lens/HookedTransformerConfig.py sha256=OsAncQCbkHxfpnctgmiQD3fbbijkw6CraTFWgvpAvm8 20958
transformer_lens/SVDInterpreter.py sha256=kUZpGM-1ybeOYQtyAmFzMOnorMgqfIvIFYCNLkWiSzQ 6070
transformer_lens/__init__.py sha256=0jvYYs7zc-Kx2_bz2otUZhufeW6-RzyApc0muQPDswE 1030
transformer_lens/components/__init__.py sha256=DGX0AzNevkgbhfMTkW5-woz8Ktua4et1S4q3EIXYHls 1088
transformer_lens/components/abstract_attention.py sha256=VZrpYSYOopdoniPkjSqLpc6JrNQVdcqDVdaj_iRvGV0 33826
transformer_lens/components/attention.py sha256=FzcHIBINbekV2iNkWd5gGE0FTqWNIfNoYenrK0CWavQ 2658
transformer_lens/components/bert_block.py sha256=YYDrnCmLv4LvpRhv5Ef2bx-u87dZCL3_K56yHdL9dh8 3068
transformer_lens/components/bert_embed.py sha256=K3tpTNdVaIzx9PGpy6bQtLTklZb7ctH600ZPaD7B8ks 1995
transformer_lens/components/bert_mlm_head.py sha256=Kp8_mF-eWKhvu6T9KzEWj2nvwStMhm4atABBc8v7808 1412
transformer_lens/components/embed.py sha256=2m5u34eUuE3sFNT9QOj7pvxOJch8OHHFPe5CPNwt_7I 1247
transformer_lens/components/grouped_query_attention.py sha256=e-G4K2QkJIyT1GzQZf7S-SDc8IpzbK70JJl87qAenps 8061
transformer_lens/components/layer_norm.py sha256=ySRZLyCIE_2jbas5a-7Xi1jq5RVhIQF5MBp3FYevMhw 2016
transformer_lens/components/layer_norm_pre.py sha256=AdznFcZ-NDWbQhKmmRElmbKHkf1EY4JscNwvRiy5Kls 2264
transformer_lens/components/mlps/can_be_used_as_mlp.py sha256=H-vH8mKrEJgrPe1XGHP4rqIPUyAK6WxHn64hWT158Hc 2681
transformer_lens/components/mlps/gated_mlp.py sha256=tysva8MghQdYLbw6PdhQ6dpG29ybbaYKh2rsTJyVpjY 2863
transformer_lens/components/mlps/gated_mlp_4bit.py sha256=4aByWMjNDlTUCUAPTc9tFQcf8jBTcz2G-I0qJCkDYbw 2957
transformer_lens/components/mlps/mlp.py sha256=T6fcbFn7-CX0tYWZwKvfL-ACGWd372bWI-dAzfyZVWs 1952
transformer_lens/components/mlps/moe.py sha256=2nEPlCKjyUaVs2-RQ-4yHvNeXZbqalLa0tZS0dAhxyI 4931
transformer_lens/components/pos_embed.py sha256=Hdxm0nCXYiVekU6OYWmEWxEicQ37GRLkfm_AiaXMa2c 2627
transformer_lens/components/rms_norm.py sha256=rHEBkkIEiICR_jqOuh3htC2wqSCFMIpfXVJT4TdVfEQ 1655
transformer_lens/components/rms_norm_pre.py sha256=yYxGflSY2PcfMmKsPx1wUZWHpmqdwUmJmkQ3PeTsHuo 1288
transformer_lens/components/t5_attention.py sha256=HszbvlMJZyaaZWV8xKh50hZxu6pLfQhVhQjsmHJkWyU 6506
transformer_lens/components/t5_block.py sha256=kO9OwMs7q7rDQ7pXonODCq8VzzM9oQMvX8uK2wyXZ0I 6556
transformer_lens/components/token_typed_embed.py sha256=gGT0gPOs77HFtg_CcZPAPmPz9A8YhecrqQylbY9gFmM 1187
transformer_lens/components/transformer_block.py sha256=7Ok1LTPdSXXoXHwOqSgTTkIw-OzxyG6P1Qt-1t7kics 9747
transformer_lens/components/unembed.py sha256=lRYr52L_xDNSFC09f7NYfqBL8S1YYZg8GvRl8oMe0jE 1232
transformer_lens/evals.py sha256=8yy7Z1p-7DSqodp0cffhfqAPy2DQmm5hWhMvxvtVjMw 12680
transformer_lens/factories/activation_function_factory.py sha256=g-xFOoBRHqXW19cQmFkIE4dEV7Chn6p4MmT8VFz-hmA 1256
transformer_lens/factories/mlp_factory.py sha256=4ovm0ThWbQ_f2obH_906rj7wJY1Besa2evJFVOoE3wg 803
transformer_lens/head_detector.py sha256=2sYtWkTaViTwPgvXUFrYM-GH7IgzN6KuCkU2it5RocI 11868
transformer_lens/hook_points.py sha256=U22QKj24mMuGqxhY6OSmsSNx0ywG127VREDm9YMvYQc 26844
transformer_lens/loading_from_pretrained.py sha256=IzV2GM_tRdpZsVCJ-nueJ0jw8mOnd1WAml3BwlfyNaE 76580
transformer_lens/past_key_value_caching.py sha256=GplNJqyKmsvJ2onIllm-U4LEguQDcyqTPl3HgEUFJkI 4483
transformer_lens/patching.py sha256=yuze0wJGf9HIRdsN0UHZiQ1iebnOvJRewv2auidUxqE 33981
transformer_lens/pretrained/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
transformer_lens/pretrained/weight_conversions/__init__.py sha256=rfAQ5SvzH52i1Fc9igpztC3S8Szwlfcx6U_sU36IKqQ 820
transformer_lens/pretrained/weight_conversions/bert.py sha256=m3Yz4L6MnMRh9Zh5qlUKwrCW3WbmEEYfxqMy5cNVZQ0 3033
transformer_lens/pretrained/weight_conversions/bloom.py sha256=jagWToKjnDp1HLrFSLhEfc-qHWeBuuBhNqhOY4f6FvM 2714
transformer_lens/pretrained/weight_conversions/coder.py sha256=XD3kPprOLZFLmXhINrcDzR2eUGiG_2N4GRU3tQQuvdE 2781
transformer_lens/pretrained/weight_conversions/gemma.py sha256=b-FDZ4dk6KefXEXA53Ed9EfWoL-a38G-tvU09uECBtE 4426
transformer_lens/pretrained/weight_conversions/gpt2.py sha256=W4JtnUB1FPOvqeZF3y8UizOcujM5l94xYaXAXV4Hg2Y 2476
transformer_lens/pretrained/weight_conversions/gptj.py sha256=LO-pdDhvTHh7e2b00yB3lg1OKt8z3QRSXcmzmU2lqbc 2329
transformer_lens/pretrained/weight_conversions/llama.py sha256=d0V8Vo5ok2_Z36Krd1ypp4ijH5L01dNVO4bLA0A2ppc 3951
transformer_lens/pretrained/weight_conversions/mingpt.py sha256=2X_aMKwK6gXOWc_p403e9ID-6KnN5VXeBL2mEmakuhs 2777
transformer_lens/pretrained/weight_conversions/mistral.py sha256=iBqIpe1FM4bjXd60E-hBj4hVk31xc_b2qM0qPtGRdME 2498
transformer_lens/pretrained/weight_conversions/mixtral.py sha256=OnbMjTTQdaJPPPyt_0IfjJtEuQ_69CNLo5KUEj4NeXY 3086
transformer_lens/pretrained/weight_conversions/nanogpt.py sha256=p7SRBgh6oGQoIZD7MruY05R8f9KLnWyqOuOMLzKgDus 4131
transformer_lens/pretrained/weight_conversions/neel_solu_old.py sha256=aFK1cIANcNJPx1RdNVK2PkFWx9TIfuxvQLKOHBhTR3k 1379
transformer_lens/pretrained/weight_conversions/neo.py sha256=pvY1j0e1kP9UYV0IbMIXFVunHrfu8NHLt27O1Hx0wjI 2367
transformer_lens/pretrained/weight_conversions/neox.py sha256=9H4zuQ-cWg8fdsPdRISGapG0zVGn91hQPRi_VgctjF0 2693
transformer_lens/pretrained/weight_conversions/opt.py sha256=FzH7FLB6kRn3nMSyK5x7DqKWfZjHRCM3uzhD_hRsUbU 3396
transformer_lens/pretrained/weight_conversions/phi.py sha256=nl7ccydnrs1we2dHTHZo28sxxHUI7tVH6adCGxOJA64 2832
transformer_lens/pretrained/weight_conversions/phi3.py sha256=-ILkvYG6PPdhAAsbYj4JJ_qSuxD_1sSlSMLokZy0RZk 2421
transformer_lens/pretrained/weight_conversions/qwen.py sha256=EFTAyRgxaQZOXFAVYhUh3it7GZq6PCa-H-8lWML4jT0 2435
transformer_lens/pretrained/weight_conversions/qwen2.py sha256=EeHLcP1ldLy3L4HpU0lFWK8yCyvHSFdonfz2NXrdQwE 2877
transformer_lens/pretrained/weight_conversions/t5.py sha256=_CKfXj0a_suGBe15kWUUEgiFBh9pKPYV1OOhiy8gClw 4037
transformer_lens/train.py sha256=Zgm52Zywq6oGqqtjq_SeskFRbE0V_ycsQd0nkslo8hA 5556
transformer_lens/utilities/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
transformer_lens/utilities/activation_functions.py sha256=X1ihGaJsV46uDtqcT4eOb7u-rjudkwNCzQUGP3laLDc 798
transformer_lens/utilities/addmm.py sha256=fXWVoOjVpaO-sKExLOTiDSr24FqfS-LUMrM6jNuwU30 1175
transformer_lens/utilities/attention.py sha256=oMJjqu_yGrRSGxVClaEG-44enSjK-UG9F5dYRKAoaAs 1580
transformer_lens/utilities/devices.py sha256=s0EYKxwEa6_4irh4w2WI4uT553WyP_9U-ofrwX5ktMc 2559
transformer_lens/utils.py sha256=fzgPfquW4LUeq1-C3hJY3N6Eaq3J0qRx9BpUt2bRTso 52313
transformer_lens-2.11.0.dist-info/LICENSE sha256=RpJCJaoqcyXZ1L9HqK3ZQIRNjX4tNCpvB7ru6vS2akM 1075
transformer_lens-2.11.0.dist-info/METADATA sha256=JRelVKHi3bXWbaxqJOyMYYoetWNOVSgSHaigsc4v_W4 12280
transformer_lens-2.11.0.dist-info/WHEEL sha256=kLuE8m1WYU0Ig0_YEGrXyTtiJvKPpLpDEiChiNyei5Y 88
transformer_lens-2.11.0.dist-info/entry_points.txt sha256=ARpTI-jfiXF2sN70uC5vHorxWMJo8wOk7W8M7pdYWJU 103
transformer_lens-2.11.0.dist-info/RECORD

entry_points.txt

build-docs = docs.make_docs:build_docs
docs-hot-reload = docs.make_docs:docs_hot_reload