optimum-neuron

View on PyPIReverse Dependencies (1)

0.0.28 optimum_neuron-0.0.28-py3-none-any.whl

Wheel Details

Project: optimum-neuron
Version: 0.0.28
Filename: optimum_neuron-0.0.28-py3-none-any.whl
Download: [link]
Size: 393736
MD5: 94548ed28df09da1297caeaa041c30ad
SHA256: 039f1a0d90085ee1fc792f92655dc3fc2189925bb86472767bf4655d00f2078a
Uploaded: 2025-02-07 10:24:30 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: optimum-neuron
Version: 0.0.28
Summary: Optimum Neuron is the interface between the Hugging Face Transformers and Diffusers libraries and AWS Trainium and Inferentia accelerators. It provides a set of tools enabling easy model loading, training and inference on single and multiple neuron core settings for different downstream tasks.
Author: HuggingFace Inc. Special Ops Team
Author-Email: hardware[at]huggingface.co
Home-Page: https://huggingface.co/hardware/aws
License: Apache
Keywords: transformers,diffusers,mixed-precision training,fine-tuning,inference,trainium,inferentia,aws
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Dist: transformers (~=4.48.1)
Requires-Dist: accelerate (==0.29.2)
Requires-Dist: optimum (~=1.23.3)
Requires-Dist: huggingface-hub (>=0.28.0)
Requires-Dist: numpy (<=1.25.2,>=1.22.2)
Requires-Dist: protobuf (<4,>=3.20.3)
Requires-Dist: diffusers (<=0.30.3,>=0.28.0); extra == "diffusers"
Requires-Dist: peft (>=0.14.0); extra == "diffusers"
Requires-Dist: wheel; extra == "neuron"
Requires-Dist: torch-neuron (==1.13.1.2.9.74.0); extra == "neuron"
Requires-Dist: torch (==1.13.1.*); extra == "neuron"
Requires-Dist: neuron-cc[tensorflow] (==1.22.0.0); extra == "neuron"
Requires-Dist: protobuf; extra == "neuron"
Requires-Dist: torchvision; extra == "neuron"
Requires-Dist: numpy (==1.22.3); extra == "neuron"
Requires-Dist: wheel; extra == "neuronx"
Requires-Dist: neuronx-cc (==2.15.143.0); extra == "neuronx"
Requires-Dist: torch-neuronx (==2.1.2.2.3.2); extra == "neuronx"
Requires-Dist: transformers-neuronx (==0.12.313); extra == "neuronx"
Requires-Dist: torch (==2.1.2.*); extra == "neuronx"
Requires-Dist: torchvision (==0.16.*); extra == "neuronx"
Requires-Dist: neuronx-distributed (==0.9.0); extra == "neuronx"
Requires-Dist: libneuronxla (==2.0.5347.0); extra == "neuronx"
Requires-Dist: ruff; extra == "quality"
Requires-Dist: isort; extra == "quality"
Requires-Dist: sentence-transformers (>=2.2.0); extra == "sentence-transformers"
Requires-Dist: pytest (<=8.0.0); extra == "tests"
Requires-Dist: psutil; extra == "tests"
Requires-Dist: parameterized; extra == "tests"
Requires-Dist: GitPython; extra == "tests"
Requires-Dist: sentencepiece; extra == "tests"
Requires-Dist: datasets; extra == "tests"
Requires-Dist: sacremoses; extra == "tests"
Requires-Dist: diffusers (<=0.30.3,>=0.28.0); extra == "tests"
Requires-Dist: safetensors; extra == "tests"
Requires-Dist: sentence-transformers (>=2.2.0); extra == "tests"
Requires-Dist: peft (>=0.14.0); extra == "tests"
Requires-Dist: trl (==0.11.4); extra == "tests"
Requires-Dist: compel; extra == "tests"
Requires-Dist: rjieba; extra == "tests"
Requires-Dist: soundfile; extra == "tests"
Requires-Dist: librosa; extra == "tests"
Requires-Dist: opencv-python-headless; extra == "tests"
Requires-Dist: controlnet-aux; extra == "tests"
Requires-Dist: mediapipe; extra == "tests"
Requires-Dist: timm (>=1.0.0); extra == "tests"
Requires-Dist: trl (==0.11.4); extra == "training"
Requires-Dist: peft (==0.14.0); extra == "training"
Requires-Dist: neuronx-distributed (==0.9.0); extra == "training"
Provides-Extra: diffusers
Provides-Extra: neuron
Provides-Extra: neuronx
Provides-Extra: quality
Provides-Extra: sentence-transformers
Provides-Extra: tests
Provides-Extra: training
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 11674 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.45.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
optimum/commands/env.py sha256=ieqShKfmpx_6PW8K-5sUHtwjwJJOdhew8ThHVQCoHFs 3733
optimum/commands/export/neuron.py sha256=tvjQorvtml2vT1zgzGVqepXeP0wi4UIrUlcUOXloadI 6766
optimum/commands/export/neuronx.py sha256=IvodlIPZRRVdvCbDnV7CYoUW0hS9sHIJHtz351JQsP8 11399
optimum/commands/neuron/base.py sha256=DAknFZXjZ7i6xpc8-BDqKJqbRduzI9tdmSV9rTU-7S8 1428
optimum/commands/neuron/cache.py sha256=ohppAbjp47SV-ezpvwQ4cUxreI2WMrM_IifKLQRbi9k 9512
optimum/commands/neuron/subcommands.py sha256=FjpqNnirZpSL26CBmKZqW_6mrqK7vt_5enVW0LEwwz8 2212
optimum/commands/register/register_export.py sha256=si-xU0xUyJlvTsYl_9daUp9268CDkNeIdeMPvtwTl60 1270
optimum/commands/register/register_neuron.py sha256=IaNP3BYz2hNGD1onJUtuoslk1vl9a13LFGRINVi7QQc 755
optimum/exporters/neuron/__init__.py sha256=447lri_nGBvNzuhuDAnelW_wZ7Jym4Jffc9FiO_8jgc 2138
optimum/exporters/neuron/__main__.py sha256=sro8edGWHNM7xMrek3_XrhBwRx7m7NyhjoUURlnOILI 31497
optimum/exporters/neuron/base.py sha256=ydUKQyNm6dzPj4IYE26BywnZjVC5MkNF-gswh1fLAMo 17513
optimum/exporters/neuron/config.py sha256=YN2X-CjCIf6TikbvPv8XX1qOaxS9NTM_TnxCcIjJYqA 3290
optimum/exporters/neuron/convert.py sha256=W2Y9AK_-68PVNyo7_e-iDj-EVYyW2qkuyGalrmaDM0g 35143
optimum/exporters/neuron/model_wrappers.py sha256=ResiLlDkcxpMXFP4VDfjE24oyueSrk6yAhgGZ_aYhlY 24926
optimum/exporters/neuron/utils.py sha256=XakQ04HZGSgAaIVItGx7qap_m1USGI6POocIYMs3LMU 27954
optimum/exporters/neuron/model_configs/__init__.py sha256=oj8AGMWPDI_Zsp11_yO4oyxV1m95zL-NEndkZp4s-ok 849
optimum/exporters/neuron/model_configs/decoder_configs.py sha256=XUBq-dm7Etbj-wZuiK3EEtx1ExuAVHpjejJww26NMHY 6557
optimum/exporters/neuron/model_configs/traced_configs.py sha256=S2UdWybhT4rP_mp1x_s6tleorP_KAeIwwFIaLn6qWMw 35888
optimum/neuron/__init__.py sha256=303PEoscbFKOLZAeQxRafozfaJ8bGlJvJZDKeCiBUIs 5023
optimum/neuron/hf_argparser.py sha256=uhE1LIYZ9EPDnMjp-5CnQrGbkWzTqPPe45QxiJ6Ezj4 2337
optimum/neuron/modeling.py sha256=zTTxCnD4FnTMXG9KUN6AeK3Xc_LGoXz96n0fuKSVDsA 58296
optimum/neuron/modeling_base.py sha256=0JQCjTWVzBUR8P7vS_MFahumUgqnnF_qEdQlb9bMZ2k 1368
optimum/neuron/modeling_decoder.py sha256=TEq73pCMY12NgqJwXGUQmU0Ne79y7-HyB8067Ewd8tk 18884
optimum/neuron/modeling_diffusion.py sha256=_78GnNYweigQbZoPnAQHgV--6w-Qn1o2d4SUsXP3BP4 72196
optimum/neuron/modeling_seq2seq.py sha256=s2a_VVahDWCW_es1Escf9zUln-rUSXHPjbAnU2W50P8 28562
optimum/neuron/modeling_traced.py sha256=xZ8BQ4Mcjao26m6DVLvlaTcTZWxd5uiS-ht5duHCROY 26583
optimum/neuron/trainers.py sha256=dsC0x2n0T7GqQFjbb49RGdRSavyf-7IbNNUVXQvniCI 104134
optimum/neuron/training_args.py sha256=7Z95cFVcKMiiuI80Q2NECA8wR5wNGbP09sDLrM9YnUQ 11250
optimum/neuron/version.py sha256=cVGiXjbGTzhvRPCN3Ad6uRtyIgSD2iMytyN3r6HYS2E 668
optimum/neuron/accelerate/__init__.py sha256=JwvqTR4LIX2i6yV8goGNj8k_rqj35-cRpl46lrcwn_c 809
optimum/neuron/accelerate/accelerator.py sha256=cPgoLnBZG6OtAVV0yNvjRFimemjxdQZR9oFqjVXGVZQ 31155
optimum/neuron/accelerate/optimizer.py sha256=3FaxRcDgb8cAYLA_FDylsm6zetPSLNjwFyp_7bsztuQ 6270
optimum/neuron/accelerate/scheduler.py sha256=YtoYfYZLbbVhGbIY30Wy6OpTfK1Xr_JEaT9QXgiQJAI 2212
optimum/neuron/accelerate/state.py sha256=R-nFLfxtS4Y5uld_NrXhYlSR27cGuwF9-b1LzqMwqYc 10757
optimum/neuron/accelerate/utils/__init__.py sha256=zoGlRKENM4Dq3VdV1Eh1eCjKsiOW0ULMWqWGln8f0dQ 790
optimum/neuron/accelerate/utils/dataclasses.py sha256=wwW9mPW8Lo6XQZMu2cUmjIN0N5Pm2qjHCAxkk8XXhSc 3561
optimum/neuron/accelerate/utils/misc.py sha256=uGI9Q6_j4r4XB2KLQFMKB94OOHi6nhaiiDna7jUDXq0 8885
optimum/neuron/accelerate/utils/operations.py sha256=M_IfB3Afe6-49LkZBP9PyyyZGf-Mk0ICnTbEd8BYMss 2541
optimum/neuron/backends/hlo/activations.py sha256=9gq6xCue2_Q9UZKJ_oft-UjztIzFIacJL8jcToXFop4 1292
optimum/neuron/backends/hlo/base.py sha256=nn2yobU8LzpOkhphYuQ-AN7KnmGhl-8hH1I6XWQaLS0 6324
optimum/neuron/backends/hlo/compiler.py sha256=zq9JEeMaqawTVBjyCiMHWvaXfNUHQ7G7JDxCLVuurd4 24559
optimum/neuron/backends/hlo/config.py sha256=yJPlI35fGPFoXxfdMean2SNkDKa87MivqVI_5IPvnuk 8018
optimum/neuron/backends/hlo/decoder.py sha256=8Dy0t1diqfPvMtJRgkOiAklCFN49bcwK4gdD9PW1His 56951
optimum/neuron/backends/hlo/dtypes.py sha256=Bfj-UplOspP5AcSTtIxR2go4bYhRj6m2CvCDUAPsuMs 1319
optimum/neuron/backends/hlo/functional.py sha256=vXQQE32lmKCeH266upLdW5vxT8VhjWvOKRM_O-jWo7I 61271
optimum/neuron/backends/hlo/module.py sha256=S3BRZT1R2FeQaATzzh-Zqe_P_CxxGNEVh4kFKWPlsOM 17407
optimum/neuron/backends/hlo/nki.py sha256=I66e3V-aOOUgwy2la4s1cULuQR8a-sFSTisCeEWgU0U 5331
optimum/neuron/backends/hlo/ops.py sha256=AHo8FzLT2e5OsjEeDEqlh9einZw0AV9U_VA63A5zJgs 2205
optimum/neuron/backends/hlo/parallel.py sha256=4p3FemxzGjcFlbXsmtlZQ8dIiR3elHU75EKwdMTmCOM 3865
optimum/neuron/backends/hlo/utils.py sha256=iRq1wJ22eqMlLuc3ORS0xGvlUfZ6N5Taqjs53yZUIyg 10002
optimum/neuron/backends/hlo/layers/attention.py sha256=fpyVam_OOLH9nc7XIDUHG9G8FhchLeZ8ebCK7F5PhEE 26659
optimum/neuron/backends/hlo/layers/rotary.py sha256=HNiqjUplbt86Y1dbwPly2y5z52Plm4ARAH9nLRmJMEU 6964
optimum/neuron/backends/hlo/layers/transformer.py sha256=Tbj-N0MNAyPvi1EX-eTLl1bCRtI-ns9Z_X469aokTVw 6084
optimum/neuron/distributed/__init__.py sha256=xFkzJY8yznzd6Xqyn8r84I2JQbVHUPuz1rGGUpzg640 933
optimum/neuron/distributed/base.py sha256=V9yeBKePs2T_14YQeqzx6BGeN9GqWcfQgg7b-Wtud6M 52081
optimum/neuron/distributed/checkpointing.py sha256=9ywmnz6yyYxaI63eu7y7Z4-v3R6wjd8SEbNcbQ58k7g 11486
optimum/neuron/distributed/decoder_models.py sha256=slfmOBVr-O1Z_PNLQBLvV3737Wp4Sq4crTnEBIJ-bsU 36168
optimum/neuron/distributed/encoder_decoder_models.py sha256=mFfv6sq3MgOEdC27yDcutCbTuguoYeZ-HPMxeFhU8sc 18218
optimum/neuron/distributed/encoder_models.py sha256=4ZU8m0caMw5TPbWT1FP4RkmRf0t4mnSQ2JBnxv_icwg 11898
optimum/neuron/distributed/parallel_layers.py sha256=xhPkGvmN76q84tvhEJCjnz3jPQj8ii8DaVGchDVENnM 54381
optimum/neuron/distributed/parallelizers_manager.py sha256=ZUzRr-qe4Win64JhZ9_OkbFkGisQY-OhLP4U5SnNr5A 5326
optimum/neuron/distributed/utils.py sha256=M7ge3PXnmWQGSOqvla5C37LvSpG39PTOQdYhPLors0g 76550
optimum/neuron/generation/__init__.py sha256=QEDIn7WV8p3d25XlOcEe9poqe-mt69PDZ1yV_hiSu0k 786
optimum/neuron/generation/logits_process.py sha256=m2a8cFq589UumoC3ercmZ0kGjIaYHO4dmpQwOaABw5A 3862
optimum/neuron/generation/token_selector.py sha256=1b74RA7hXXoe-hQcqWORb4q-5nWsM7q-AZbP2MMm5b4 9268
optimum/neuron/generation/utils.py sha256=WKxUApCqlMjYIKOwxkLJLqVAwUSHHf2UN7mfE2LtlKQ 83583
optimum/neuron/models/__init__.py sha256=TGVQwFyxkb7pGSbC0fq2wFHHY-agemZr4UFi6bgpK0U 621
optimum/neuron/models/granite/__init__.py sha256=TGVQwFyxkb7pGSbC0fq2wFHHY-agemZr4UFi6bgpK0U 621
optimum/neuron/models/granite/hlo.py sha256=rMoH_1MxvbAPyP6UdIRJPcbkOIFTO2a8DJ-ktMIz4Zk 10676
optimum/neuron/models/granite/model.py sha256=ojx6yM5NBkntzdfrHvNvb2vQq7-PWTB55Ox1iQbTPQ8 1865
optimum/neuron/models/granite/modules.py sha256=ez_gtTUFB2oBgo-BmvjTFINBGeIc9ZxPRaVDDuT_cWc 3526
optimum/neuron/models/llama/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
optimum/neuron/models/llama/hlo.py sha256=CiYDFq7PQr6H3oe5n3IT0z1AtdBrUUX4Uqu4RdseOSQ 11733
optimum/neuron/models/llama/model.py sha256=wX-52ugwP13ULtpjSt66wxIY32t5xratD0UwIjBU4Yg 3848
optimum/neuron/models/llama/modules.py sha256=W6DDS9RmdkWAcerOqFhy0DegPyf3F9nSfNeiZLyFOII 3167
optimum/neuron/models/qwen2/__init__.py sha256=TGVQwFyxkb7pGSbC0fq2wFHHY-agemZr4UFi6bgpK0U 621
optimum/neuron/models/qwen2/model.py sha256=xfCbon0FnxpHrjN-HkFWnpJw9VnoprQ3UbxJNjC0Kko 1504
optimum/neuron/models/qwen2/modules.py sha256=g8gXZmuN-KDoajLZeUDsQHIFvwwtlSlaNQ2MA0wOrvg 2751
optimum/neuron/pipelines/__init__.py sha256=TqfFMj-WOJQCEepPesEEJFKKasPhF-ivY8VVDw__B6o 1371
optimum/neuron/pipelines/diffusers/__init__.py sha256=9PG4dT13AaYLM612COpw0p6wD3Zglmq_tuxugDHv9LM 850
optimum/neuron/pipelines/diffusers/pipeline_controlnet.py sha256=D2smmWC-XJrppUboaa4lDW3_wjzChcMKuKXrMWgy4wI 25082
optimum/neuron/pipelines/diffusers/pipeline_controlnet_sd_xl.py sha256=31PmICVptkwe10FxmevxJL6f5zE_neiCLmELFt8miag 34436
optimum/neuron/pipelines/diffusers/pipeline_utils.py sha256=9T8klNp1xs76_yNzMzgD91fM-MW73k8OQoEanNL990g 3246
optimum/neuron/pipelines/transformers/__init__.py sha256=RXpHlx0tILCeYroRAx0jlNBQztPJnTxbF4zwn4zRbVI 658
optimum/neuron/pipelines/transformers/base.py sha256=aW5cN3WFnusCyk37adr97xYM8V1eWM3UtkIBs8sXMfY 12348
optimum/neuron/pipelines/transformers/sentence_transformers.py sha256=eXKHzM_l8vPaE_W4X1PqofVAm5c2abTxvmjJ-WWJC7E 3546
optimum/neuron/utils/__init__.py sha256=j2lRSTNnkTR3j1v-EKkY0fudLFWLRIFah7CRAUZYnG8 4952
optimum/neuron/utils/argument_utils.py sha256=G5sBLBGaFXqg1DQjFTqxh3YgA_DiBhtr3X8zGmv-m6E 7877
optimum/neuron/utils/cache_utils.py sha256=QGxXxD3oio6dz8Ou-KNC8A_CU6TyZ1Lf9xwYg1bhmwk 10740
optimum/neuron/utils/constant.py sha256=jE8HU1nszV5xYEfehXWQ_qBhpIR2v4o5YNDuBjIoNfo 1132
optimum/neuron/utils/deprecate_utils.py sha256=ML7shIzgsPRTAJGzorIZ8eOAAJQ1HevSZeuh8cGp_RQ 2720
optimum/neuron/utils/hub_cache_utils.py sha256=DvyNDcc53T72NZrnrO9ba9qjjXZrIhLWOejo7pCP0pc 23471
optimum/neuron/utils/import_utils.py sha256=MRirt0nDWs_TSgPnCCR3nwhM918IE-j9r_LvabFY3_0 3055
optimum/neuron/utils/input_generators.py sha256=Hn6ZK6v7qQePw2jIQLzHKvBAAhxf6I98Ss7u17KaT0c 7521
optimum/neuron/utils/misc.py sha256=cujyUldCwkk5fAqsAi62atx1s84zP8IffGgNTCmq0QU 30986
optimum/neuron/utils/model_utils.py sha256=UeF7qFCjcvlQsI5WyIVsLmKXKEtA0hu_sKGjJPeiXwE 3214
optimum/neuron/utils/neuron_cc_wrapper sha256=kHMw49tfWp0CtEzGEAyQTxrejAatk4ejALBkw3-8p9s 250
optimum/neuron/utils/neuron_parallel_compile.py sha256=uAmT7JgLeQF2E-hk1xnzCXxBsQ5bwLowNHp4cIOVFf8 1290
optimum/neuron/utils/optimization_utils.py sha256=Tq2pFGqySFb2V_tC6BYZUIlxvwJ3ItR1ZACXWslUPiQ 3065
optimum/neuron/utils/optimum_neuron_cc_wrapper.py sha256=QKto-cp9-2R3xoWIuvbVgpd1_P0YpLcy0Yed_eNXVKw 1027
optimum/neuron/utils/patching.py sha256=jaO4otCwrMqiy_IsaPFSzTZXDWfbFzzBlWplwiWXNSk 9255
optimum/neuron/utils/peft_utils.py sha256=-swE4JqDnbx_rgCoZ4XTnZK9OLtD9uZ2x1DrNwYQOOc 13081
optimum/neuron/utils/require_utils.py sha256=iR1Hkz7etd7tMIke5P4JA5MwTH11xqSOFmKYjFO8Hfo 2326
optimum/neuron/utils/runner.py sha256=K6XDlJS2BYImTTzj_UmpqdF2MtqvfFqgM5kD8ZlIkik 25666
optimum/neuron/utils/testing_utils.py sha256=BZTw0yig6fc8cWXWBm-cwFLtUELOAEIYUP1wCb2HVk4 1644
optimum/neuron/utils/torch_xla_and_neuronx_initialization.py sha256=_-WBgb7BWTmDRzd2aBhn2HaJZevM3xOMgo3HBLPTra4 4043
optimum/neuron/utils/training_utils.py sha256=9787Fhby_XjfTJxwciCt8jyEfFbyiiwXxuxKGQNIbUM 11307
optimum/neuron/utils/trl_utils.py sha256=bKoAOKW2QZKcQILkF9z7xkNCWWjljcie3d0bXbe5kVg 1531
optimum/neuron/utils/version_utils.py sha256=N9Vf7dyyIbu6BSCtqUdxmL3abVClX0YTJNoOil38Dvw 4378
optimum_neuron-0.0.28.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
optimum_neuron-0.0.28.dist-info/METADATA sha256=vLelXiu9OdoQyxLeXBU2yo48iQ2Uqys-EBeqeBAL2C8 15435
optimum_neuron-0.0.28.dist-info/WHEEL sha256=tZoeGjtWxWRfdplE7E3d45VPlLNQnvbKiYnx7gwAy8A 92
optimum_neuron-0.0.28.dist-info/dependency_links.txt sha256=4v7Jf0ylcHEOE-oPSq6kbH5Pk7kl196QnJjeV89UF4c 39
optimum_neuron-0.0.28.dist-info/entry_points.txt sha256=sgPkvCyde_KUZXpAF6hN7pzOBej-8BevY3PdTmzeYoI 142
optimum_neuron-0.0.28.dist-info/top_level.txt sha256=rc1rV-uPZnV1Ek7hCwh56pvMCKcip65JbHRRWs8Yqu8 8
optimum_neuron-0.0.28.dist-info/RECORD

top_level.txt

optimum

entry_points.txt

neuron_parallel_compile = optimum.neuron.utils.neuron_parallel_compile:main
optimum-cli = optimum.commands.optimum_cli:main
https://pip.repos.neuron.amazonaws.com