vocab-coverage

View on PyPIReverse Dependencies (0)

0.9 vocab_coverage-0.9-py3-none-any.whl

Wheel Details

Project: vocab-coverage
Version: 0.9
Filename: vocab_coverage-0.9-py3-none-any.whl
Download: [link]
Size: 2897309
MD5: 72d333816e60cd3274c00de0c25e5008
SHA256: 8c196dfd23ced91f688fe0d1e5d86c84e7bd186be386f03baec9a352a31f6c75
Uploaded: 2023-09-09 10:24:42 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: vocab-coverage
Version: 0.9
Summary: 语言模型中文识字率分析
Author: Tao Wang
Author-Email: twang2218[at]gmail.com
Home-Page: https://github.com/twang2218/vocab-coverage
License: Apache License 2.0
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Scientific/Engineering :: Information Analysis
Classifier: Topic :: Text Processing :: Linguistic
Requires-Dist: Pillow
Requires-Dist: protobuf (==3.20.0)
Requires-Dist: sentencepiece
Requires-Dist: tiktoken
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: beautifulsoup4
Requires-Dist: bs4
Requires-Dist: pandas
Requires-Dist: requests
Requires-Dist: scikit-learn
Requires-Dist: accelerate
Requires-Dist: openai
Requires-Dist: python-dotenv
Requires-Dist: umap-learn
Requires-Dist: einops
Requires-Dist: transformers-stream-generator
Requires-Dist: cudf-cu12; extra == "cuml"
Requires-Dist: cuml-cu12; extra == "cuml"
Requires-Dist: harvesttext; extra == "datasets"
Requires-Dist: matplotlib; extra == "datasets"
Requires-Dist: cmaps; extra == "datasets"
Provides-Extra: cuml
Provides-Extra: datasets
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 99577 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.38.4)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
vocab_coverage/__init__.py sha256=z7zgBL4g_hjAzaceEbyksHZMWWq8ym8rwXxmgSJ8oMw 278
vocab_coverage/cache.py sha256=ZM0pCN8ftk91qLbNCvLYUanLoVVqeHF0OFNdJXggCV0 2193
vocab_coverage/charsets_char.json sha256=71PPO4xR_DZK_ZWsYocGR-ZBaLbFX7EuYA5aL-SD7X0 149537
vocab_coverage/charsets_token.json sha256=SyBInPu8GdsS1DhIBGb2qf9qWtRNMtc7ls5B_-9b0Ik 229005
vocab_coverage/classifier.py sha256=ykqC1UzdpCSSO0cKEACTQl_-U53bdrbPBAZ4VddRdx8 4966
vocab_coverage/constants.py sha256=EaeJfZBcrt_695naaODO1F1_YnJBheE9E6gIeboBpbs 5536
vocab_coverage/coverage.py sha256=WHwf_4HymZonzG0mneAoZ7Ec6j85CP614Lb7Gxmm4ZY 5261
vocab_coverage/crawler.py sha256=l_NRU0cnBVKzOSsWBV_CZB3mg3llxkphxcFUDg4ZaLE 15854
vocab_coverage/dataset_sentence_long.json sha256=5VeG927T2HEuIGEb36F1EbyTyFfq8otXWoyfqDlVg3Q 4474089
vocab_coverage/dataset_sentence_short.json sha256=k6VAkoiNVItxcVjMZn59WiBvzLaQC_HS9ei_OuKeA44 1086843
vocab_coverage/dict_word.json sha256=F7I5m51m41WJw9eZVvDMfxSiy97gwWn6vv0htUkQX_I 163066
vocab_coverage/draw.py sha256=LBHAWXOYW42PXHiaIMb8GxSxdH4MMW_m-jt6w6ffs4s 17233
vocab_coverage/embedding.py sha256=0xYhipAPJPA6fEyUSe38oBOCBQ-0QEVwOtkRbDoQdmo 20615
vocab_coverage/generate.py sha256=EwsHW1IWB0YsV6i8MXpZLzx0l0ehGzwm2XHczmPkb1E 31205
vocab_coverage/lexicon.py sha256=CCeOrE9M6nL4AwgCrkf5tPwrQzWFaC4Xnm2VtAd9A2M 6607
vocab_coverage/loader.py sha256=ZYjEVXblg__16pAj_T2ycj_bURI2gUMyxlDtwzIwrxU 10636
vocab_coverage/main.py sha256=-IIqLChqkdrxJK2T3802DyZcXQH61u5xtmBO4XugUBA 4738
vocab_coverage/models.yaml sha256=elcwu4IywUSX-iQ_npqTE8mew1AeOEabbUcmdT1WAqw 7464
vocab_coverage/models_readme.yaml sha256=YxeKFJDL5-8d4Whfj1IDUXP8nnX3VxO1fMe1OGUIJzo 1328
vocab_coverage/reducer.py sha256=bGfehZW2_zHxnkFCobnHzkfMPriacmAupQOFIGf9_Do 8246
vocab_coverage/utils.py sha256=bsq3PPp-eK_zHmaoW4CnstrOCeUSRd-EkhPAJGO_Bzo 5660
vocab_coverage-0.9.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
vocab_coverage-0.9.dist-info/METADATA sha256=di39-cyWWgBMOfqzsU5c_s9qfVPV8RCxmqF7u7AMC-A 115504
vocab_coverage-0.9.dist-info/WHEEL sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo 92
vocab_coverage-0.9.dist-info/entry_points.txt sha256=5BjaWrrZfQdYAUE34gLKZSO7SciGAj05iCq5dJqLOdM 56
vocab_coverage-0.9.dist-info/top_level.txt sha256=iJi6LebW6di2xJ9dM8sk0cgxzofyFLxhUdMvaOSp8ZY 15
vocab_coverage-0.9.dist-info/RECORD

top_level.txt

vocab_coverage

entry_points.txt

vocab-coverage = vocab_coverage:main