Wheelodex » Projects » yvestest

yvestest

View on PyPI — Reverse Dependencies (0)

0.1.3 yvestest-0.1.3-py3-none-any.whl

Wheel Details

Project: yvestest
Version: 0.1.3
Filename: yvestest-0.1.3-py3-none-any.whl
Download: [link]
Size: 76012
MD5: 98c32393ee44c4d9365f889d1b21b054
SHA256: 7d66033be7c695aea3b0e36c778fe98a138ee645d89b542876a069a9fcfc5c87
Uploaded: 2024-02-07 13:11:25 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: yvestest
Version: 0.1.3
Summary: An open-source simplifies ETL workflow with Python based on Spark
Author: Dataverse Team
Author-Email: 77601251[at]daum.net
License: MIT
Requires-Python: >=3.10, <=3.11
Requires-Dist: aiohttp (==3.9.3)
Requires-Dist: aiosignal (==1.3.1)
Requires-Dist: antlr4-python3-runtime (==4.9.3)
Requires-Dist: attrs (==23.2.0)
Requires-Dist: boto3 (==1.34.36)
Requires-Dist: certifi (==2024.2.2)
Requires-Dist: cfgv (==3.4.0)
Requires-Dist: charset-normalizer (==3.3.2)
Requires-Dist: colorama (==0.4.4)
Requires-Dist: courlan (==1.0.0)
Requires-Dist: datasets (==2.16.1)
Requires-Dist: dateparser (==1.2.0)
Requires-Dist: Faker (==23.0.0)
Requires-Dist: fasttext-wheel (==0.9.2)
Requires-Dist: fsspec (==2023.10.0)
Requires-Dist: html2text
Requires-Dist: ipykernel (>=6.29.1)
Requires-Dist: ipython (>=8.21.0)
Requires-Dist: numpy (==1.26.4)
Requires-Dist: omegaconf (==2.3.0)
Requires-Dist: pandas (==2.2.0)
Requires-Dist: py4j (==0.10.9.7)
Requires-Dist: pyarrow (==15.0.0)
Requires-Dist: pyarrow-hotfix (==0.6)
Requires-Dist: pyspark (==3.5.0)
Requires-Dist: pytz (==2024.1)
Requires-Dist: regex (==2023.12.25)
Requires-Dist: requests (==2.31.0)
Requires-Dist: scipy (==1.12.0)
Requires-Dist: tqdm (==4.66.1)
Requires-Dist: trafilatura (==1.7.0)
Requires-Dist: awscli (==1.32.36); extra == "all"
Requires-Dist: black (==22.12.0); extra == "all"
Requires-Dist: awscli (==1.32.36); extra == "aws"
Requires-Dist: botocore (==1.34.36); extra == "aws"
Requires-Dist: rsa (==4.7.2); extra == "aws"
Requires-Dist: s3transfer (==0.10.0); extra == "aws"
Requires-Dist: black (==22.12.0); extra == "dev"
Requires-Dist: isort (>=5.10.1); extra == "dev"
Requires-Dist: flake8 (>=4.0.1); extra == "dev"
Requires-Dist: pytest (>=7.4.4); extra == "dev"
Requires-Dist: pre-commit (==3.6.0); extra == "dev"
Provides-Extra: all
Provides-Extra: aws
Provides-Extra: dev
License-File: LICENSE
[No description]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
dataverse/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/api/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/api/cli.py sha256=XC2d2PBjlCvVDjwL16IZeO5b4KfbcsVh5GecpQ36u-o 413
dataverse/api/emr.py sha256=yclJdmwbEbkQcSRbbw8wTiPg8QBEQdf3CSETrluCrg8 1350
dataverse/config/__init__.py sha256=pMSFHIzM8VhlUucLswiBhSGm9efPbOA9yqP0XigP9U8 30
dataverse/config/interface.py sha256=X2MsDvaWjERDGraRc5bnSFr9OrE_L_Q8Rb1qJnLaytQ 6923
dataverse/etl/__init__.py sha256=pST076vRaTjGNG8-i7UHeBOLsKnbbxC1awplHaNyEbY 133
dataverse/etl/pipeline.py sha256=c3QMqELLB2UMJI_qaHgYJW-XxCB0Nm56cIgQqiSd3sM 14344
dataverse/etl/registry.py sha256=KeVrqmC_etdrVw5pFRcQ7zFAssxVCmC7vsAS7UPwAuA 10663
dataverse/etl/__sample/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/__sample/ducky.py sha256=mAYV3iSjKJyMCZzKXkm7BTTcsKzH3BVB_fH3H64R1mA 374
dataverse/etl/__sample/github.py sha256=NvZbBE8IMz7a0UD-vwSCZUYOaqBIgPQ8bTxF6VfC9Ew 1437
dataverse/etl/bias/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/cleaning/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/cleaning/accent.py sha256=lv3XzCMBHD9QN2LcL7x9acPPvhi7R_xg9NhPF4f6Tek 1256
dataverse/etl/cleaning/char.py sha256=iGhu6Dmv3VMfr9bsc5n4lwSrXHv0fvKITXci6t6dn94 1978
dataverse/etl/cleaning/document.py sha256=eVfW8LHqSY8Cbu5uxCoq4AcH1qlHfJU-UBJwPOuvYMk 1719
dataverse/etl/cleaning/html.py sha256=TLma6WhL3KgVGe64yx-bqlfRxTfnhW4L8zLKS91orBA 2092
dataverse/etl/cleaning/korean.py sha256=Xg6sRMx8NmQPKDnA_dYl04wMJWDaCiBFZeHH3uEGF4Q 8621
dataverse/etl/cleaning/length.py sha256=IJChGzpDdRYK6SFn_gB60oSrV7VWo2FIn3TaBCNyo9E 2308
dataverse/etl/cleaning/number.py sha256=L_FvFbKD5ZH8YbSuMEa-5iP-sXGd6jNT20gp5CaS3l0 1224
dataverse/etl/cleaning/table.py sha256=P4SR3edAjuHHQjgAZx2Vox9hDb-aCXEMHaUdyscKoNY 1520
dataverse/etl/cleaning/unicode.py sha256=qRaMEsTRCY3Cgh6sL1PXpYYAMp6w-3_GE4-akkHy0u4 2780
dataverse/etl/data_ingestion/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/data_ingestion/arrow.py sha256=MQupMYsNTB0SGsbSY9PnUkQSazbAb4pJChaOTOO9PX4 5251
dataverse/etl/data_ingestion/common_crawl.py sha256=p-C6jr-0VCkAafSyfVk5OoaqQ1TQVtCQ2gJXyIudsUs 14442
dataverse/etl/data_ingestion/csv.py sha256=n1lERs_gvkyA2Nuull5r7hiJ0fyXSc6PgjHxX9YNSB0 800
dataverse/etl/data_ingestion/cultura_x.py sha256=8lap_qISzT4fRaowvJJbMqyLDqSnFhmy2vMwhhr9pu8 720
dataverse/etl/data_ingestion/huggingface.py sha256=kA-uO9dTwlBhvJUCDOejv1z5_9Agjx1FXHjKZQlTtlM 1283
dataverse/etl/data_ingestion/parquet.py sha256=y4l30JGFYQ7tlpwhkYHfRhJerUntRrHqMEYX2y6A26I 594
dataverse/etl/data_ingestion/red_pajama.py sha256=-r1XEyhI83RpvE2qxgHksJghWG0wBq39W7_WMLmGwVA 3633
dataverse/etl/data_ingestion/slim_pajama.py sha256=aRQaTyj1cA0BsMtHYhk31x91VDYffthu9Dl7tK5hfts 1702
dataverse/etl/data_ingestion/test.py sha256=tbffuQwohZtZH6yzhrMuHfMPhgECQwOMf2oimsx_4X8 1340
dataverse/etl/data_load/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/data_load/aws.py sha256=COi2ET_ZISoOM_SxbPB7RzK7_k39LXecwqfqmPteFDk 55
dataverse/etl/data_load/huggingface.py sha256=qhMgKKC_hIMmlg_9ptng9VAq4sz2cGScqYvF19Tg3Y0 1461
dataverse/etl/data_load/parquet.py sha256=roBFvO9uPlC56o8bGpijTxZc9eCIKzrHvkTsJnovloU 675
dataverse/etl/decontamination/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/deduplication/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/deduplication/common_crawl.py sha256=k1_gwLm5j-JyN4yECtoJ7L_wGhVbsJeg53B2s9XgS7I 2120
dataverse/etl/deduplication/exact.py sha256=98r59-Xrbz6y12YkpQ9AnHeTTdf7KkNDOfOoBJIvR6U 582
dataverse/etl/deduplication/minhash.py sha256=dYBbdbST-u2wJc5M_aPMi-eGjwV7I6-K2uhNt32qNP8 13326
dataverse/etl/deduplication/polyglot.py sha256=HAVVBomtshqlnEvcIh2UqjyA5F4P0HoSNhJCV7cwlgs 4436
dataverse/etl/pii/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/pii/card.py sha256=yqhF_dF_0ZEoSe3A1YhEE_ZHouAfYje3VTiRjkiISM8 2537
dataverse/etl/pii/nin.py sha256=eVC47NV9oAPIv4Zdroa1bcdUaiHQcnpb6gyObogx6Ls 2758
dataverse/etl/quality/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/quality/language.py sha256=kHIya5OQf6JCdPf_bKrIg6-Kpmug0k2vubzPOfCZQrU 5483
dataverse/etl/toxicity/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/etl/utils/log.py sha256=TZXNSJwizILoY2LY65-bqSTszC_F-YGcLzpF8cwZFtI 674
dataverse/etl/utils/sampling.py sha256=ZoQhR_D03ui2RSZeLVMRf1UtT97OhUNSs_BZErtbSIg 733
dataverse/etl/utils/statistics.py sha256=rAha8rCOdXwLQZ_solEyDevyEYua-fEByLxjTdjQCnQ 1866
dataverse/lab/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataverse/utils/analyze/__init__.py sha256=hAS7XGdorLRrvX9PbScsfabwbtaIYBNq96qCibEsnfo 86
dataverse/utils/analyze/pip.py sha256=R4iN3H97qJPSQSTZhpOuJeZmBhNoOYjWchnidWltwvQ 296
dataverse/utils/analyze/python.py sha256=nchHNEbl-Iqm23VhICYLUnJJDUxCp6FjNTOP2HiPv1w 1036
dataverse/utils/api/__init__.py sha256=pgAJdND7egHR1gWshxXPqJgNjq5w0j5-Rk5Sjp-j4Ws 1603
dataverse/utils/api/aws.py sha256=e9SEtzfvMtuu3AnOVty3c5wGJlqbAlAWTrTcI0eK7nQ 68144
dataverse/utils/format/__init__.py sha256=kPoH1GQBG_nvIHtxtjRVqQJWt2x40W5OEcbQq22R6pU 151
dataverse/utils/format/huggingface.py sha256=Ws0GmocK8Un0Pm6l8xQR_P0KLFf5-zrKSJJiszBqKoY 3261
dataverse/utils/format/ufl.py sha256=fIBYyV5Rue-kkBHLSO8h4rRhi01G_B7jPU0HZpZb5_s 144
dataverse/utils/setting/__init__.py sha256=v7-MJJgJgK3c9IZ6V-TfJKjjrMffxhpKKjmwzIWgAQ0 110
dataverse/utils/setting/system.py sha256=jhHNPS-m2ugAy7mSoyickmYD0t7mqTb1Cxj3DOg_XUY 7283
dataverse/utils/setting/user.py sha256=TJfVJbAgeViMxvNgH-1Xt-5fRCmxRzLWLe1MQRnprjI 6019
yvestest-0.1.3.dist-info/LICENSE sha256=jxRVW9ZgoEiGiLj15oGsw8O_bwk2ifnpKuxuDfWK3kU 1074
yvestest-0.1.3.dist-info/METADATA sha256=Oq9scyTpo5HK4IopGaAqvz2YQ2XwQj-11WkQ3Ab3hoI 1854
yvestest-0.1.3.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
yvestest-0.1.3.dist-info/entry_points.txt sha256=2JG3fmkHIRftHHC4pKRQb9TT0cl8jKkjwzw-6I03hqw 53
yvestest-0.1.3.dist-info/top_level.txt sha256=DQthQD-a7flZ1h_SzQ_2X0ZD9T4hl_K8UW43H1y_t6k 10
yvestest-0.1.3.dist-info/RECORD — —

top_level.txt

dataverse

entry_points.txt

[console_scripts]
dataverse = dataverse.api.cli:main