Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

can the version pins for tokenizers and transformers be removed, in requirements.txt? #306

Open
glycerine opened this issue Feb 10, 2022 · 2 comments
Open

can the version pins for tokenizers and transformers be removed, in requirements.txt? #306

glycerine opened this issue Feb 10, 2022 · 2 comments

Comments

@glycerine
Copy link

I couldn't get installation with the pinned versions of tokenizers and transformers in place, using the latest nightly rustc.

Will my fast-bert installation be incorrect without those version pins? Is there a quick correctness check I could run? I simply removed the pins like so to get installation:

~/fast-bert (main) $ git diff
diff --git a/requirements.txt b/requirements.txt
index c6f31fa..4ed1fb3 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -5,8 +5,8 @@ fastprogress
 sklearn
 spacy
 seqeval
-tokenizers==0.8.1.rc1
-transformers==3.0.2
+tokenizers
+transformers
 pandas
 python-box
 more-itertools

Then I was able to install from source.

With the version pins in place I get this failure to install using pip install:

$ pip install fast-bert 
Collecting fast-bert
  Using cached fast_bert-1.9.15-py3-none-any.whl (99 kB)
Collecting spacy
  Using cached spacy-3.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.1 MB)
Collecting pandas
  Using cached pandas-1.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
Collecting seqeval
  Using cached seqeval-1.2.2-py3-none-any.whl
Collecting fastprogress
  Using cached fastprogress-1.0.0-py3-none-any.whl (12 kB)
Collecting more-itertools
  Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB)
Collecting tokenizers==0.8.1.rc1
  Using cached tokenizers-0.8.1rc1.tar.gz (97 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting tensorboardX
  Using cached tensorboardX-2.4.1-py2.py3-none-any.whl (124 kB)
Collecting sklearn
  Using cached sklearn-0.0-py2.py3-none-any.whl
Collecting matplotlib
  Using cached matplotlib-3.5.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (11.2 MB)
Collecting transformers==3.0.2
  Using cached transformers-3.0.2-py3-none-any.whl (769 kB)
Collecting python-box
  Using cached python_box-5.4.1-py3-none-any.whl (21 kB)
Collecting pytorch-lamb
  Using cached pytorch_lamb-1.0.0-py3-none-any.whl (4.4 kB)
Requirement already satisfied: sentencepiece!=0.1.92 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (0.1.96)
Requirement already satisfied: numpy in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (1.21.2)
Requirement already satisfied: packaging in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (21.3)
Requirement already satisfied: filelock in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (3.4.2)
Requirement already satisfied: regex!=2019.12.17 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (2022.1.18)
Requirement already satisfied: requests in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (2.27.1)
Requirement already satisfied: tqdm>=4.27 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (4.62.3)
Requirement already satisfied: sacremoses in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from transformers==3.0.2->fast-bert) (0.0.47)
Requirement already satisfied: pillow>=6.2.0 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from matplotlib->fast-bert) (8.4.0)
Collecting fonttools>=4.22.0
  Using cached fonttools-4.29.1-py3-none-any.whl (895 kB)
Collecting kiwisolver>=1.0.1
  Using cached kiwisolver-1.3.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB)
Requirement already satisfied: pyparsing>=2.2.1 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from matplotlib->fast-bert) (3.0.7)
Requirement already satisfied: python-dateutil>=2.7 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from matplotlib->fast-bert) (2.8.2)
Collecting cycler>=0.10
  Using cached cycler-0.11.0-py3-none-any.whl (6.4 kB)
Collecting pytz>=2020.1
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Requirement already satisfied: torch>=0.4.1 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from pytorch-lamb->fast-bert) (1.10.2)
Requirement already satisfied: torchvision in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from pytorch-lamb->fast-bert) (0.11.3)
Collecting scikit-learn>=0.21.3
  Using cached scikit_learn-1.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26.4 MB)
Collecting preshed<3.1.0,>=3.0.2
  Using cached preshed-3.0.6-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (128 kB)
Requirement already satisfied: setuptools in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from spacy->fast-bert) (58.0.4)
Collecting pathy>=0.3.5
  Using cached pathy-0.6.1-py3-none-any.whl (42 kB)
Collecting spacy-legacy<3.1.0,>=3.0.8
  Using cached spacy_legacy-3.0.8-py2.py3-none-any.whl (14 kB)
Collecting spacy-loggers<2.0.0,>=1.0.0
  Using cached spacy_loggers-1.0.1-py3-none-any.whl (7.0 kB)
Collecting cymem<2.1.0,>=2.0.2
  Using cached cymem-2.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (35 kB)
Collecting blis<0.8.0,>=0.4.0
  Using cached blis-0.7.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (9.9 MB)
Collecting typer<0.5.0,>=0.3.0
  Using cached typer-0.4.0-py3-none-any.whl (27 kB)
Collecting srsly<3.0.0,>=2.4.1
  Using cached srsly-2.4.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (452 kB)
Collecting pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4
  Using cached pydantic-1.8.2-cp39-cp39-manylinux2014_x86_64.whl (11.3 MB)
Collecting catalogue<2.1.0,>=2.0.6
  Using cached catalogue-2.0.6-py3-none-any.whl (17 kB)
Collecting langcodes<4.0.0,>=3.2.0
  Using cached langcodes-3.3.0-py3-none-any.whl (181 kB)
Collecting wasabi<1.1.0,>=0.8.1
  Using cached wasabi-0.9.0-py3-none-any.whl (25 kB)
Collecting thinc<8.1.0,>=8.0.12
  Using cached thinc-8.0.13-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (635 kB)
Collecting jinja2
  Using cached Jinja2-3.0.3-py3-none-any.whl (133 kB)
Collecting murmurhash<1.1.0,>=0.28.0
  Using cached murmurhash-1.0.6-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (21 kB)
Collecting protobuf>=3.8.0
  Using cached protobuf-3.19.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting smart-open<6.0.0,>=5.0.0
  Using cached smart_open-5.2.1-py3-none-any.whl (58 kB)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4->spacy->fast-bert) (3.10.0.2)
Requirement already satisfied: six>=1.5 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from python-dateutil>=2.7->matplotlib->fast-bert) (1.16.0)
Requirement already satisfied: certifi>=2017.4.17 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from requests->transformers==3.0.2->fast-bert) (2021.10.8)
Requirement already satisfied: idna<4,>=2.5 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from requests->transformers==3.0.2->fast-bert) (3.3)
Requirement already satisfied: charset-normalizer~=2.0.0 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from requests->transformers==3.0.2->fast-bert) (2.0.11)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from requests->transformers==3.0.2->fast-bert) (1.26.8)
Collecting threadpoolctl>=2.0.0
  Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Requirement already satisfied: joblib>=0.11 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from scikit-learn>=0.21.3->seqeval->fast-bert) (1.1.0)
Collecting scipy>=1.1.0
  Using cached scipy-1.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.1 MB)
Requirement already satisfied: click<9.0.0,>=7.1.1 in ./anaconda3/envs/jasonenv/lib/python3.9/site-packages (from typer<0.5.0,>=0.3.0->spacy->fast-bert) (8.0.3)
Collecting MarkupSafe>=2.0
  Using cached MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (30 kB)
Building wheels for collected packages: tokenizers
  Building wheel for tokenizers (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Building wheel for tokenizers (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [203 lines of output]
      /tmp/pip-build-env-pneje7pk/overlay/lib/python3.9/site-packages/setuptools/dist.py:502: UserWarning: Normalizing '0.8.1.rc1' to '0.8.1rc1'
        warnings.warn(tmpl.format(**locals()))
      running bdist_wheel
      running build
      running build_py
      running build_ext
      running build_rust
          Updating crates.io index
          Updating git repository `https://github.com/n1t0/rayon-cond`
      cargo rustc --lib --manifest-path Cargo.toml --release -v --features pyo3/extension-module -- --crate-type cdylib
      warning: unused manifest key: target.x86_64-apple-darwin.rustflags
         Compiling proc-macro2 v1.0.36
         Compiling unicode-xid v0.2.2
         Compiling syn v1.0.86
         Compiling libc v0.2.117
         Compiling autocfg v1.1.0
         Compiling cfg-if v1.0.0
         Compiling lazy_static v1.4.0
         Compiling serde_derive v1.0.136
         Compiling memchr v2.4.1
         Compiling scopeguard v1.1.0
         Compiling crossbeam-utils v0.8.7
         Compiling serde v1.0.136
         Compiling proc-macro-hack v0.5.19
         Compiling regex-syntax v0.6.25
         Compiling crossbeam-epoch v0.9.7
         Compiling serde_json v1.0.78
         Compiling rayon-core v1.9.1
         Compiling getrandom v0.1.16
         Compiling itoa v1.0.1
         Compiling unicode-width v0.1.9
         Compiling smallvec v1.8.0
         Compiling cc v1.0.72
         Compiling pkg-config v0.3.24
         Compiling ryu v1.0.9
         Compiling either v1.6.1
         Compiling once_cell v1.9.0
         Compiling erased-serde v0.3.18
         Compiling ppv-lite86 v0.2.16
         Compiling unindent v0.1.7
         Compiling version_check v0.9.4
         Compiling inventory v0.1.11
         Compiling cfg-if v0.1.10
         Compiling bitflags v1.3.2
         Compiling number_prefix v0.3.0
         Compiling strsim v0.8.0
         Compiling vec_map v0.8.2
         Compiling ansi_term v0.12.1
         Compiling unicode_categories v0.1.1
           Running `rustc --crate-name unicode_xid /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/unicode-xid-0.2.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' -C metadata=5169222e9a9224f7 -C extra-filename=-5169222e9a9224f7 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name lazy_static /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/lazy_static-1.4.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=79cb8478fcd4b466 -C extra-filename=-79cb8478fcd4b466 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name cfg_if --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/cfg-if-1.0.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=2deae1b316fdaf6f -C extra-filename=-2deae1b316fdaf6f --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro2-1.0.36/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=127f0f35c6e17df7 -C extra-filename=-127f0f35c6e17df7 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/proc-macro2-127f0f35c6e17df7 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name scopeguard /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/scopeguard-1.1.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=3c7ae9dd20140962 -C extra-filename=-3c7ae9dd20140962 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/serde_derive-1.0.136/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' -C metadata=22ed2124e3dc3757 -C extra-filename=-22ed2124e3dc3757 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/serde_derive-22ed2124e3dc3757 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/libc-0.2.117/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=0b981d156e8a7171 -C extra-filename=-0b981d156e8a7171 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/libc-0b981d156e8a7171 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name autocfg /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/autocfg-1.1.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=061a37f812b47518 -C extra-filename=-061a37f812b47518 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/crossbeam-utils-0.8.7/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="lazy_static"' --cfg 'feature="std"' -C metadata=6559af75350ec7e6 -C extra-filename=-6559af75350ec7e6 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/crossbeam-utils-6559af75350ec7e6 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/memchr-2.4.1/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=c28282e528ea8998 -C extra-filename=-c28282e528ea8998 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/memchr-c28282e528ea8998 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/serde-1.0.136/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="serde_derive"' --cfg 'feature="std"' -C metadata=1f3db4bc67db0301 -C extra-filename=-1f3db4bc67db0301 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/serde-1f3db4bc67db0301 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/syn-1.0.86/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=7cccbbc3608bd282 -C extra-filename=-7cccbbc3608bd282 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/syn-7cccbbc3608bd282 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro-hack-0.5.19/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no -C metadata=235c58df4bfc2d26 -C extra-filename=-235c58df4bfc2d26 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/proc-macro-hack-235c58df4bfc2d26 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name regex_syntax --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/regex-syntax-0.6.25/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=79e1cae865a51a95 -C extra-filename=-79e1cae865a51a95 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/serde_json-1.0.78/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=0aca0db3ea81e27c -C extra-filename=-0aca0db3ea81e27c --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/serde_json-0aca0db3ea81e27c -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/crossbeam-epoch-0.9.7/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="lazy_static"' --cfg 'feature="std"' -C metadata=1b53a95c38fac831 -C extra-filename=-1b53a95c38fac831 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/crossbeam-epoch-1b53a95c38fac831 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.9.1/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no -C metadata=d2283c246bafe80c -C extra-filename=-d2283c246bafe80c --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/rayon-core-d2283c246bafe80c -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/getrandom-0.1.16/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="std"' -C metadata=f7f1f89d3879f12a -C extra-filename=-f7f1f89d3879f12a --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/getrandom-f7f1f89d3879f12a -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name itoa --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/itoa-1.0.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=34da94ddc3c6a630 -C extra-filename=-34da94ddc3c6a630 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name unicode_width /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/unicode-width-0.1.9/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' -C metadata=bfedf134330d4bf0 -C extra-filename=-bfedf134330d4bf0 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name smallvec --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/smallvec-1.8.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=a659c1158aa05c54 -C extra-filename=-a659c1158aa05c54 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name pkg_config /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/pkg-config-0.3.24/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=92694de5e874cd28 -C extra-filename=-92694de5e874cd28 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name cc --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/cc-1.0.72/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=46bea57c09b258af -C extra-filename=-46bea57c09b258af --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name ryu --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/ryu-1.0.9/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=8fa7abc9dff34c50 -C extra-filename=-8fa7abc9dff34c50 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name either /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/either-1.6.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="use_std"' -C metadata=7a8a5a271dc7cb51 -C extra-filename=-7a8a5a271dc7cb51 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name once_cell --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/once_cell-1.9.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="race"' --cfg 'feature="std"' -C metadata=a203cc7f4a593743 -C extra-filename=-a203cc7f4a593743 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/erased-serde-0.3.18/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=f7c32cc485c2d89f -C extra-filename=-f7c32cc485c2d89f --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/erased-serde-f7c32cc485c2d89f -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name ppv_lite86 --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/ppv-lite86-0.2.16/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="simd"' --cfg 'feature="std"' -C metadata=f41c402efdf936bd -C extra-filename=-f41c402efdf936bd --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name unindent --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/unindent-0.1.7/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=ffdf58ea3b9e347d -C extra-filename=-ffdf58ea3b9e347d --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/inventory-0.1.11/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no -C metadata=e086f8ea4f266166 -C extra-filename=-e086f8ea4f266166 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/inventory-e086f8ea4f266166 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name cfg_if --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/cfg-if-0.1.10/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=33adbc7c23a934c7 -C extra-filename=-33adbc7c23a934c7 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name version_check /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/version_check-0.9.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=2be5c2cc4c1c8e71 -C extra-filename=-2be5c2cc4c1c8e71 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name bitflags --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/bitflags-1.3.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' -C metadata=07e4b438a47db117 -C extra-filename=-07e4b438a47db117 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name strsim /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/strsim-0.8.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=0b9af79a9eabd5cc -C extra-filename=-0b9af79a9eabd5cc --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name vec_map /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/vec_map-0.8.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=99222fb3abba5a69 -C extra-filename=-99222fb3abba5a69 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name number_prefix /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/number_prefix-0.3.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=fa210d0967aff1ff -C extra-filename=-fa210d0967aff1ff --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name ansi_term /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/ansi_term-0.12.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=299089b8a23df6cc -C extra-filename=-299089b8a23df6cc --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
           Running `rustc --crate-name unicode_categories /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/unicode_categories-0.1.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=6796d54f4a15ffb4 -C extra-filename=-6796d54f4a15ffb4 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow`
         Compiling lock_api v0.3.4
           Running `rustc --crate-name lock_api --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/lock_api-0.3.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="nightly"' -C metadata=0e8ba3e8e8af44f0 -C extra-filename=-0e8ba3e8e8af44f0 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern scopeguard=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libscopeguard-3c7ae9dd20140962.rmeta --cap-lints allow`
         Compiling textwrap v0.11.0
           Running `rustc --crate-name textwrap /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/textwrap-0.11.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=1e5358ff7f49d80c -C extra-filename=-1e5358ff7f49d80c --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern unicode_width=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libunicode_width-bfedf134330d4bf0.rmeta --cap-lints allow`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/rayon-core-d2283c246bafe80c/build-script-build`
         Compiling itertools v0.8.2
           Running `rustc --crate-name itertools /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/itertools-0.8.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="use_std"' -C metadata=ea6969d200b46984 -C extra-filename=-ea6969d200b46984 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern either=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libeither-7a8a5a271dc7cb51.rmeta --cap-lints allow`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/crossbeam-utils-6559af75350ec7e6/build-script-build`
           Running `rustc --crate-name crossbeam_utils --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/crossbeam-utils-0.8.7/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="lazy_static"' --cfg 'feature="std"' -C metadata=e1fe7783182401eb -C extra-filename=-e1fe7783182401eb --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern cfg_if=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcfg_if-2deae1b316fdaf6f.rmeta --extern lazy_static=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblazy_static-79cb8478fcd4b466.rmeta --cap-lints allow`
         Compiling unicode-normalization-alignments v0.1.12
           Running `rustc --crate-name unicode_normalization_alignments /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/unicode-normalization-alignments-0.1.12/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=af70868c129dc73e -C extra-filename=-af70868c129dc73e --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern smallvec=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libsmallvec-a659c1158aa05c54.rmeta --cap-lints allow`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/serde_derive-22ed2124e3dc3757/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/crossbeam-epoch-1b53a95c38fac831/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/memchr-c28282e528ea8998/build-script-build`
           Running `rustc --crate-name memchr --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/memchr-2.4.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=671cb2e32aa232f7 -C extra-filename=-671cb2e32aa232f7 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow --cfg memchr_runtime_simd --cfg memchr_runtime_sse2 --cfg memchr_runtime_sse42 --cfg memchr_runtime_avx`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/getrandom-f7f1f89d3879f12a/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/libc-0b981d156e8a7171/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/serde-1f3db4bc67db0301/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/proc-macro-hack-235c58df4bfc2d26/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/inventory-e086f8ea4f266166/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/serde_json-0aca0db3ea81e27c/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/syn-7cccbbc3608bd282/build-script-build`
           Running `rustc --crate-name libc /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/libc-0.2.117/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=3deba52fa91f444f -C extra-filename=-3deba52fa91f444f --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow --cfg freebsd11 --cfg libc_priv_mod_use --cfg libc_union --cfg libc_const_size_of --cfg libc_align --cfg libc_core_cvoid --cfg libc_packedN --cfg libc_cfg_target_vendor --cfg libc_non_exhaustive`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/erased-serde-f7c32cc485c2d89f/build-script-build`
           Running `rustc --crate-name proc_macro_hack --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro-hack-0.5.19/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C opt-level=3 -Cembed-bitcode=no -C metadata=940fbea956d42b7d -C extra-filename=-940fbea956d42b7d --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern proc_macro --cap-lints allow`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/proc-macro2-127f0f35c6e17df7/build-script-build`
         Compiling crossbeam-channel v0.5.2
           Running `rustc --crate-name crossbeam_channel --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/crossbeam-channel-0.5.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="crossbeam-utils"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=5d5b0d1f4a915704 -C extra-filename=-5d5b0d1f4a915704 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern cfg_if=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcfg_if-2deae1b316fdaf6f.rmeta --extern crossbeam_utils=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_utils-e1fe7783182401eb.rmeta --cap-lints allow`
           Running `rustc --crate-name proc_macro2 --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro2-1.0.36/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=4cc4c99b8d0fab22 -C extra-filename=-4cc4c99b8d0fab22 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern unicode_xid=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libunicode_xid-5169222e9a9224f7.rmeta --cap-lints allow --cfg no_literal_from_str --cfg no_group_open_close --cfg no_is_available --cfg use_proc_macro --cfg wrap_proc_macro --cfg proc_macro_span`
         Compiling memoffset v0.6.5
         Compiling rayon v1.5.1
         Compiling num-traits v0.2.14
           Running `rustc --crate-name build_script_build /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/memoffset-0.6.5/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' -C metadata=a8a139922711247a -C extra-filename=-a8a139922711247a --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/memoffset-a8a139922711247a -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern autocfg=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libautocfg-061a37f812b47518.rlib --cap-lints allow`
           Running `rustc --crate-name build_script_build --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.5.1/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no -C metadata=2cbfc7fb53d9ab52 -C extra-filename=-2cbfc7fb53d9ab52 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/rayon-2cbfc7fb53d9ab52 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern autocfg=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libautocfg-061a37f812b47518.rlib --cap-lints allow`
           Running `rustc --crate-name build_script_build /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/num-traits-0.2.14/build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=0f54341be5041910 -C extra-filename=-0f54341be5041910 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/num-traits-0f54341be5041910 -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern autocfg=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libautocfg-061a37f812b47518.rlib --cap-lints allow`
         Compiling aho-corasick v0.7.18
           Running `rustc --crate-name aho_corasick --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/aho-corasick-0.7.18/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=157f3d95428c1664 -C extra-filename=-157f3d95428c1664 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern memchr=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libmemchr-671cb2e32aa232f7.rmeta --cap-lints allow`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/memoffset-a8a139922711247a/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/num-traits-0f54341be5041910/build-script-build`
           Running `/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/build/rayon-2cbfc7fb53d9ab52/build-script-build`
         Compiling quote v1.0.15
           Running `rustc --crate-name quote --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/quote-1.0.15/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=37cabfa38d900970 -C extra-filename=-37cabfa38d900970 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern proc_macro2=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libproc_macro2-4cc4c99b8d0fab22.rmeta --cap-lints allow`
           Running `rustc --crate-name memoffset /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/memoffset-0.6.5/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' -C metadata=2bcd7283847f3dbc -C extra-filename=-2bcd7283847f3dbc --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow --cfg tuple_ty --cfg allow_clippy --cfg maybe_uninit --cfg doctests`
           Running `rustc --crate-name crossbeam_epoch --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/crossbeam-epoch-0.9.7/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="lazy_static"' --cfg 'feature="std"' -C metadata=5a5aa8866fece43c -C extra-filename=-5a5aa8866fece43c --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern cfg_if=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcfg_if-2deae1b316fdaf6f.rmeta --extern crossbeam_utils=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_utils-e1fe7783182401eb.rmeta --extern lazy_static=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblazy_static-79cb8478fcd4b466.rmeta --extern memoffset=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libmemoffset-2bcd7283847f3dbc.rmeta --extern scopeguard=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libscopeguard-3c7ae9dd20140962.rmeta --cap-lints allow`
         Compiling num_cpus v1.13.1
         Compiling terminal_size v0.1.17
         Compiling parking_lot_core v0.7.2
         Compiling atty v0.2.14
           Running `rustc --crate-name getrandom --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/getrandom-0.1.16/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="std"' -C metadata=02d36cc9cb79e5aa -C extra-filename=-02d36cc9cb79e5aa --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern cfg_if=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcfg_if-2deae1b316fdaf6f.rmeta --extern libc=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblibc-3deba52fa91f444f.rmeta --cap-lints allow`
           Running `rustc --crate-name num_cpus /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/num_cpus-1.13.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=b9f33399c948b917 -C extra-filename=-b9f33399c948b917 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern libc=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblibc-3deba52fa91f444f.rmeta --cap-lints allow`
           Running `rustc --crate-name terminal_size --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/terminal_size-0.1.17/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=1fc20f7f9da277df -C extra-filename=-1fc20f7f9da277df --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern libc=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblibc-3deba52fa91f444f.rmeta --cap-lints allow`
           Running `rustc --crate-name parking_lot_core --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot_core-0.7.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="nightly"' -C metadata=1b1c1dba5e1ae5d7 -C extra-filename=-1b1c1dba5e1ae5d7 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern cfg_if=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcfg_if-33adbc7c23a934c7.rmeta --extern libc=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblibc-3deba52fa91f444f.rmeta --extern smallvec=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libsmallvec-a659c1158aa05c54.rmeta --cap-lints allow`
           Running `rustc --crate-name atty /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/atty-0.2.14/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=96bd073f4656261d -C extra-filename=-96bd073f4656261d --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern libc=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblibc-3deba52fa91f444f.rmeta --cap-lints allow`
         Compiling clap v2.34.0
           Running `rustc --crate-name clap --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/clap-2.34.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="ansi_term"' --cfg 'feature="atty"' --cfg 'feature="color"' --cfg 'feature="default"' --cfg 'feature="strsim"' --cfg 'feature="suggestions"' --cfg 'feature="vec_map"' -C metadata=2d260623f0c0c640 -C extra-filename=-2d260623f0c0c640 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern ansi_term=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libansi_term-299089b8a23df6cc.rmeta --extern atty=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libatty-96bd073f4656261d.rmeta --extern bitflags=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libbitflags-07e4b438a47db117.rmeta --extern strsim=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libstrsim-0b9af79a9eabd5cc.rmeta --extern textwrap=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libtextwrap-1e5358ff7f49d80c.rmeta --extern unicode_width=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libunicode_width-bfedf134330d4bf0.rmeta --extern vec_map=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libvec_map-99222fb3abba5a69.rmeta --cap-lints allow`
           Running `rustc --crate-name syn --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/syn-1.0.86/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=3e33e9c139dfd7d6 -C extra-filename=-3e33e9c139dfd7d6 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern proc_macro2=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libproc_macro2-4cc4c99b8d0fab22.rmeta --extern quote=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libquote-37cabfa38d900970.rmeta --extern unicode_xid=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libunicode_xid-5169222e9a9224f7.rmeta --cap-lints allow --cfg syn_no_negative_literal_parse`
           Running `rustc --crate-name num_traits /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/num-traits-0.2.14/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=f850401c6cabd015 -C extra-filename=-f850401c6cabd015 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --cap-lints allow --cfg has_i128 --cfg has_to_int_unchecked`
         Compiling rand_core v0.5.1
           Running `rustc --crate-name rand_core --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rand_core-0.5.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="getrandom"' --cfg 'feature="std"' -C metadata=3ce944ff9b15e65f -C extra-filename=-3ce944ff9b15e65f --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern getrandom=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libgetrandom-02d36cc9cb79e5aa.rmeta --cap-lints allow`
         Compiling parking_lot v0.10.2
           Running `rustc --crate-name parking_lot --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot-0.10.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="default"' --cfg 'feature="nightly"' -C metadata=2e9b927e64e2fd23 -C extra-filename=-2e9b927e64e2fd23 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern lock_api=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblock_api-0e8ba3e8e8af44f0.rmeta --extern parking_lot_core=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libparking_lot_core-1b1c1dba5e1ae5d7.rmeta --cap-lints allow`
         Compiling crossbeam-deque v0.8.1
           Running `rustc --crate-name crossbeam_deque --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/crossbeam-deque-0.8.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="crossbeam-epoch"' --cfg 'feature="crossbeam-utils"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=aa7eb6221c37ab49 -C extra-filename=-aa7eb6221c37ab49 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern cfg_if=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcfg_if-2deae1b316fdaf6f.rmeta --extern crossbeam_epoch=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_epoch-5a5aa8866fece43c.rmeta --extern crossbeam_utils=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_utils-e1fe7783182401eb.rmeta --cap-lints allow`
      error[E0658]: `if` is not allowed in a `const fn`
        --> /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/clap-2.34.0/src/app/settings.rs:7:1
         |
      7  | / bitflags! {
      8  | |     struct Flags: u64 {
      9  | |         const SC_NEGATE_REQS       = 1;
      10 | |         const SC_REQUIRED          = 1 << 1;
      ...  |
      51 | |     }
      52 | | }
         | |_^
         |
         = note: see issue #49146 <https://github.com/rust-lang/rust/issues/49146> for more information
         = help: add `#![feature(const_if_match)]` to the crate attributes to enable
         = note: this error originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)
      
         Compiling rand_chacha v0.2.2
           Running `rustc --crate-name rand_chacha --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rand_chacha-0.2.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="std"' -C metadata=78432008163ec0a9 -C extra-filename=-78432008163ec0a9 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern ppv_lite86=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libppv_lite86-f41c402efdf936bd.rmeta --extern rand_core=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/librand_core-3ce944ff9b15e65f.rmeta --cap-lints allow`
      error[E0658]: `if` is not allowed in a `const fn`
        --> /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/clap-2.34.0/src/args/settings.rs:6:1
         |
      6  | / bitflags! {
      7  | |     struct Flags: u32 {
      8  | |         const REQUIRED         = 1;
      9  | |         const MULTIPLE         = 1 << 1;
      ...  |
      28 | |     }
      29 | | }
         | |_^
         |
         = note: see issue #49146 <https://github.com/rust-lang/rust/issues/49146> for more information
         = help: add `#![feature(const_if_match)]` to the crate attributes to enable
         = note: this error originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)
      
           Running `rustc --crate-name rayon_core --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-core-1.9.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=268a2b41a39bead0 -C extra-filename=-268a2b41a39bead0 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern crossbeam_channel=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_channel-5d5b0d1f4a915704.rmeta --extern crossbeam_deque=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_deque-aa7eb6221c37ab49.rmeta --extern crossbeam_utils=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_utils-e1fe7783182401eb.rmeta --extern lazy_static=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblazy_static-79cb8478fcd4b466.rmeta --extern num_cpus=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libnum_cpus-b9f33399c948b917.rmeta --cap-lints allow`
         Compiling paste-impl v0.1.18
           Running `rustc --crate-name paste_impl --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/paste-impl-0.1.18/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C opt-level=3 -Cembed-bitcode=no -C metadata=7047fcfa649dd5ba -C extra-filename=-7047fcfa649dd5ba --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern proc_macro_hack=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libproc_macro_hack-940fbea956d42b7d.so --extern proc_macro --cap-lints allow`
         Compiling rand v0.7.3
           Running `rustc --crate-name rand --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rand-0.7.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="getrandom"' --cfg 'feature="getrandom_package"' --cfg 'feature="libc"' --cfg 'feature="std"' -C metadata=795b7e2f5f181642 -C extra-filename=-795b7e2f5f181642 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern getrandom_package=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libgetrandom-02d36cc9cb79e5aa.rmeta --extern libc=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/liblibc-3deba52fa91f444f.rmeta --extern rand_chacha=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/librand_chacha-78432008163ec0a9.rmeta --extern rand_core=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/librand_core-3ce944ff9b15e65f.rmeta --cap-lints allow`
           Running `rustc --crate-name rayon --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/rayon-1.5.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=9ba1226349fb0a01 -C extra-filename=-9ba1226349fb0a01 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern crossbeam_deque=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libcrossbeam_deque-aa7eb6221c37ab49.rmeta --extern either=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libeither-7a8a5a271dc7cb51.rmeta --extern rayon_core=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/librayon_core-268a2b41a39bead0.rmeta --cap-lints allow --cfg step_by`
         Compiling regex v1.5.4
           Running `rustc --crate-name regex --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/regex-1.5.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="aho-corasick"' --cfg 'feature="default"' --cfg 'feature="memchr"' --cfg 'feature="perf"' --cfg 'feature="perf-cache"' --cfg 'feature="perf-dfa"' --cfg 'feature="perf-inline"' --cfg 'feature="perf-literal"' --cfg 'feature="std"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=1e333a3fef530f25 -C extra-filename=-1e333a3fef530f25 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern aho_corasick=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libaho_corasick-157f3d95428c1664.rmeta --extern memchr=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libmemchr-671cb2e32aa232f7.rmeta --extern regex_syntax=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libregex_syntax-79e1cae865a51a95.rmeta --cap-lints allow`
      error: aborting due to 2 previous errors
      
      For more information about this error, try `rustc --explain E0658`.
      error: could not compile `clap`.
      
      Caused by:
        process didn't exit successfully: `rustc --crate-name clap --edition=2018 /home/jaten/.cargo/registry/src/github.com-1ecc6299db9ec823/clap-2.34.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg 'feature="ansi_term"' --cfg 'feature="atty"' --cfg 'feature="color"' --cfg 'feature="default"' --cfg 'feature="strsim"' --cfg 'feature="suggestions"' --cfg 'feature="vec_map"' -C metadata=2d260623f0c0c640 -C extra-filename=-2d260623f0c0c640 --out-dir /tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps -L dependency=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps --extern ansi_term=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libansi_term-299089b8a23df6cc.rmeta --extern atty=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libatty-96bd073f4656261d.rmeta --extern bitflags=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libbitflags-07e4b438a47db117.rmeta --extern strsim=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libstrsim-0b9af79a9eabd5cc.rmeta --extern textwrap=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libtextwrap-1e5358ff7f49d80c.rmeta --extern unicode_width=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libunicode_width-bfedf134330d4bf0.rmeta --extern vec_map=/tmp/pip-install-tednfh26/tokenizers_3e8135338e264710b8ac175053db5595/target/release/deps/libvec_map-99222fb3abba5a69.rmeta --cap-lints allow` (exit code: 1)
      warning: build failed, waiting for other jobs to finish...
      error: build failed
      error: cargo failed with code: 101
      
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
$

$ rustc --version
rustc 1.60.0-nightly (e7aca8959 2022-02-09)
@glycerine
Copy link
Author

for completeness (the actually used versions), here was my "successful looking" build log:

$ python setup.py install
running install
running bdist_egg
running egg_info
creating fast_bert.egg-info
writing fast_bert.egg-info/PKG-INFO
writing dependency_links to fast_bert.egg-info/dependency_links.txt
writing requirements to fast_bert.egg-info/requires.txt
writing top-level names to fast_bert.egg-info/top_level.txt
writing manifest file 'fast_bert.egg-info/SOURCES.txt'
reading manifest file 'fast_bert.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'fast_bert.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build
creating build/lib
creating build/lib/fast_bert
copying fast_bert/data_ner.py -> build/lib/fast_bert
copying fast_bert/metrics.py -> build/lib/fast_bert
copying fast_bert/prediction.py -> build/lib/fast_bert
copying fast_bert/learner_abs.py -> build/lib/fast_bert
copying fast_bert/learner_cls.py -> build/lib/fast_bert
copying fast_bert/optimization.py -> build/lib/fast_bert
copying fast_bert/data.py -> build/lib/fast_bert
copying fast_bert/learner_util.py -> build/lib/fast_bert
copying fast_bert/data_qa.py -> build/lib/fast_bert
copying fast_bert/learner_cls_old.py -> build/lib/fast_bert
copying fast_bert/data_cls.py -> build/lib/fast_bert
copying fast_bert/data_lm.py -> build/lib/fast_bert
copying fast_bert/bert_layers.py -> build/lib/fast_bert
copying fast_bert/modeling.py -> build/lib/fast_bert
copying fast_bert/utils_squad_evaluate.py -> build/lib/fast_bert
copying fast_bert/data_abs.py -> build/lib/fast_bert
copying fast_bert/learner_ner.py -> build/lib/fast_bert
copying fast_bert/learner_qa.py -> build/lib/fast_bert
copying fast_bert/learner_lm.py -> build/lib/fast_bert
copying fast_bert/__init__.py -> build/lib/fast_bert
creating build/lib/fast_bert/summarisation
copying fast_bert/summarisation/modeling_bertabs.py -> build/lib/fast_bert/summarisation
copying fast_bert/summarisation/configuration_bertabs.py -> build/lib/fast_bert/summarisation
copying fast_bert/summarisation/__init__.py -> build/lib/fast_bert/summarisation
creating build/lib/fast_bert/utils
copying fast_bert/utils/spellcheck.py -> build/lib/fast_bert/utils
copying fast_bert/utils/__init__.py -> build/lib/fast_bert/utils
creating build/bdist.linux-x86_64
creating build/bdist.linux-x86_64/egg
creating build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/data_ner.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/metrics.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/prediction.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/learner_abs.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/learner_cls.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/optimization.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/data.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/learner_util.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/data_qa.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/learner_cls_old.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/data_cls.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/data_lm.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/bert_layers.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/modeling.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/utils_squad_evaluate.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/data_abs.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/learner_ner.py -> build/bdist.linux-x86_64/egg/fast_bert
creating build/bdist.linux-x86_64/egg/fast_bert/summarisation
copying build/lib/fast_bert/summarisation/modeling_bertabs.py -> build/bdist.linux-x86_64/egg/fast_bert/summarisation
copying build/lib/fast_bert/summarisation/configuration_bertabs.py -> build/bdist.linux-x86_64/egg/fast_bert/summarisation
copying build/lib/fast_bert/summarisation/__init__.py -> build/bdist.linux-x86_64/egg/fast_bert/summarisation
creating build/bdist.linux-x86_64/egg/fast_bert/utils
copying build/lib/fast_bert/utils/spellcheck.py -> build/bdist.linux-x86_64/egg/fast_bert/utils
copying build/lib/fast_bert/utils/__init__.py -> build/bdist.linux-x86_64/egg/fast_bert/utils
copying build/lib/fast_bert/learner_qa.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/learner_lm.py -> build/bdist.linux-x86_64/egg/fast_bert
copying build/lib/fast_bert/__init__.py -> build/bdist.linux-x86_64/egg/fast_bert
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/data_ner.py to data_ner.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/metrics.py to metrics.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/prediction.py to prediction.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_abs.py to learner_abs.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_cls.py to learner_cls.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/optimization.py to optimization.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/data.py to data.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_util.py to learner_util.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/data_qa.py to data_qa.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_cls_old.py to learner_cls_old.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/data_cls.py to data_cls.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/data_lm.py to data_lm.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/bert_layers.py to bert_layers.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/modeling.py to modeling.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/utils_squad_evaluate.py to utils_squad_evaluate.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/data_abs.py to data_abs.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_ner.py to learner_ner.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/summarisation/modeling_bertabs.py to modeling_bertabs.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/summarisation/configuration_bertabs.py to configuration_bertabs.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/summarisation/__init__.py to __init__.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/utils/spellcheck.py to spellcheck.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/utils/__init__.py to __init__.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_qa.py to learner_qa.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/learner_lm.py to learner_lm.cpython-39.pyc
byte-compiling build/bdist.linux-x86_64/egg/fast_bert/__init__.py to __init__.cpython-39.pyc
creating build/bdist.linux-x86_64/egg/EGG-INFO
copying fast_bert.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
copying fast_bert.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying fast_bert.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying fast_bert.egg-info/not-zip-safe -> build/bdist.linux-x86_64/egg/EGG-INFO
copying fast_bert.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying fast_bert.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
creating dist
creating 'dist/fast_bert-1.9.15-py3.9.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)
Processing fast_bert-1.9.15-py3.9.egg
creating /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/fast_bert-1.9.15-py3.9.egg
Extracting fast_bert-1.9.15-py3.9.egg to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding fast-bert 1.9.15 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/fast_bert-1.9.15-py3.9.egg
Processing dependencies for fast-bert==1.9.15
Searching for more-itertools
Reading https://pypi.org/simple/more-itertools/
Downloading https://files.pythonhosted.org/packages/e5/c3/48e2c81038f57e8caab9a6e6fb6c2fc23536c59b092abefc447e6b5d1903/more_itertools-8.12.0-py3-none-any.whl#sha256=43e6dd9942dffd72661a2c4ef383ad7da1e6a3e968a927ad7a6083ab410a688b
Best match: more-itertools 8.12.0
Processing more_itertools-8.12.0-py3-none-any.whl
Installing more_itertools-8.12.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding more-itertools 8.12.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/more_itertools-8.12.0-py3.9.egg
Searching for python-box
Reading https://pypi.org/simple/python-box/
Downloading https://files.pythonhosted.org/packages/49/2a/8e78c54e922cd441a9af330c9d6b9dde913d21a6dd38c65aff1f6813c43f/python_box-6.0.0rc3-py3-none-any.whl#sha256=b0ed110ed7826b96310c02fd320d46f6af298e453b3e16f5b6652dfc03c9cb56
Best match: python-box 6.0.0rc3
Processing python_box-6.0.0rc3-py3-none-any.whl
Installing python_box-6.0.0rc3-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding python-box 6.0.0rc3 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/python_box-6.0.0rc3-py3.9.egg
Searching for pandas
Reading https://pypi.org/simple/pandas/
Downloading https://files.pythonhosted.org/packages/eb/fa/6cbc442e86f625dc403fbceb79e869893fc09486cfba79bd4ba33e366293/pandas-1.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=1d59c958d6b8f96fdf850c7821571782168d5acfe75ccf78cd8d1ac15fb921df
Best match: pandas 1.4.0
Processing pandas-1.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing pandas-1.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding pandas 1.4.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/pandas-1.4.0-py3.9-linux-x86_64.egg
Searching for seqeval
Reading https://pypi.org/simple/seqeval/
Downloading https://files.pythonhosted.org/packages/9d/2d/233c79d5b4e5ab1dbf111242299153f3caddddbb691219f363ad55ce783d/seqeval-1.2.2.tar.gz#sha256=f28e97c3ab96d6fcd32b648f6438ff2e09cfba87f05939da9b3970713ec56e6f
Best match: seqeval 1.2.2
Processing seqeval-1.2.2.tar.gz
Writing /tmp/easy_install-1tv9r5pl/seqeval-1.2.2/setup.cfg
Running seqeval-1.2.2/setup.py -q bdist_egg --dist-dir /tmp/easy_install-1tv9r5pl/seqeval-1.2.2/egg-dist-tmp-4jh8tx1x
listing git files failed - pretending there aren't any
zip_safe flag not set; analyzing archive contents...
Moving seqeval-1.2.2-py3.9.egg to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding seqeval 1.2.2 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/seqeval-1.2.2-py3.9.egg
Searching for spacy
Reading https://pypi.org/simple/spacy/
Downloading https://files.pythonhosted.org/packages/c7/a8/f25ac1fa1268b6ec76221eef08bbdae6b270a79368f2e2353b1b963ba75f/spacy-3.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=d12b3e6568b7fde01b62ed42d0d578779774d091a33764d0f29def9b75363f81
Best match: spacy 3.2.1
Processing spacy-3.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing spacy-3.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding spacy 3.2.1 to easy-install.pth file
Installing spacy script to /home/jaten/anaconda3/envs/jasonenv/bin

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/spacy-3.2.1-py3.9-linux-x86_64.egg
Searching for sklearn
Reading https://pypi.org/simple/sklearn/
Downloading https://files.pythonhosted.org/packages/1e/7a/dbb3be0ce9bd5c8b7e3d87328e79063f8b263b2b1bfa4774cb1147bfcd3f/sklearn-0.0.tar.gz#sha256=e23001573aa194b834122d2b9562459bf5ae494a2d59ca6b8aa22c85a44c0e31
Best match: sklearn 0.0
Processing sklearn-0.0.tar.gz
Writing /tmp/easy_install-nwsqwnla/sklearn-0.0/setup.cfg
Running sklearn-0.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-nwsqwnla/sklearn-0.0/egg-dist-tmp-nbng0634
file wheel-platform-tag-is-broken-on-empty-wheels-see-issue-141.py (for module wheel-platform-tag-is-broken-on-empty-wheels-see-issue-141) not found
file wheel-platform-tag-is-broken-on-empty-wheels-see-issue-141.py (for module wheel-platform-tag-is-broken-on-empty-wheels-see-issue-141) not found
file wheel-platform-tag-is-broken-on-empty-wheels-see-issue-141.py (for module wheel-platform-tag-is-broken-on-empty-wheels-see-issue-141) not found
warning: install_lib: 'build/lib' does not exist -- no Python modules to install

creating /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/sklearn-0.0-py3.9.egg
Extracting sklearn-0.0-py3.9.egg to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding sklearn 0.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/sklearn-0.0-py3.9.egg
Searching for fastprogress
Reading https://pypi.org/simple/fastprogress/
Downloading https://files.pythonhosted.org/packages/eb/1f/c61b92d806fbd06ad75d08440efe7f2bd1006ba0b15d086debed49d93cdc/fastprogress-1.0.0-py3-none-any.whl#sha256=474cd6a6e5b1c29a02383d709bf71f502477d0849bddc6ba5aa80b683f4ad16f
Best match: fastprogress 1.0.0
Processing fastprogress-1.0.0-py3-none-any.whl
Installing fastprogress-1.0.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding fastprogress 1.0.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/fastprogress-1.0.0-py3.9.egg
Searching for tensorboardX
Reading https://pypi.org/simple/tensorboardX/
Downloading https://files.pythonhosted.org/packages/98/88/977b2f03fd0f8a2490fc7a1ad691d5e44cee5f1dc90c57078c5c168e2e70/tensorboardX-2.4.1-py2.py3-none-any.whl#sha256=209770034b87e99bfa36ecb471462c3bcce6544324b0c891958b65523348c277
Best match: tensorboardX 2.4.1
Processing tensorboardX-2.4.1-py2.py3-none-any.whl
Installing tensorboardX-2.4.1-py2.py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding tensorboardX 2.4.1 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/tensorboardX-2.4.1-py3.9.egg
Searching for pytorch-lamb
Reading https://pypi.org/simple/pytorch-lamb/
Downloading https://files.pythonhosted.org/packages/43/98/3bce14a319317a2856db722f2542d329baf42845fa53563d0d749c5a2d40/pytorch_lamb-1.0.0-py3-none-any.whl#sha256=0cdc4dffe0b402ee55f482466ebab5b25332a1036cef595d5c733bac0a37be71
Best match: pytorch-lamb 1.0.0
Processing pytorch_lamb-1.0.0-py3-none-any.whl
Installing pytorch_lamb-1.0.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding pytorch-lamb 1.0.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/pytorch_lamb-1.0.0-py3.9.egg
Searching for matplotlib
Reading https://pypi.org/simple/matplotlib/
Downloading https://files.pythonhosted.org/packages/6a/52/703f568256a3e614a448503a698557d7832b7893fd63d3f7c2ebb54cd6e2/matplotlib-3.5.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl#sha256=87900c67c0f1728e6db17c6809ec05c025c6624dcf96a8020326ea15378fe8e7
Best match: matplotlib 3.5.1
Processing matplotlib-3.5.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl
Installing matplotlib-3.5.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding matplotlib 3.5.1 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/matplotlib-3.5.1-py3.9-linux-x86_64.egg
Searching for pytz>=2020.1
Reading https://pypi.org/simple/pytz/
Downloading https://files.pythonhosted.org/packages/d3/e3/d9f046b5d1c94a3aeab15f1f867aa414f8ee9d196fae6865f1d6a0ee1a0b/pytz-2021.3-py2.py3-none-any.whl#sha256=3672058bc3453457b622aab7a1c3bfd5ab0bdae451512f6cf25f64ed37f5b87c
Best match: pytz 2021.3
Processing pytz-2021.3-py2.py3-none-any.whl
Installing pytz-2021.3-py2.py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding pytz 2021.3 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/pytz-2021.3-py3.9.egg
Searching for scikit-learn>=0.21.3
Reading https://pypi.org/simple/scikit-learn/
Downloading https://files.pythonhosted.org/packages/57/aa/483fbe6b5314bce2d49801e6cec1f2139a9c220d0d51494788fff47233b3/scikit_learn-1.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=ff746a69ff2ef25f62b36338c615dd15954ddc3ab8e73530237dd73235e76d62
Best match: scikit-learn 1.0.2
Processing scikit_learn-1.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing scikit_learn-1.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding scikit-learn 1.0.2 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/scikit_learn-1.0.2-py3.9-linux-x86_64.egg
Searching for wasabi<1.1.0,>=0.8.1
Reading https://pypi.org/simple/wasabi/
Downloading https://files.pythonhosted.org/packages/da/96/1f8e7a9d5cd48251b84991657ba3aeab9463a9e897ff105f70e103946348/wasabi-0.9.0-py3-none-any.whl#sha256=f40f317981d019903db5b69eb2bf78519c9e165c1dfdbd0452e4ca81ff9a31d2
Best match: wasabi 0.9.0
Processing wasabi-0.9.0-py3-none-any.whl
Installing wasabi-0.9.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding wasabi 0.9.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/wasabi-0.9.0-py3.9.egg
Searching for typer<0.5.0,>=0.3.0
Reading https://pypi.org/simple/typer/
Downloading https://files.pythonhosted.org/packages/4f/bd/77f6cb38c291717c5109cc2638086033fd7de4f8aeb0ed95e9ed484efa82/typer-0.4.0-py3-none-any.whl#sha256=d81169725140423d072df464cad1ff25ee154ef381aaf5b8225352ea187ca338
Best match: typer 0.4.0
Processing typer-0.4.0-py3-none-any.whl
Installing typer-0.4.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding typer 0.4.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/typer-0.4.0-py3.9.egg
Searching for thinc<8.1.0,>=8.0.12
Reading https://pypi.org/simple/thinc/
Downloading https://files.pythonhosted.org/packages/3f/07/2210d1160ec7992fea82752042e641624aed42d0cd113d64129b866f6805/thinc-8.0.14.dev0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=48ec31ee51e93e59ff8135c456adbbe28f7b622a3924e19eb0e39cd3264b95b3
Best match: thinc 8.0.14.dev0
Processing thinc-8.0.14.dev0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing thinc-8.0.14.dev0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding thinc 8.0.14.dev0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/thinc-8.0.14.dev0-py3.9-linux-x86_64.egg
Searching for srsly<3.0.0,>=2.4.1
Reading https://pypi.org/simple/srsly/
Downloading https://files.pythonhosted.org/packages/6a/05/fe141570619a48a9e98b099cdfeba79a3951bb1604e19049ecb255deb81b/srsly-2.4.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=d4bc36962208810d29c72156e0573dcbabd9914f42fede42217ccfcadd96beb6
Best match: srsly 2.4.2
Processing srsly-2.4.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing srsly-2.4.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding srsly 2.4.2 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/srsly-2.4.2-py3.9-linux-x86_64.egg
Searching for spacy-loggers<2.0.0,>=1.0.0
Reading https://pypi.org/simple/spacy-loggers/
Downloading https://files.pythonhosted.org/packages/9a/34/44741cf6abdf29b6baee3bc8a0b868213ecb9ed2b9f1c83a276053a32a92/spacy_loggers-1.0.1-py3-none-any.whl#sha256=5e610c980efb831fa428c24fd659e5dd850ea6140c9ed987efe0e8d26df3ee7c
Best match: spacy-loggers 1.0.1
Processing spacy_loggers-1.0.1-py3-none-any.whl
Installing spacy_loggers-1.0.1-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding spacy-loggers 1.0.1 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/spacy_loggers-1.0.1-py3.9.egg
Searching for spacy-legacy<3.1.0,>=3.0.8
Reading https://pypi.org/simple/spacy-legacy/
Downloading https://files.pythonhosted.org/packages/d3/e8/1bc00eeff3faf1c50bde941f88a491a5c1128debb75dd8c913401e71585c/spacy_legacy-3.0.8-py2.py3-none-any.whl#sha256=eb37a3540bb461b5fe9348d4976784f18a0e345982e41e2c5c7cd8229889e825
Best match: spacy-legacy 3.0.8
Processing spacy_legacy-3.0.8-py2.py3-none-any.whl
Installing spacy_legacy-3.0.8-py2.py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding spacy-legacy 3.0.8 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/spacy_legacy-3.0.8-py3.9.egg
Searching for pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4
Reading https://pypi.org/simple/pydantic/
Downloading https://files.pythonhosted.org/packages/ff/74/54e030641601112309f6d2af620774e9080f99c7a15742fc6a0b170c4076/pydantic-1.8.2-py3-none-any.whl#sha256=fec866a0b59f372b7e776f2d7308511784dace622e0992a0b59ea3ccee0ae833
Best match: pydantic 1.8.2
Processing pydantic-1.8.2-py3-none-any.whl
Installing pydantic-1.8.2-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding pydantic 1.8.2 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/pydantic-1.8.2-py3.9.egg
Searching for preshed<3.1.0,>=3.0.2
Reading https://pypi.org/simple/preshed/
Downloading https://files.pythonhosted.org/packages/24/d8/1d895e64a1582937b6571d30c4556cc8c6197a804ece12937a76053c3e77/preshed-3.0.6-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=cfe1495fcfc7f479de840ddc4f426dbb55351e218ae5c8712c1269183a4d0060
Best match: preshed 3.0.6
Processing preshed-3.0.6-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing preshed-3.0.6-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding preshed 3.0.6 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/preshed-3.0.6-py3.9-linux-x86_64.egg
Searching for pathy>=0.3.5
Reading https://pypi.org/simple/pathy/
Downloading https://files.pythonhosted.org/packages/44/b9/43b8bdc8154f7b895291a3573816216f1c00c23cda7ca2849f3bf9a07e46/pathy-0.6.1-py3-none-any.whl#sha256=25fd04cec6393661113086730ce69c789d121bea83ab1aa18452e8fd42faf29a
Best match: pathy 0.6.1
Processing pathy-0.6.1-py3-none-any.whl
Installing pathy-0.6.1-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding pathy 0.6.1 to easy-install.pth file
Installing pathy script to /home/jaten/anaconda3/envs/jasonenv/bin

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/pathy-0.6.1-py3.9.egg
Searching for murmurhash<1.1.0,>=0.28.0
Reading https://pypi.org/simple/murmurhash/
Downloading https://files.pythonhosted.org/packages/1f/b7/448937c171e0f5a504a58b6aebaaf51b6b81ba0b5f0d9b164166046c7985/murmurhash-1.0.7.dev0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=419e76afe6fa2ecbbf762bc39b9593862cfa53bbf873a679b90e152d4401950e
Best match: murmurhash 1.0.7.dev0
Processing murmurhash-1.0.7.dev0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing murmurhash-1.0.7.dev0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding murmurhash 1.0.7.dev0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/murmurhash-1.0.7.dev0-py3.9-linux-x86_64.egg
Searching for langcodes<4.0.0,>=3.2.0
Reading https://pypi.org/simple/langcodes/
Downloading https://files.pythonhosted.org/packages/fe/c3/0d04d248624a181e57c2870127dfa8d371973561caf54333c85e8f9133a2/langcodes-3.3.0-py3-none-any.whl#sha256=4d89fc9acb6e9c8fdef70bcdf376113a3db09b67285d9e1d534de6d8818e7e69
Best match: langcodes 3.3.0
Processing langcodes-3.3.0-py3-none-any.whl
Installing langcodes-3.3.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding langcodes 3.3.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/langcodes-3.3.0-py3.9.egg
Searching for jinja2
Reading https://pypi.org/simple/jinja2/
Downloading https://files.pythonhosted.org/packages/20/9a/e5d9ec41927401e41aea8af6d16e78b5e612bca4699d417f646a9610a076/Jinja2-3.0.3-py3-none-any.whl#sha256=077ce6014f7b40d03b47d1f1ca4b0fc8328a692bd284016f806ed0eaca390ad8
Best match: Jinja2 3.0.3
Processing Jinja2-3.0.3-py3-none-any.whl
Installing Jinja2-3.0.3-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding Jinja2 3.0.3 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/Jinja2-3.0.3-py3.9.egg
Searching for cymem<2.1.0,>=2.0.2
Reading https://pypi.org/simple/cymem/
Downloading https://files.pythonhosted.org/packages/aa/39/038d9b5331b48aa27a96095b450057ce861384b9ee309ba111a88b531812/cymem-2.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=04676d696596b0db3f3c5a3936bab12fb6f24278921a6622bb185e61765b2b4d
Best match: cymem 2.0.6
Processing cymem-2.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing cymem-2.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding cymem 2.0.6 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/cymem-2.0.6-py3.9-linux-x86_64.egg
Searching for catalogue<2.1.0,>=2.0.6
Reading https://pypi.org/simple/catalogue/
Downloading https://files.pythonhosted.org/packages/1f/8b/273bf7d3863570302401991839e1b2c68ae544cc5b02367f58089db872cb/catalogue-2.0.6-py3-none-any.whl#sha256=34ebb5cd2b98f7fa7421fa0eead3b84e577243532509b3fa8cd04abcc9f61d3c
Best match: catalogue 2.0.6
Processing catalogue-2.0.6-py3-none-any.whl
Installing catalogue-2.0.6-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding catalogue 2.0.6 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/catalogue-2.0.6-py3.9.egg
Searching for blis<0.8.0,>=0.4.0
Reading https://pypi.org/simple/blis/
Downloading https://files.pythonhosted.org/packages/fa/2a/b76e7e06298ac035baca2e7c8d3d6b8eb80fe1c481c56b1768c431f917d2/blis-0.7.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=8345bd04777557ef385e2f2d1f14a19d53b2ea9ca5fe107a2cdc50d7bafb8eb2
Best match: blis 0.7.5
Processing blis-0.7.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing blis-0.7.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding blis 0.7.5 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/blis-0.7.5-py3.9-linux-x86_64.egg
Searching for protobuf>=3.8.0
Reading https://pypi.org/simple/protobuf/
Downloading https://files.pythonhosted.org/packages/b7/d3/37c36b3f5b125ac0d5b9f10d51dbecca355e24c233fd8e447c9879338ec2/protobuf-4.0.0rc2-py2.py3-none-any.whl#sha256=5df64b064b1b15e03768295939cbb5595733a02e8945dc033e56c6a9667a225c
Best match: protobuf 4.0.0rc2
Processing protobuf-4.0.0rc2-py2.py3-none-any.whl
Installing protobuf-4.0.0rc2-py2.py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding protobuf 4.0.0rc2 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/protobuf-4.0.0rc2-py3.9.egg
Searching for kiwisolver>=1.0.1
Reading https://pypi.org/simple/kiwisolver/
Downloading https://files.pythonhosted.org/packages/1f/99/58fe27c8e4a3de823f9fc28ab2c415347efc4139f1c85cac65a008007210/kiwisolver-1.3.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl#sha256=30fa008c172355c7768159983a7270cb23838c4d7db73d6c0f6b60dde0d432c6
Best match: kiwisolver 1.3.2
Processing kiwisolver-1.3.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Installing kiwisolver-1.3.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding kiwisolver 1.3.2 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/kiwisolver-1.3.2-py3.9-linux-x86_64.egg
Searching for fonttools>=4.22.0
Reading https://pypi.org/simple/fonttools/
Downloading https://files.pythonhosted.org/packages/1d/46/65a58d7b92905e2767000b3f6eb1d0301e9ed7d459d14461075c1db63349/fonttools-4.29.1-py3-none-any.whl#sha256=1933415e0fbdf068815cb1baaa1f159e17830215f7e8624e5731122761627557
Best match: fonttools 4.29.1
Processing fonttools-4.29.1-py3-none-any.whl
Installing fonttools-4.29.1-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding fonttools 4.29.1 to easy-install.pth file
Installing fonttools script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing pyftmerge script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing pyftsubset script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing ttx script to /home/jaten/anaconda3/envs/jasonenv/bin

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/fonttools-4.29.1-py3.9.egg
Searching for cycler>=0.10
Reading https://pypi.org/simple/cycler/
Downloading https://files.pythonhosted.org/packages/5c/f9/695d6bedebd747e5eb0fe8fad57b72fdf25411273a39791cde838d5a8f51/cycler-0.11.0-py3-none-any.whl#sha256=3a27e95f763a428a739d2add979fa7494c912a32c17c4c38c4d5f082cad165a3
Best match: cycler 0.11.0
Processing cycler-0.11.0-py3-none-any.whl
Installing cycler-0.11.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding cycler 0.11.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/cycler-0.11.0-py3.9.egg
Searching for threadpoolctl>=2.0.0
Reading https://pypi.org/simple/threadpoolctl/
Downloading https://files.pythonhosted.org/packages/61/cf/6e354304bcb9c6413c4e02a747b600061c21d38ba51e7e544ac7bc66aecc/threadpoolctl-3.1.0-py3-none-any.whl#sha256=8b99adda265feb6773280df41eece7b2e6561b772d21ffd52e372f999024907b
Best match: threadpoolctl 3.1.0
Processing threadpoolctl-3.1.0-py3-none-any.whl
Installing threadpoolctl-3.1.0-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding threadpoolctl 3.1.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/threadpoolctl-3.1.0-py3.9.egg
Searching for scipy>=1.1.0
Reading https://pypi.org/simple/scipy/
Downloading https://files.pythonhosted.org/packages/b8/51/6a058c1c742c8365399c93685a5b3c4f9c39389957189725738954c427a0/scipy-1.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl#sha256=f3720d0124aced49f6f2198a6900304411dbbeed12f56951d7c66ebef05e3df6
Best match: scipy 1.8.0
Processing scipy-1.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Installing scipy-1.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding scipy 1.8.0 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/scipy-1.8.0-py3.9-linux-x86_64.egg
Searching for smart-open<6.0.0,>=5.0.0
Reading https://pypi.org/simple/smart-open/
Downloading https://files.pythonhosted.org/packages/cd/11/05f68ea934c24ade38e95ac30a38407767787c4e3db1776eae4886ad8c95/smart_open-5.2.1-py3-none-any.whl#sha256=71d14489da58b60ce12fc3ecb823facc59a8b23cd1b58edb97175640350d3a62
Best match: smart-open 5.2.1
Processing smart_open-5.2.1-py3-none-any.whl
Installing smart_open-5.2.1-py3-none-any.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding smart-open 5.2.1 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/smart_open-5.2.1-py3.9.egg
Searching for MarkupSafe>=2.0
Reading https://pypi.org/simple/MarkupSafe/
Downloading https://files.pythonhosted.org/packages/c2/db/314df69668f582d5173922bded7b58126044bb77cfce6347c5d992074d2e/MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl#sha256=1f2ade76b9903f39aa442b4aadd2177decb66525062db244b35d71d0ee8599b6
Best match: MarkupSafe 2.0.1
Processing MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Installing MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl to /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Adding MarkupSafe 2.0.1 to easy-install.pth file

Installed /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages/MarkupSafe-2.0.1-py3.9-linux-x86_64.egg
Searching for transformers==4.16.2
Best match: transformers 4.16.2
Adding transformers 4.16.2 to easy-install.pth file
Installing transformers-cli script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for tokenizers==0.11.4
Best match: tokenizers 0.11.4
Adding tokenizers 0.11.4 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for python-dateutil==2.8.2
Best match: python-dateutil 2.8.2
Adding python-dateutil 2.8.2 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for numpy==1.21.2
Best match: numpy 1.21.2
Adding numpy 1.21.2 to easy-install.pth file
Installing f2py script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing f2py3 script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing f2py3.9 script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for huggingface-hub==0.4.0
Best match: huggingface-hub 0.4.0
Adding huggingface-hub 0.4.0 to easy-install.pth file
Installing huggingface-cli script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for regex==2022.1.18
Best match: regex 2022.1.18
Adding regex 2022.1.18 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for filelock==3.4.2
Best match: filelock 3.4.2
Adding filelock 3.4.2 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for packaging==21.3
Best match: packaging 21.3
Adding packaging 21.3 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for requests==2.27.1
Best match: requests 2.27.1
Adding requests 2.27.1 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for PyYAML==6.0
Best match: PyYAML 6.0
Adding PyYAML 6.0 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for sacremoses==0.0.47
Best match: sacremoses 0.0.47
Adding sacremoses 0.0.47 to easy-install.pth file
Installing sacremoses script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for tqdm==4.62.3
Best match: tqdm 4.62.3
Adding tqdm 4.62.3 to easy-install.pth file
Installing tqdm script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for setuptools==58.0.4
Best match: setuptools 58.0.4
Adding setuptools 58.0.4 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for torchvision==0.11.3
Best match: torchvision 0.11.3
Adding torchvision 0.11.3 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for torch==1.10.2
Best match: torch 1.10.2
Adding torch 1.10.2 to easy-install.pth file
Installing convert-caffe2-to-onnx script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing convert-onnx-to-caffe2 script to /home/jaten/anaconda3/envs/jasonenv/bin
Installing torchrun script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for pyparsing==3.0.7
Best match: pyparsing 3.0.7
Adding pyparsing 3.0.7 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for Pillow==8.4.0
Best match: Pillow 8.4.0
Adding Pillow 8.4.0 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for six==1.16.0
Best match: six 1.16.0
Adding six 1.16.0 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for typing-extensions==3.10.0.2
Best match: typing-extensions 3.10.0.2
Adding typing-extensions 3.10.0.2 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for charset-normalizer==2.0.11
Best match: charset-normalizer 2.0.11
Adding charset-normalizer 2.0.11 to easy-install.pth file
Installing normalizer script to /home/jaten/anaconda3/envs/jasonenv/bin

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for urllib3==1.26.8
Best match: urllib3 1.26.8
Adding urllib3 1.26.8 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for idna==3.3
Best match: idna 3.3
Adding idna 3.3 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for certifi==2021.10.8
Best match: certifi 2021.10.8
Adding certifi 2021.10.8 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for click==8.0.3
Best match: click 8.0.3
Adding click 8.0.3 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Searching for joblib==1.1.0
Best match: joblib 1.1.0
Adding joblib 1.1.0 to easy-install.pth file

Using /home/jaten/anaconda3/envs/jasonenv/lib/python3.9/site-packages
Finished processing dependencies for fast-bert==1.9.15
$

@glycerine
Copy link
Author

This was on Ubuntu 18, amd64, specific versions:

$ uname -a
Linux rog 5.4.0-91-generic #102~18.04.1-Ubuntu SMP Thu Nov 11 14:46:36 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.5 LTS"
(jasonenv) jaten@rog ~ $ python
Python 3.9.7 (default, Sep 16 2021, 13:09:58)
[GCC 7.5.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@glycerine