My Dockerfile for crawler and pyright lsp support
- python3
- node.js
- requests httpx
- curl_cffi (bypass anti-bot through fingerprint)
- beautifulsoup4 pyquery lxml
- lzstring
- node_vm2 (for execute javascript)
- ipython
- cchardet
- ujson
- numpy SQLAlchemy
docker pull b09780978/crawler
docker container run -idt -v {YOUR_CODE_DIR}:{DOCKER_DIR} --name crawler b09780978/crawler
docker container exec -it crawler script /dev/null -c tmux
docker run --rm -it b09780978/crawler
docker pull b09780978/crawler:deploy
docker container run -it -v {YOUR_CODE_DIR}:{DOCKER_DIR} --name crawler b09780978/crawler
Deploy version use python-alpine image