Skip to content

Check the NSFW level of articles at the Velvet section of index.hu

Notifications You must be signed in to change notification settings

kviktor/velvet-check

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

52 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Velvet Check build

A simple utility to check the NSFW level of articles at the Velvet section of index.hu.

Before

before

After

after

Installation

To whole NSFW classification is based on open_nsfw which uses caffe. To install caffe follow the documentation or these snippets below (they are basically the same).

Create Python virtual env

pyenv install 3.8.2
pyenv virtualenv 3.8.2 velvet-check
pyenv local velvet-check

Clone the caffe and yahoo's open_nsfw

git clone https://github.com/yahoo/open_nsfw.git
git clone https://github.com/BVLC/caffe.git

Install the required dependencies while in virtualenv already, tested on Ubuntu 16.04 and Manjaro

sudo apt-get install libprotobuf-dev libleveldb-dev libsnappy-dev libopencv-dev libhdf5-serial-dev protobuf-compiler libatlas-base-dev libgflags-dev libgoogle-glog-dev liblmdb-dev python-dev
sudo apt-get install --no-install-recommends libboost-all-dev

# openblas doesn't work, see this comment
# https://github.com/BVLC/caffe/issues/2353#issuecomment-612492470
sudo pacman -Syu boost gflags google-glog cblas hdf5

Build caffe and the python package, Makefile.config used at: https://gist.github.com/kviktor/6be1d8d569d293aa292c3badd65f8ab9

cd caffe
pip install -r python/requirements.txt
cp Makefile.config.example Makefile.config  # for the correct settings follow the previously mentioned documentation
make all -j2
make pycaffe

Test that it works (it probably won't as it doesn't support py3 out of the box, just modify tasks.py and check whats up)

export PYTHONPATH=/path/to/caffe/python:$PYTHONPATH
cd ../open_nsfw
python ./classify_nsfw.py \
--model_def nsfw_model/deploy.prototxt \
--pretrained_model nsfw_model/resnet_50_1by2_nsfw.caffemodel \
INPUT_IMAGE_PATH

Now to install Velvet Check clone this repo, enter it and run the following commands.

sudo apt-get install redis-server sqlite3
pip install -r server/requirements.txt