Rayraegah / nsfw_japan Public

Notifications You must be signed in to change notification settings
Fork 3
Star 14

nsfw dataset with images and text for content moderation in Japan

14 stars 3 forks Branches Tags Activity

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
raw_data		raw_data
source_urls		source_urls
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md

Repository files navigation

NSFW Japan

dataset

Description

Repository contains lists of URLs that will help you download NSFW images, this set can be used in building big enough dataset to train robust NSFM classification model.

This work inspired by nsfw_data_scrapper and for downloading images suggested to use scripts from the scrapper.

NOTE

After downloading is highly suggested to clean your dataset, for example:
- delete duplicates
- remove images that was banned/deleted (they have a special image placeholder)
- find out corrupted data and remove it also
- etc
Pay attention to noise, some resources provide highly mixed data of NSFW and neutral images
This repository helps in retrieving NSFW images and there's no special URLs for neutral content