Skip to content

This repository is about a comparison of some text preprocessing methods that i have used when working on a NLP (Natural Language Processing) project

Notifications You must be signed in to change notification settings

Hermann-web/text-preprocessing-methods-for-NLP-search-engine

Repository files navigation

text-preprocessing-methods

It is not obvious to compute all parts of a NLP project in french language. After some research, i've found/created some methods that you could use for your own NLP projects.

Text pre-processing methods

A preprocessing algorithm

After these benchmark You cand find an function named SENTENCE_TO_CORRECT_WORDS in the file all.py that use these methods to get french tokens from a french sentence.

You can also find my search engine that use preprocessing and semantic similarities here

requirements

You can find them here. In respect of the methods you want to test, you can just install some of them

About

This repository is about a comparison of some text preprocessing methods that i have used when working on a NLP (Natural Language Processing) project

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published