Skip to content

Enables creation of complex NLP pipelines in seconds, for processing static files or streaming text, using a set of simple command line tools. Perform multiple operation on text like NER, Sentiment Analysis, Chunking, Language Identification, Q&A, 0-shot Classification and more by executing a single command in the terminal. Can be used as a low …

License

Notifications You must be signed in to change notification settings

code2k13/nlphose

Repository files navigation

nlphose Nlphose is a set of command-line tools that enables creation of complex NLP pipelines within seconds. It currently supports following operation on static files and streaming data:

  • Sentiment Analysis (AFINN)
  • NER (Spacy)
  • Language Identification (FastText)
  • Chunking (NLTK)
  • Sentiment Analysis (Transformers)
  • Question Answering (Transformers)
  • Zero shot Classification (Transformers)

👇🏻Below is a sample pipeline that streams in 🗨️ tweets containing the term ⛈️'rainfall' and tries to guess the 🏙️ place it rained using extractive question answering.

twint -s 'rainfall' |\
./twint2json.py |\
./xformer.py --pipeline question-answering --param 'where did it rain' |\
jq '{"text":.text,"answer":.xfrmr_question_answering.answer}'

Nlphose pipelines can run on your laptop or on a cluster of computers using Kubernetes or Pyspark.

😲😲😲 Looks interesting ??

Checkout the 🔗installation guide and 🔎some usage examples. Please refer to the wiki for 📖detailed documentation

GUI Pipeline Builder (WIP)

I am also working on a GUI Pipeline buider tool which allows users to create a pipeline by simply drag-and-drop

For more details visit it's repository : https://github.com/code2k13/nlphoseGUI

About

Enables creation of complex NLP pipelines in seconds, for processing static files or streaming text, using a set of simple command line tools. Perform multiple operation on text like NER, Sentiment Analysis, Chunking, Language Identification, Q&A, 0-shot Classification and more by executing a single command in the terminal. Can be used as a low …

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published