Skip to content

Latest commit

 

History

History
56 lines (41 loc) · 2.31 KB

README.md

File metadata and controls

56 lines (41 loc) · 2.31 KB

What's Neural Solution?

Neural Solution is a flexible and easy to use tool that brings the capabilities of Intel® Neural Compressor as a service. With Neural Solution, Users can effortlessly submit optimization tasks through the RESTful/gRPC APIs. Neural Solution automatically dispatches these tasks to one or multiple nodes, streamlining the entire process.

Why Neural Solution?

  • Task Parallelism: Neural Solution automatically schedules the optimization task queue by coordinating available resources and allows execution of multiple optimization tasks simultaneously.
  • Tuning Parallelism: Neural Solution accelerates the optimization process by seamlessly parallelizing the tuning across multiple nodes.
  • APIs Support: Neural Solution supports both RESTful and gRPC APIs, enabling users to conveniently submit optimization tasks.
  • Code Less: When working with Hugging Face models, Neural Solution seamlessly integrates the functionality of the Neural Coder, eliminating the need for any code modifications during the optimization process.

How does Neural Solution Work?

NS-OaaS-Intro

Get Started

Installation

Prerequisites

There are two ways to install the neural solution:

Method 1. Using pip:

pip install neural-solution

Method 2. Building from source:

# get source code
git clone https://github.com/intel/neural-compressor
cd neural-compressor

# install neural compressor
pip install -r requirements.txt
python setup.py install

# install neural solution
pip install -r neural_solution/requirements.txt
python setup.py neural_solution install

End-to-end examples

Learn More

Contact

Please contact us at [email protected] for any Neural Solution related question.