GPT-J 6B inference on TensorRT with INT-8 precision
-
Updated
Apr 5, 2023 - Python
GPT-J 6B inference on TensorRT with INT-8 precision
Key python tools for inference: Sample functions, Confidence Intervals, Hypotheses testing, Bootstrapping and Cross Validation. This repo is made for learning purposes.
Token-wise and real-time display Inference module for Llama2 and other LLMs.
Motor de inferencia hecho en SQL Server con capa de exposición en C# y un sitio de generación y consumo de reglas de ejemplo.
A test project to try making abstract type inference
Learn OOV inference ability from word embedding vector
Inferring password composition policies from breached user credential databases.
Code for the active inference simulations in: The Acquisition of Culturally Patterned Attention Styles under Active Inference
Python program to perform object detection inference with Tensorflow 2.0.
Learning LTL formulae from finite system traces.
Test Time Augmentation for Deep Learning Inference
Alpha Belief Propagation
STM32 letter + digit classification based on EMNIST(47 classes) on STM B-L475E-IOT01A board.
📊 Hypothesis testing - how significant is significant?
Repo for the winning submission of 2020 Duke Datathon. Performed inference and predictive modeling and forecasting on the economic impact of COVID-19 for different countries.
Raspberry Pi project using Intel's Neural Compute Stick with pre-trained MobileNet model for edge based streaming inference and SMS notification when class (dog) is in identified in frame
It shows how to create custom component for image classification in IoT Device.
Add a description, image, and links to the inference topic page so that developers can more easily learn about it.
To associate your repository with the inference topic, visit your repo's landing page and select "manage topics."