Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature Request: Distributed inference API where the "miners" are paid. #556

Open
NewtonTrendy opened this issue Feb 20, 2024 · 1 comment
Open

Feature Request: Distributed inference API where the "miners" are paid. #556

NewtonTrendy opened this issue Feb 20, 2024 · 1 comment

Comments

@NewtonTrendy
Copy link

I'm imagining a situation where people can infer for others and make a small profit. In practicality it is similar to, but more useful than, cryptocurrency mining. You would get paid a small amount per percent of a request you inferred by users of the inference API.
If the system was built people could load their own models into the cluster and it would make sure demand is met at market rate. This would improve access for individuals to large compute in projects they want to develop, and would not be a worse use of compute than cryptocurrency mining.
@NewtonTrendy NewtonTrendy changed the title Feature Request: Paid distributed crypto inference API. Feature Request: Paid distributed inference API. Feb 20, 2024
@NewtonTrendy NewtonTrendy changed the title Feature Request: Paid distributed inference API. Feature Request: Distributed inference API where the "miners" are paid. Feb 20, 2024
@Priyanshupareek
Copy link
Contributor

Hey @NewtonTrendy I was thinking on similar lines and am working on this. Wanna chat more on discord?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Priyanshupareek @NewtonTrendy