Modal Serverless GPU Integration

[DoctorSlimm]

heyyy has anybody tried to integrate this / run it on Modal Serverless GPUs?

/ would running this service be faster than

texts = body['texts']
embeddings = model.encode(texts)
return {
'statusCode': 200,
'embeddings': embeddings 
}

[numb3r3]

tbh, i'm not sure I fully got your points. Anyway, we already integrated this embedding product into our Jina Cloud and make it accessible public https://cloud.jina.ai/user/inference. It works smoothly and efficiently.