Not LLM but I'm currently trying to host image genAI (comfyui) on runpod. I've tried replicate too. replicate is more simple, runpod has many opensource images. What are you gonna host ?
Thread
Does anyone have experience with hosting LLMs or generative AI in the cloud? If so, I'd really appreciate your input! Hit me up with a DM or just reply here 😊
Saw your comment about backstage-ai, looks cool. I'm unsure as to what I wanna do, was just wondering where to start looking, runpod and replicate both look awesome, thanks man!
yeah! replicate is more simple with integrated backend API, might be good to start! I'm so glad there's designer like you trying AI apps. I hope more designers to use open source generative AI 😀😀