Nemeski@lemm.ee to Firefox@lemmy.ml · 4 months agoOrbit by Mozillaorbitbymozilla.comexternal-linkmessage-square11fedilinkarrow-up11arrow-down10cross-posted to: [email protected][email protected]
arrow-up11arrow-down1external-linkOrbit by Mozillaorbitbymozilla.comNemeski@lemm.ee to Firefox@lemmy.ml · 4 months agomessage-square11fedilinkcross-posted to: [email protected][email protected]
minus-squareGenderNeutralBro@lemmy.sdf.orglinkfedilinkEnglisharrow-up1·4 months ago Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance. Hmm. >locally hosted >Google Cloud Hmmmmmmmmmmmmmmmm.
minus-squareSzethFriendOfNimi@lemmy.worldlinkfedilinkarrow-up1·edit-24 months agoSounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API. As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.
minus-squaresugar_in_your_tea@sh.itjust.workslinkfedilinkarrow-up1·4 months agoYeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.
Hmm.
>locally hosted
>Google Cloud
Hmmmmmmmmmmmmmmmm.
Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.
As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.
Yeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.