Free AI Hosting
Host AI models for free. GPU access, API hosting, and cloud deployment.
Wolkm Gesteen
Gebruik Free.ai infrastruktuur. Nul opstelling, nul instandhouding. Alle modelle word vooraf gelaai en gereed om te gebruik via API of web UI.
Beskikbaar NouSelf- Hosted (DIY)
Hardloop dieselfde ope-gewig modelle op jou eie hardeware, gebruik die gewigte wat hulle skrywers publiseer en standaard diensgereedskap. Ons publiseer nie 'n Docker-beeld nie.
Self-diensBestuur Private
Toegewyde GPU bedieners wat deur ons bestuur is, het in u voorkeur wolkstreek ontplooi. Vol data afsondering en pasmaak SLA.
OndernemingSelf-Hoste Depleyment
Ons self-geënaarde modelle is opegewig modelle waarvan die skrywers die gewigte publiseer, die meeste onder permissiewe lisensies (na elke modelkaart). Ons publiseer nie 'n Docker-beeld of ons eie inference bediener nie; om self 'n model te loop, gebruik' n standaard open- seurce-bediener soos illM:
# Example with vLLM (third-party, Apache 2.0) and a Qwen model from Hugging Face
pip install vllm
vllm serve Qwen/Qwen3-30B-A3B-Instruct-2507 --port 8000Minimum vereistes
- NVIDIA GPU met 24GB+ VRAM (RTX 4090, A5000, A100)
- CUDA 12,0+ en 'n onlangse NVIDIË bestuurder
- 16GB+ stelsel Ram, 100GB+ stooring per model
- Vir 72B parameter modelle: 80GB VRAM (A100) of multi-GPU-opstelling
Waarom Self-Host?
- Data privaatheid — Your data never leaves your servers
- Geen tempo beperk — Unlimited inference on your hardware
- Nakoming — Meet data residency requirements
- Pasmaak — Fine-tune models on your data
- Duur beheer — Fixed hardware costs, no per-token fees
- Air- apped — Runs fully offline
Constellation name (optional)
Wolk Gegrewatteer (gebruik ons infrastruktuur, nul opstelling) is die standaard opsie. Jy kan ook self die opegewig modelle op jou eie GPU's bestuur met standaard gereedskap, sonder ons hulp of ons sagteware. ' n Bestuurder vir private ontplooiing (bedikeerde GPU bedieners wat deur ons bestuur word) is ge omvang en aangehaal per rekening.
Dit hang af van die model en die bedieningshulpmiddel. As'n moeilike gids,'n NVIDIA GPU met 24GB+ VRAM (RTX 4090, A5000, A100), CUDA 12,0+, 16GB+-stelsel Ram en 100GB+ - berging per model; 70B-klasmodelle het 80GBVRAM of verskeie GPUs nodig. Bevestig die model kaart en jou diens gereedskap se dokumentasie.
As jy self opegewig modelle loop, kan hulle af- lyn hardloop sodra jy die gewigte afgelaai het en jou gereedskap vir diens. Dit opstelling is joune: ons stuur nie sagteware daarvoor aan nie.
We do not publish a Docker image or an installer. Download the model weights from the model author (usually on Hugging Face) and serve them with a standard open-source tool such as vLLM. If you want us to deploy and run it for you, email hello@free.ai and we scope it per account.
All self-hosted models use permissive open-source licenses -- Apache 2.0, MIT, or BSD. You can use them commercially without restrictions. We deliberately exclude models with restrictive licenses like Meta's Llama license.
Managed private hosting gives you dedicated GPU servers in your preferred cloud region, fully managed by our team. We handle setup, patching, model updates, and monitoring. You get full data isolation with an enterprise SLA.
If the model's license allows it, you can fine-tune the open weights yourself with standard frameworks such as Hugging Face Transformers. We do not provide fine-tuning tools or images.
Contact our sales team to discuss a trial period. We typically offer a short evaluation period for enterprise prospects to test managed private hosting before committing to a long-term plan.
Cloud hosting uses the standard token-based pricing. Self-hosted is free -- you only pay for your own hardware and electricity. Managed private hosting is priced based on GPU allocation, region, and SLA level.
Yes. You can run some open-weight models yourself and use the Free.ai cloud for everything else. Routing requests between the two is up to you, and your own server's API will follow whatever tool you run.
Ons voorsien nie sagteware of ondersteuning vir die gebruik van jou eie gebruik nie. 'n bestuurde private ontplooiing, ge omvang per rekening, sluit tegniese ondersteuning in deur e-pos, monitering en 'n toegewyde rekening bestuurder.
Cloud hosted is best for teams that want zero maintenance. Self-hosted is ideal for data privacy, compliance, or unlimited usage on your own hardware. Managed private is the best of both worlds -- full data isolation with no operational burden.