Available Models

The following models are available in Seaplane today. Some models have cold start times others do not.

model name	type	parameter size	cold start
all-mpnet-base-v2	embeddings	na	yes
zephyr-7b-beta	LLM	7 billion	yes
mistral-7b-instruct	LLM Instruct	7 billion	yes
mixtral-8x7b-instruct-v0.1	LLM Instruct	7 billion	yes
bge-large-en-v1.5	LLM		yes
starling-lm-7b-alpha	LLM	7 billion	yes
yi-34b-chat	LLM Chat	34 billion	yes
yi-6b	LLM	6 billion	yes
falcon-40b-instruct	LLM instruct	40 billion	yes
vicuna-13b	LLM	13 billion	yes
phi-2	LLM		yes
olmo-7b	LLM	7 billion	yes
llama-2-7b-chat	LLM Chat	7 billion	yes
llama-2-13b-chat	LLM Chat	13 billion	yes
llama-2-70b-chat	LLM Chat	70 billion	yes
codellama-7b-instruct	LLM Instruct	7 billion	yes
codellama-7b-python	LLM Code	7 billion	yes
codellama-13b-instruct	LLM Code	13 billion	yes
codellama-34b-instruct	LLM Code	34 billion	yes
codellama-34b-python	LLM Code	34 billion	yes
codellama-70b	LLM Code	70 billion	yes
codellama-70b-instruct	LLM Code	70 billiion	yes
codellama-70b-python	LLM Code	70 billion	yes
wizardcoder-34b-v1.0	LLM	34 billion	yes
stable-diffusion	Generative Art	na	yes
sdxl	Generative Art	na	yes
stable-diffusion-inpainting	Generative Art	na	yes
whisper	STT	na	yes
styletts2	TTS	na	yes
resnet	LLM		yes
huggingfaceh4/zephyr-7b-beta	LLM	7 billion	yes
chat-azure-openai-gpt35-turbo16k	LLM		yes