> ## Documentation Index
> Fetch the complete documentation index at: https://portkey-docs-chore-remove-get-model-generals-api.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Portkey connects with all major LLM providers and orchestration frameworks.

## Supported AI Providers

<CardGroup cols={3}>
  <Card title="OpenAI" href="/integrations/llms/openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/open-ai.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=d4ceca594505c109bd81ce3fe19ac5ef" alt="OpenAI" width="245" height="138" data-path="images/supported-llm/open-ai.avif" />
    </Frame>
  </Card>

  <Card title="Anthropic" href="/integrations/llms/anthropic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/anthroic.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=9ae4297ac98da8e60f49b5283cf07174" alt="Anthropic" width="245" height="138" data-path="images/supported-llm/anthroic.avif" />
    </Frame>
  </Card>

  <Card title="Azure OpenAI" href="/integrations/llms/azure-openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/microsoft-assure.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=64bf5bc8f6b104f3117f47511e72d184" alt="Azure OpenAI" width="245" height="138" data-path="images/supported-llm/microsoft-assure.avif" />
    </Frame>
  </Card>

  <Card title="AWS Bedrock" href="/integrations/llms/aws-bedrock">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/amazon.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=d0433417f917bd8a41e27683c27c1f86" alt="AWS Bedrock" width="245" height="138" data-path="images/supported-llm/amazon.avif" />
    </Frame>
  </Card>

  <Card title="Cerebras" href="/integrations/llms/cerebras">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/0KUvg8mUpbDnaAES/images/llms/cerebras.avif?fit=max&auto=format&n=0KUvg8mUpbDnaAES&q=85&s=22d8d372d438497ea9c2886d6078165a" alt="Cerebras" width="770" height="480" data-path="images/llms/cerebras.avif" />
    </Frame>
  </Card>

  <Card title="Google Gemini" href="/integrations/llms/gemini">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/google-gemini.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=6fa02e017200995442686e274f8742b0" alt="Google Gemini" width="245" height="138" data-path="images/supported-llm/google-gemini.avif" />
    </Frame>
  </Card>

  <Card title="Vertex AI" href="/integrations/llms/vertex-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/vertex-ai.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=e4dc2ac3bc43ba6e5d3f63109f1b4084" alt="Vertex AI" width="245" height="138" data-path="images/supported-llm/vertex-ai.avif" />
    </Frame>
  </Card>

  <Card title="Cohere" href="/integrations/llms/cohere">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/cohere.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=73681859187b3cf12d81642b9c6b2744" alt="Cohere" width="245" height="138" data-path="images/supported-llm/cohere.avif" />
    </Frame>
  </Card>

  <Card title="Perplexity AI" href="/integrations/llms/perplexity-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/perplexity-ai.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=b426a66d9c1824ed7b5436951bb88df3" alt="Perplexity AI" width="245" height="138" data-path="images/supported-llm/perplexity-ai.avif" />
    </Frame>
  </Card>

  <Card title="AI21" href="/integrations/llms/ai21">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/ai21.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=e77d5d42eea68ba1bb6feec752a907df" alt="AI21" width="245" height="138" data-path="images/supported-llm/ai21.avif" />
    </Frame>
  </Card>

  <Card title="Anyscale" href="/integrations/llms/anyscale-llama2-mistral-zephyr">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/anyscale.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=99a821f372184599e30b481d82a225b9" alt="Anyscale" width="245" height="138" data-path="images/supported-llm/anyscale.avif" />
    </Frame>
  </Card>

  <Card title="Byollm" href="/integrations/llms/byollm" />

  <Card title="Dashscope" href="/integrations/llms/dashscope">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/dashscope.jpeg?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=9416684511a722c382b500309d1541fd" alt="Dashscope" width="128" height="128" data-path="images/supported-llm/dashscope.jpeg" />
    </Frame>
  </Card>

  <Card title="Deepbricks" href="/integrations/llms/deepbricks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/deepbricks.jpeg?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=150c97e0d21b6e0c2876a1cb43938e2f" alt="Deepbricks" width="225" height="225" data-path="images/supported-llm/deepbricks.jpeg" />
    </Frame>
  </Card>

  <Card title="DeepInfra" href="/integrations/llms/deepinfra">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/deepinfa.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=bff3a58a2a0ac96d0247370b8f128561" alt="DeepInfra" width="245" height="138" data-path="images/supported-llm/deepinfa.avif" />
    </Frame>
  </Card>

  <Card title="DeepSeek" href="/integrations/llms/deepseek">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/deepseek.webp?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=6f31eff7787ab072905e6cb7795e7874" alt="DeepSeek" width="780" height="165" data-path="images/supported-llm/deepseek.webp" />
    </Frame>
  </Card>

  <Card title="Fireworks AI" href="/integrations/llms/fireworks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/fireworks.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=8c3e909a9ea62c20c0270b988ea71d91" alt="Fireworks AI" width="240" height="136" data-path="images/supported-llm/fireworks.png" />
    </Frame>
  </Card>

  <Card title="Featherless AI" href="/integrations/llms/featherless">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/featherless.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=4534f369855bd587538fd645145a9d56" alt="featherless-AI" width="225" height="225" data-path="images/supported-llm/featherless.png" />
    </Frame>
  </Card>

  <Card title="Github Models" href="/integrations/llms/github">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/0KUvg8mUpbDnaAES/images/llms/github.png?fit=max&auto=format&n=0KUvg8mUpbDnaAES&q=85&s=43ddecc3d8fa3a2eef86c896d870eb53" alt="Github" width="954" height="482" data-path="images/llms/github.png" />
    </Frame>
  </Card>

  <Card title="Google Palm" href="/integrations/llms/google-palm">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/google-palm.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=92900ee62712f7c82833f91f1488d251" alt="Google Palm" width="245" height="138" data-path="images/supported-llm/google-palm.avif" />
    </Frame>
  </Card>

  <Card title="Groq" href="/integrations/llms/groq">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/groq.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=2828579468c20599937202c9c24a7de3" alt="Groq" width="245" height="138" data-path="images/supported-llm/groq.avif" />
    </Frame>
  </Card>

  <Card title="Jina AI" href="/integrations/llms/jina-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/jina.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=67e3318eddc35a146729b28ed9e65ce1" alt="Jina AI" width="225" height="225" data-path="images/supported-llm/jina.png" />
    </Frame>
  </Card>

  <Card title="Lambda" href="/integrations/llms/lambda">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/lambda.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=698bee448c060cf1945cc473175baa85" alt="Lambda" width="225" height="225" data-path="images/supported-llm/lambda.png" />
    </Frame>
  </Card>

  <Card title="Lemonfox AI" href="/integrations/llms/lemon-fox">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/lemonfox-ai.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=f32252cc9dffe276a6cd1d40062ac8cc" alt="Lemonfox AI" width="225" height="225" data-path="images/supported-llm/lemonfox-ai.png" />
    </Frame>
  </Card>

  <Card title="Lepton AI" href="/integrations/llms/lepton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/lepton.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=e687ab2b0f631d44d4e1fed0db0cece2" alt="Lepton AI" width="311" height="85" data-path="images/supported-llm/lepton.png" />
    </Frame>
  </Card>

  <Card title="Lingyi (01.ai)" href="/integrations/llms/lingyi-01.ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/lingyi.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=e54398a5a071988203137e7e2d24e5dd" alt="Lingyi (01.ai)" width="200" height="200" data-path="images/supported-llm/lingyi.png" />
    </Frame>
  </Card>

  <Card title="LocalAI" href="/integrations/llms/local-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/local.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=08ab68f68f771168a6eb1d61cf9e71a9" alt="LocalAI" width="245" height="132" data-path="images/supported-llm/local.avif" />
    </Frame>
  </Card>

  <Card title="Mistral AI" href="/integrations/llms/mistral-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/mistral.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=2285b5d775471c70779ca29f5c3d067f" alt="Mistral AI" width="245" height="138" data-path="images/supported-llm/mistral.avif" />
    </Frame>
  </Card>

  <Card title="MonsterAPI" href="/integrations/llms/monster-api">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/monster.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=32c4c886a953e8ad8e3f89bfe1a9a426" alt="MonsterAPI" width="245" height="138" data-path="images/supported-llm/monster.avif" />
    </Frame>
  </Card>

  <Card title="Moonshot" href="/integrations/llms/moonshot">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/moonshoot.jpg?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=ae89090413baadee90b58f06fc0abb0a" alt="Moonshot" width="224" height="224" data-path="images/supported-llm/moonshoot.jpg" />
    </Frame>
  </Card>

  <Card title="nCompass" href="/integrations/llms/ncompass">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/0KUvg8mUpbDnaAES/images/llms/ncompass.jpeg?fit=max&auto=format&n=0KUvg8mUpbDnaAES&q=85&s=3ec7cbd022611eec4b5593aba8798dec" alt="nCompass" width="200" height="200" data-path="images/llms/ncompass.jpeg" />
    </Frame>
  </Card>

  <Card title="Nebius" href="/integrations/llms/nebius">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/nebius.jpeg?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=e5bb439b478ee3202665b08f5773cd73" alt="Nebius" width="200" height="200" data-path="images/supported-llm/nebius.jpeg" />
    </Frame>
  </Card>

  <Card title="Nomic AI" href="/integrations/llms/nomic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/nomic.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=ef1eba8dd79736b092cd635e3a42f090" alt="Nomic AI" width="245" height="138" data-path="images/supported-llm/nomic.avif" />
    </Frame>
  </Card>

  <Card title="Nscale" href="/integrations/llms/nscale">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/nscale.jpeg?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=f2827a5db363e328c0888363758b8442" alt="Nscale" width="259" height="194" data-path="images/supported-llm/nscale.jpeg" />
    </Frame>
  </Card>

  <Card title="Ollama" href="/integrations/llms/ollama">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/ollama.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=a00a1edd2f1019cc3679761e5371e46c" alt="Ollama" width="245" height="138" data-path="images/supported-llm/ollama.avif" />
    </Frame>
  </Card>

  <Card title="Openrouter" href="/integrations/llms/openrouter">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/openrouter.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=762e9db432839d79dc9e6af9727f45b5" alt="Openrouter" width="224" height="224" data-path="images/supported-llm/openrouter.png" />
    </Frame>
  </Card>

  <Card title="Predibase" href="/integrations/llms/predibase">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/predise.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=6553e8e655a6d5677f388a2a778fc564" alt="Predibase" width="245" height="132" data-path="images/supported-llm/predise.avif" />
    </Frame>
  </Card>

  <Card title="Recraft AI" href="/integrations/llms/recraft-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/0KUvg8mUpbDnaAES/images/llms/recraft.jpeg?fit=max&auto=format&n=0KUvg8mUpbDnaAES&q=85&s=abfb8410f4edbe75ba86ab57d29855bc" alt="Recraft" width="200" height="200" data-path="images/llms/recraft.jpeg" />
    </Frame>
  </Card>

  <Card title="Siliconflow" href="/integrations/llms/siliconflow">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/siliconflow.jpeg?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=c58fb1291bdea9ac025fcb544ae6862c" alt="Siliconflow" width="200" height="200" data-path="images/supported-llm/siliconflow.jpeg" />
    </Frame>
  </Card>

  <Card title="Snowflake Cortex" href="/integrations/llms/snowflake-cortex">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/0KUvg8mUpbDnaAES/images/llms/Snowflake%20Cortex%20Logo.png?fit=max&auto=format&n=0KUvg8mUpbDnaAES&q=85&s=bf0a2c79aa39b83e1c01aa175a7b4566" alt="Snowflake" width="225" height="225" data-path="images/llms/Snowflake Cortex Logo.png" />
    </Frame>
  </Card>

  <Card title="Stability AI" href="/integrations/llms/stability-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/stability.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=313ca95fa82854a1e72bf2170d687f59" alt="Stability AI" width="245" height="138" data-path="images/supported-llm/stability.avif" />
    </Frame>
  </Card>

  <Card title="Together AI" href="/integrations/llms/together-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/together-ai.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=bdbc34fcfde03ea3026fb17a16128c1b" alt="Together AI" width="245" height="138" data-path="images/supported-llm/together-ai.avif" />
    </Frame>
  </Card>

  <Card title="Triton" href="/integrations/llms/triton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/triton.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=8a10eba71986885202f93128fe1ae5b2" alt="Triton" width="254" height="198" data-path="images/supported-llm/triton.png" />
    </Frame>
  </Card>

  <Card title="Upstage" href="/integrations/llms/upstage">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/upstage.jpeg?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=12af562ba1a3a7580a2068df28a9272d" alt="Upstage" width="200" height="200" data-path="images/supported-llm/upstage.jpeg" />
    </Frame>
  </Card>

  <Card title="Voyage-AI" href="/integrations/llms/voyage-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/voyage.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=ffcdf9dbc1a1c558a75b9366e6c0cba5" alt="Voyage-AI" width="314" height="160" data-path="images/supported-llm/voyage.png" />
    </Frame>
  </Card>

  <Card title="Workers AI" href="/integrations/llms/workers-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/worksai.jpg?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=39c3ddd9f8ea7ad6a4701bf97c784748" alt="Workers AI" width="225" height="225" data-path="images/supported-llm/worksai.jpg" />
    </Frame>
  </Card>

  <Card title="ZhipuAI" href="/integrations/llms/zhipu">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/zhipu.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=60654a78c355c5c4720fbe759dbace3e" alt="ZhipuAI" width="245" height="132" data-path="images/supported-llm/zhipu.avif" />
    </Frame>
  </Card>

  <Card title="Z AI" href="/integrations/llms/z-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/z-ai.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=a0dcaeced670df356dca4d156d44695a" alt="Z-AI" width="250" height="250" data-path="images/supported-llm/z-ai.png" />
    </Frame>
  </Card>
</CardGroup>

## Endpoints Supported

For a detailed breakdown of supported endpoints and features per provider, refer to the table below:

<Card title="Supported Providers" href="/provider-endpoints/supported-providers" />

## Supported Frameworks

Portkey has native integrations with the following frameworks. Click to read their getting started guides.

<CardGroup cols={3}>
  <Card title="Langchain" href="/integrations/libraries/langchain-python">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/langchain.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=d9b20e3210126d23b1143d622a6f6cdd" alt="Langchain" width="245" height="138" data-path="images/supported-llm/langchain.avif" />
  </Card>

  <Card title="LlamaIndex" href="/integrations/libraries/llama-index-python">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/llama.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=202e79b0cc7655e27fd4f08d47ca5456" alt="LlamaIndex" width="245" height="138" data-path="images/supported-llm/llama.avif" />
  </Card>

  <Card title="Autogen" href="/integrations/libraries/autogen">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/qpDyd8Vo1lY3eMqy/images/supported-llm/autogen.avif?fit=max&auto=format&n=qpDyd8Vo1lY3eMqy&q=85&s=d6d24ed4fcbf5513cae2e155f1c57d77" alt="Autogen" width="245" height="138" data-path="images/supported-llm/autogen.avif" />
  </Card>

  <Card title="Vercel" href="/integrations/libraries/vercel">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/vercel.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=e671dafd2c4a83db5e1148c7ed940260" alt="Vercel" width="245" height="132" data-path="images/supported-llm/vercel.avif" />
  </Card>

  <Card title="Instructor" href="/integrations/libraries/instructor">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/instructor.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=58a0dbab1842a16199f8c6322bb202b2" alt="Instructor" width="245" height="132" data-path="images/supported-llm/instructor.avif" />
  </Card>

  <Card title="DSPy" href="/integrations/libraries/dspy">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/dspy.png?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=688ae6cb1f0eee0296e53c29dd56fc42" alt="DSPy" width="300" height="168" data-path="images/supported-llm/dspy.png" />
  </Card>

  <Card title="Promptfoo" href="/integrations/libraries/promptfoo">
    <img src="https://mintcdn.com/portkey-docs-chore-remove-get-model-generals-api/-ShMDV_mh2icjrjG/images/supported-llm/prompftoo.avif?fit=max&auto=format&n=-ShMDV_mh2icjrjG&q=85&s=901a15ee08ebee0a3c47721ad8103d12" alt="Promptfoo" width="245" height="132" data-path="images/supported-llm/prompftoo.avif" />
  </Card>
</CardGroup>

Have a suggestion for an integration with Portkey? Tell us on [Discord](https://discord.gg/DD7vgKK299), or drop a message on [support@portkey.ai](mailto:support@portkey.ai).

While you're here, why not [give us a star](https://git.new/ai-gateway-docs)? It helps us a lot!
