> ## Documentation Index
> Fetch the complete documentation index at: https://www.latitude.sh/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# List available inference models

> Lists the inference models available through the inference gateway. The id is the canonical model ID — send it verbatim as the "model" value in inference requests. Only enabled models are returned; availability is global unless a model is explicitly scoped by region.




## OpenAPI

````yaml https://spec.speakeasy.com/latitude/latitude/latitude-sh-api-with-code-samples get /inference/models
openapi: 3.0.1
info:
  title: Latitude.sh API
  version: '2023-06-01'
  description: >-
    The Latitude.sh API is a RESTful API to manage your Latitude.sh account. It
    allows you to perform the same actions as the Latitude.sh dashboard.
servers:
  - url: https://api.latitude.sh
    variables:
      latitude_api_key:
        default: <insert your api key here>
  - url: http://api.latitude.sh
    variables:
      latitude_api_key:
        default: <insert your api key here>
security: []
tags:
  - name: API keys
  - name: Baselines (Preview)
    description: >-
      Preview. Available to teams with the `baselines_api` feature flag. The
      shape of these endpoints may change before general availability.
  - name: Billing
  - name: Elastic Ips
  - name: Events
  - name: Firewalls
  - name: Inference
  - name: IP Addresses
  - name: Managed Databases
    description: Managed database instances (PostgreSQL, ClickHouse)
  - name: Kubernetes Clusters
  - name: LKS
  - name: Marketplace apps
  - name: Operating Systems
  - name: Plans
  - name: Sandboxes (Preview)
    description: >-
      Preview. Available to teams with the `sandboxes_api` feature flag. The
      shape of these endpoints may change before general availability.
  - name: Public Networks
  - name: Private Networks
  - name: Projects
  - name: Regions
  - name: Roles
  - name: SSH Keys
  - name: Servers
  - name: Block Storage
  - name: Filesystem Storage
  - name: Object Storage
  - name: Tags
  - name: Teams
  - name: Team members
  - name: Traffic
  - name: User data
  - name: User profile
  - name: VPN Sessions
  - name: Virtual machines
  - name: Virtual machine backups
  - name: Virtual machine restores
paths:
  /inference/models:
    get:
      tags:
        - Inference
      summary: List available inference models
      description: >
        Lists the inference models available through the inference gateway. The
        id is the canonical model ID — send it verbatim as the "model" value in
        inference requests. Only enabled models are returned; availability is
        global unless a model is explicitly scoped by region.
      operationId: get-inference-models
      parameters:
        - name: project_id
          in: query
          required: true
          description: Project ID or Slug
          examples:
            Success:
              value: proj_AoW6vRnwkvLn0
          schema:
            type: string
      responses:
        '200':
          description: Success
          content:
            application/vnd.api+json:
              examples:
                Success:
                  value:
                    data:
                      - id: llama-3.3-70b-instruct
                        type: inference_models
                        attributes:
                          display_name: Llama 3.3 70B Instruct
                          description: Meta's Llama 3.3 70B instruction-tuned model.
                          provider: meta
                          modality: text
                          context_length: 131072
                          input_price_per_million_tokens: '0.00'
                          output_price_per_million_tokens: '0.00'
                          capabilities:
                            - chat
                          regions:
                            - dallas
                          created_at: '2026-01-14T15:56:29+00:00'
                          updated_at: '2026-01-14T15:56:29+00:00'
              schema:
                $ref: '#/components/schemas/inference_models'
        '401':
          description: Unauthorized
          content:
            application/vnd.api+json:
              schema:
                $ref: '#/components/schemas/error_object'
        '404':
          description: Not Found
          content:
            application/vnd.api+json:
              schema:
                $ref: '#/components/schemas/error_object'
        '503':
          description: Service Unavailable
          content:
            application/vnd.api+json:
              schema:
                $ref: '#/components/schemas/error_object'
      security:
        - Bearer: []
      x-codeSamples:
        - lang: python
          label: Python (SDK)
          source: |-
            from latitudesh_python_sdk import Latitudesh
            import os


            with Latitudesh(
                bearer=os.getenv("LATITUDESH_BEARER", ""),
            ) as latitudesh:

                res = latitudesh.inference.get_inference_models(project_id="proj_AoW6vRnwkvLn0")

                # Handle response
                print(res)
components:
  schemas:
    inference_models:
      type: object
      properties:
        data:
          type: array
          items:
            $ref: '#/components/schemas/inference_model'
    error_object:
      type: object
      properties:
        errors:
          type: array
          items:
            type: object
            properties:
              code:
                type: string
                nullable: true
              status:
                type: string
              title:
                type: string
              detail:
                type: string
              source:
                type: object
                properties:
                  pointer:
                    type: string
                  parameter:
                    type: string
              meta:
                type: object
    inference_model:
      type: object
      properties:
        id:
          type: string
          description: >-
            Canonical model ID — the exact value to send as "model" in inference
            requests
        type:
          type: string
          enum:
            - inference_models
        attributes:
          type: object
          properties:
            display_name:
              type: string
              nullable: true
            description:
              type: string
              nullable: true
            provider:
              type: string
              nullable: true
            modality:
              type: string
              nullable: true
              description: >-
                Model modality. Known values include text, vision, embedding and
                audio, but the set may grow.
            context_length:
              type: integer
              nullable: true
            input_price_per_million_tokens:
              type: string
              nullable: true
              description: >-
                USD per million tokens as a decimal string with 2 to 6 decimal
                places
              example: '0.0375'
            output_price_per_million_tokens:
              type: string
              nullable: true
              description: >-
                USD per million tokens as a decimal string with 2 to 6 decimal
                places
              example: '0.0375'
            capabilities:
              type: array
              items:
                type: string
              example:
                - chat
            regions:
              type: array
              items:
                type: string
              example:
                - dallas
            created_at:
              type: string
              format: date-time
              nullable: true
            updated_at:
              type: string
              format: date-time
              nullable: true
  securitySchemes:
    Bearer:
      type: apiKey
      name: Authorization
      in: header

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.