LangChain Integration

Connect LangChain to nexos.ai and route your ChatOpenAI calls through any OpenAI-compatible model on the gateway. This guide walks through Python and TypeScript example setups to get you started.

What is LangChain?

LangChain is a comprehensive framework for developing applications powered by Large Language Models (LLMs). It provides:

A unified interface to interact with various model providers
Tools to manage conversation history
Primitives for building complex chains and agents

Sample implementation using nexos.ai

Below is a minimal example written in Python and TypeScript showing how to use LangChain’s ChatOpenAI client with the nexos.ai Gateway (OpenAI-compatible) endpoint.

Python:

import os
from dotenv import load_dotenv
from langchain_openai import ChatOpenAI
from langchain_core.messages import HumanMessage, SystemMessage

# Load environment variables from .env file
load_dotenv()

# --- Configuration ---
NEXOS_BASE_URL = os.getenv("NEXOS_BASE_URL")
NEXOS_API_KEY = os.getenv("NEXOS_API_KEY")

if not NEXOS_BASE_URL or not NEXOS_API_KEY:
    raise ValueError("Please set NEXOS_BASE_URL and NEXOS_API_KEY in your .env file")

def main():
    # Initialize the ChatOpenAI client
    llm = ChatOpenAI(
        model="gpt-4.1",          # or any other OpenAI-compatible model ID available to you
        base_url=NEXOS_BASE_URL,  # e.g. "https://api.nexos.ai/v1"
        api_key=NEXOS_API_KEY,
    )

    # Create a simple message sequence
    messages = [
        SystemMessage(content="You are a helpful assistant."),
        HumanMessage(content="Hello world!"),
    ]

    try:
        response = llm.invoke(messages)
        print("\n--- Response from AI ---")
        print(response.content)
        print("------------------------")
    except Exception as e:
        print(f"\nError communicating with the API: {e}")

if __name__ == "__main__":
    main()

TypeScript:

import * as dotenv from "dotenv";
import { ChatOpenAI } from "@langchain/openai";
import { HumanMessage, SystemMessage } from "@langchain/core/messages";

// Load environment variables from .env file
dotenv.config();

// --- Configuration ---
const NEXOS_BASE_URL = process.env.NEXOS_BASE_URL;
const NEXOS_API_KEY = process.env.NEXOS_API_KEY;

if (!NEXOS_BASE_URL || !NEXOS_API_KEY) {
  throw new Error("Please set NEXOS_BASE_URL and NEXOS_API_KEY in your .env file");
}

async function main() {
  // Initialize the ChatOpenAI client
  const llm = new ChatOpenAI({
    model: "gemini-2.5-flash", // or any other OpenAI-compatible model ID available to you
    apiKey: NEXOS_API_KEY,
    configuration: {
      baseURL: NEXOS_BASE_URL,
    },
    temperature: 0.7,
  });

  // Create a simple message sequence
  const messages = [
    new SystemMessage("You are a helpful assistant."),
    new HumanMessage("Hello world!"),
  ];

  try {
    const response = await llm.invoke(messages);
    console.log("\n--- Response from AI ---");
    console.log(response.content);
    console.log("------------------------");
  } catch (e) {
    console.error(`\nError communicating with the API: ${e}`);
  }
}

main()

You can use any open AI compatible model. To check what models are available for you, call Gateway API Models You can use either nexos_model_idor id as model.

FAQ

Which other integrations are available in nexos.ai Gateway?

nexos.ai Gateway supports integrations with the following coding tools:

PreviousLangGraph

NextRoo Code

Last updated 5 days ago

import * as dotenv from "dotenv";
import { ChatOpenAI } from "@langchain/openai";
import { HumanMessage, SystemMessage } from "@langchain/core/messages";

// Load environment variables from .env file
dotenv.config();

// --- Configuration ---
const NEXOS_BASE_URL = process.env.NEXOS_BASE_URL;
const NEXOS_API_KEY = process.env.NEXOS_API_KEY;

if (!NEXOS_BASE_URL || !NEXOS_API_KEY) {
  throw new Error("Please set NEXOS_BASE_URL and NEXOS_API_KEY in your .env file");
}

async function main() {
  // Initialize the ChatOpenAI client
  const llm = new ChatOpenAI({
    model: "gemini-2.5-flash", // or any other OpenAI-compatible model ID available to you
    apiKey: NEXOS_API_KEY,
    configuration: {
      baseURL: NEXOS_BASE_URL,
    },
    temperature: 0.7,
  });

  // Create a simple message sequence
  const messages = [
    new SystemMessage("You are a helpful assistant."),
    new HumanMessage("Hello world!"),
  ];

  try {
    const response = await llm.invoke(messages);
    console.log("\n--- Response from AI ---");
    console.log(response.content);
    console.log("------------------------");
  } catch (e) {
    console.error(`\nError communicating with the API: ${e}`);
  }
}

main()