Bluemarz is a new python written AI framework; it’s also an open-source platform specifically designed for managing and orchestrating multiple AI agents. It brings a measure of scalability and flexibility that’s been lacking in the Ai open-source industry. From its stateless architecture to its support for multiple language models (such as OpenAI, Anthropic Claude, and Google Gemini), Bluemarz offers a robust solution to meet enterprise needs around scalability, security, and privacy — all crucial for projects/organizations handling sensitive data and complex workflows. Let’s briefly dive into what makes Bluemarz a unique and powerful tool for developers looking to deploy Ai agents at scale. Getting Started with Bluemarz Installation: You can get Bluemarz running by installing it from GitHub using pip: pip install git+https://github.com/StartADAM/bluemarz.git Basic Workflow: Bluemarz introduces three main concepts: Agent, Session, and Assignment. These allow developers to set up a flexible workflow where multiple agents can interact within the same session, pulling from different LLMs as needed. Here’s an example of a simple session from its repo: https://github.com/StartADAM/bluemarz): import bluemarz as bm
import asyncio

async def procedural_example():
    # Initialize an agent using OpenAI
    agent = bm.openai.OpenAiAssistant.from_id(api_key, assistant_id)
    
    # Start a session
    session = bm.openai.OpenAiAssistantNativeSession.new_session(api_key)
    
    # Assign the agent to the session
    task = bm.Assignment(agent, session)
    task.add_message(bm.SessionMessage(role=bm.MessageRole.USER, text="What can you do?"))
    
    # Run the task and display the result
    res = await task.run_until_breakpoint()
    print(res)

asyncio.run(procedural_example()) Key Benefits of Bluemarz Bluemarz addresses significant limitations that other platforms like LangChain, LangGraph, and Chainlit haven’t fully solved, especially around multi-agent, multi-LLM support, and session scalability. What Sets Bluemarz Apart Stateless and Scalable: Running Bluemarz in a Kubernetes cluster or on any cloud platform is simple due to its stateless design, which doesn’t require session retention, thus enhancing scalability.
Multi-Agent Flexibility: You can assign multiple agents in a single session and add or remove agents dynamically. This means that if an AI agent for translation is needed mid-session, it can be added on the fly without interrupting ongoing conversations.
Enterprise-Ready Security: Bluemarz is built to fit into corporate environments, with compliance and privacy controls already accounted for.
Dynamic Agent Selection: Either through code or with an AI-powered Selector (coming soon), developers can manage agent workflows with ease, adding a layer of control over task assignment and performance. Core Components Providers: These are the LLMs Bluemarz supports, including OpenAI, Anthropic Claude, and Google Gemini, with the flexibility to work with on-premises models. Sessions: Sessions represent interactions that are entirely stateless in Bluemarz, running and storing sessions within your LLM provider’s infrastructure. Agents and Assignments: Agents can be defined and assigned to sessions dynamically. Bluemarz supports both manual and programmatic agent assignments, allowing real-time changes during active sessions. Extending Bluemarz with Tools One of the most powerful features of Bluemarz is the ability to define reusable tools. Tools extend the capabilities of LLMs by connecting them to external systems, data sources, or services. Here’s an example of a tool that converts Celsius to Kelvin: class TemperatureConverter(bm.SyncTool):
    def __init__(self):
        self._spec = bm.ToolSpec.model_validate({
            "id": "convert_celsius_to_kelvin",
            "name": "Convert Celsius to Kelvin",
            "description": "Converts a temperature from Celsius to Kelvin",
            "toolType": "sync",
            "variables": {
                "temperature": {
                    "type": "string",
                    "description": "Temperature in Celsius",
                },
            },
        })

     def call(self, tool_call: bm.ToolCall) -> bm.ToolCallResult:
        temp_celsius = int(tool_call.arguments.get("temperature", "0"))
        kelvin = temp_celsius + 273.15
        return bm.ToolCallResult(tool_call=tool_call, text=str(kelvin)) Once defined, this tool can be used across different agents and sessions, providing a single point of configuration for any agent needing temperature conversions. Real-World Use Cases for Bluemarz Customer Support Automation: Bluemarz’s multi-agent support allows for agents specialized in different domains to collaborate in real-time within a single session, improving response times and relevance.
R&D: Devs can use Bluemarz to configure research sessions where agents access documents or datasets dynamically.
Cost Control and Optimization: Bluemarz’s agent flexibility means only the necessary agents are deployed, reducing compute costs for organizations. Conclusion If you’re looking to contribute to a new, powerful, and flexible, open-source solution check it out: https://github.com/StartADAM/bluemarz. Since its stateless, adaptable, and ready for corporate-grade deployments, it should be a great project on a portfolio and an easy win into contributing to the Ai band-wagon. Whether you’re orchestrating a single, complex task across multiple agents or need to ensure scalability and security, Bluemarz can provide the infrastructure to support and grow the AI agent ecosystem. Bluemarz is a new python written AI framework; it’s also an open-source platform specifically designed for managing and orchestrating multiple AI agents. It brings a measure of scalability and flexibility that’s been lacking in the Ai open-source industry. From its stateless architecture to its support for multiple language models (such as OpenAI, Anthropic Claude, and Google Gemini), Bluemarz offers a robust solution to meet enterprise needs around scalability, security, and privacy — all crucial for projects/organizations handling sensitive data and complex workflows. Let’s briefly dive into what makes Bluemarz a unique and powerful tool for developers looking to deploy Ai agents at scale. Getting Started with Bluemarz Installation : You can get Bluemarz running by installing it from GitHub using pip: Installation pip install git+https://github.com/StartADAM/bluemarz.git pip install git+https://github.com/StartADAM/bluemarz.git Basic Workflow : Bluemarz introduces three main concepts: Agent , Session , and Assignment . These allow developers to set up a flexible workflow where multiple agents can interact within the same session, pulling from different LLMs as needed. Here’s an example of a simple session from its repo: https://github.com/StartADAM/bluemarz ): Basic Workflow Agent Session Assignment https://github.com/StartADAM/bluemarz https://github.com/StartADAM/bluemarz import bluemarz as bm
import asyncio

async def procedural_example():
    # Initialize an agent using OpenAI
    agent = bm.openai.OpenAiAssistant.from_id(api_key, assistant_id)
    
    # Start a session
    session = bm.openai.OpenAiAssistantNativeSession.new_session(api_key)
    
    # Assign the agent to the session
    task = bm.Assignment(agent, session)
    task.add_message(bm.SessionMessage(role=bm.MessageRole.USER, text="What can you do?"))
    
    # Run the task and display the result
    res = await task.run_until_breakpoint()
    print(res)

asyncio.run(procedural_example()) import bluemarz as bm
import asyncio

async def procedural_example():
    # Initialize an agent using OpenAI
    agent = bm.openai.OpenAiAssistant.from_id(api_key, assistant_id)
    
    # Start a session
    session = bm.openai.OpenAiAssistantNativeSession.new_session(api_key)
    
    # Assign the agent to the session
    task = bm.Assignment(agent, session)
    task.add_message(bm.SessionMessage(role=bm.MessageRole.USER, text="What can you do?"))
    
    # Run the task and display the result
    res = await task.run_until_breakpoint()
    print(res)

asyncio.run(procedural_example()) Key Benefits of Bluemarz Bluemarz addresses significant limitations that other platforms like LangChain, LangGraph, and Chainlit haven’t fully solved, especially around multi-agent, multi-LLM support, and session scalability. What Sets Bluemarz Apart Stateless and Scalable: Running Bluemarz in a Kubernetes cluster or on any cloud platform is simple due to its stateless design, which doesn’t require session retention, thus enhancing scalability. Multi-Agent Flexibility: You can assign multiple agents in a single session and add or remove agents dynamically. This means that if an AI agent for translation is needed mid-session, it can be added on the fly without interrupting ongoing conversations. Enterprise-Ready Security: Bluemarz is built to fit into corporate environments, with compliance and privacy controls already accounted for. Dynamic Agent Selection: Either through code or with an AI-powered Selector (coming soon), developers can manage agent workflows with ease, adding a layer of control over task assignment and performance. Stateless and Scalable : Running Bluemarz in a Kubernetes cluster or on any cloud platform is simple due to its stateless design, which doesn’t require session retention, thus enhancing scalability. Stateless and Scalable Multi-Agent Flexibility : You can assign multiple agents in a single session and add or remove agents dynamically. This means that if an AI agent for translation is needed mid-session, it can be added on the fly without interrupting ongoing conversations. Multi-Agent Flexibility Enterprise-Ready Security : Bluemarz is built to fit into corporate environments, with compliance and privacy controls already accounted for. Enterprise-Ready Security Dynamic Agent Selection : Either through code or with an AI-powered Selector (coming soon), developers can manage agent workflows with ease, adding a layer of control over task assignment and performance. Dynamic Agent Selection Core Components Providers : These are the LLMs Bluemarz supports, including OpenAI, Anthropic Claude, and Google Gemini, with the flexibility to work with on-premises models. Providers Sessions : Sessions represent interactions that are entirely stateless in Bluemarz, running and storing sessions within your LLM provider’s infrastructure. Sessions Agents and Assignments : Agents can be defined and assigned to sessions dynamically. Bluemarz supports both manual and programmatic agent assignments, allowing real-time changes during active sessions. Agents and Assignments Extending Bluemarz with Tools One of the most powerful features of Bluemarz is the ability to define reusable tools. Tools extend the capabilities of LLMs by connecting them to external systems, data sources, or services. Here’s an example of a tool that converts Celsius to Kelvin: class TemperatureConverter(bm.SyncTool):
    def __init__(self):
        self._spec = bm.ToolSpec.model_validate({
            "id": "convert_celsius_to_kelvin",
            "name": "Convert Celsius to Kelvin",
            "description": "Converts a temperature from Celsius to Kelvin",
            "toolType": "sync",
            "variables": {
                "temperature": {
                    "type": "string",
                    "description": "Temperature in Celsius",
                },
            },
        })

     def call(self, tool_call: bm.ToolCall) -> bm.ToolCallResult:
        temp_celsius = int(tool_call.arguments.get("temperature", "0"))
        kelvin = temp_celsius + 273.15
        return bm.ToolCallResult(tool_call=tool_call, text=str(kelvin)) class TemperatureConverter(bm.SyncTool):
    def __init__(self):
        self._spec = bm.ToolSpec.model_validate({
            "id": "convert_celsius_to_kelvin",
            "name": "Convert Celsius to Kelvin",
            "description": "Converts a temperature from Celsius to Kelvin",
            "toolType": "sync",
            "variables": {
                "temperature": {
                    "type": "string",
                    "description": "Temperature in Celsius",
                },
            },
        })

     def call(self, tool_call: bm.ToolCall) -> bm.ToolCallResult:
        temp_celsius = int(tool_call.arguments.get("temperature", "0"))
        kelvin = temp_celsius + 273.15
        return bm.ToolCallResult(tool_call=tool_call, text=str(kelvin)) Once defined, this tool can be used across different agents and sessions, providing a single point of configuration for any agent needing temperature conversions. Real-World Use Cases for Bluemarz Customer Support Automation: Bluemarz’s multi-agent support allows for agents specialized in different domains to collaborate in real-time within a single session, improving response times and relevance. R&D: Devs can use Bluemarz to configure research sessions where agents access documents or datasets dynamically. Cost Control and Optimization: Bluemarz’s agent flexibility means only the necessary agents are deployed, reducing compute costs for organizations. Customer Support Automation : Bluemarz’s multi-agent support allows for agents specialized in different domains to collaborate in real-time within a single session, improving response times and relevance. Customer Support Automation R&D : Devs can use Bluemarz to configure research sessions where agents access documents or datasets dynamically. R&D Cost Control and Optimization : Bluemarz’s agent flexibility means only the necessary agents are deployed, reducing compute costs for organizations. Cost Control and Optimization Conclusion If you’re looking to contribute to a new, powerful, and flexible, open-source solution check it out: https://github.com/StartADAM/bluemarz . Since its stateless, adaptable, and ready for corporate-grade deployments, it should be a great project on a portfolio and an easy win into contributing to the Ai band-wagon. Whether you’re orchestrating a single, complex task across multiple agents or need to ensure scalability and security, Bluemarz can provide the infrastructure to support and grow the AI agent ecosystem. https://github.com/StartADAM/bluemarz https://github.com/StartADAM/bluemarz

This story contains new, firsthand information uncovered by the writer.

This writer has a vested interest be it monetary, business, or otherwise, with 1 or more of the products or companies mentioned within.

An Open-Source Platform for Multi-Agent AI Orchestration

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

The Noonification: Use This 7-Step McKinsey Framework to Solve Any Problem (1/10/2023)

The Noonification: A Taxonomy of Inclusiveness (1/11/2024)

The Noonification: What is the InfiniteNature-Zero AI Model? (11/19/2022)

10 Ways AI Has Changed Our Lives

100 Days of AI, Day 8: Experimenting With Microsoft's Semantic Kernel Using GPT-4

The Noonification: Use This 7-Step McKinsey Framework to Solve Any Problem (1/10/2023)

The Noonification: A Taxonomy of Inclusiveness (1/11/2024)

The Noonification: What is the InfiniteNature-Zero AI Model? (11/19/2022)

10 Ways AI Has Changed Our Lives

100 Days of AI, Day 8: Experimenting With Microsoft's Semantic Kernel Using GPT-4

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps