Master Thesis - AgentOPS frameworks and infrastructure

Problem statement

Generative AI (GenAI) is transforming software development. Tool support powered by large language models (LLMs), such as GitHub co-pilot and ChatGPT, are becoming an integrated part of the software development workflow. LLM-based agents, which take on software development tasks more autonomously, are now starting to emerge. While an LLM provides replies to prompts in one step, an LLM-based agent can autonomously perform tasks and take decisions, using an LLM in several steps. In addition to an LLM, the agent includes perception capabilities, memory, and supporting resources, and can provide the LLM with context intelligence via the Model Context Protocol (MCP).

When multiple agents collaborate, we get a dynamic system where agents jointly work on a problem where human involvement changes from being aware of all details to a supervisory role. Setting up an infrastructure for a multi agent system and how to manag...