Skip to content

Instantly share code, notes, and snippets.

@allenporter

allenporter/Home Assistant Model Context Protocol.md

Last active March 1, 2026 16:29
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save allenporter/b0e9946feb2ab60901c4f467ac1ba6f9 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save allenporter/b0e9946feb2ab60901c4f467ac1ba6f9 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
MCP_README.md

Model Context Protocol

TL;DR

Completing these steps will let you have an LLM Powered Web Browser in Home Assistant using Puppeteer through the Model Context Protocol.

Pre-requisites

This assumes you already know about the following:

  • Home Assistant
  • Voice Assistant with Conversation Agent (OpenAI, Google Gemini, Anthropic, etc)
  • Python virtual environment for running MCP server

Install MCP Proxy & Fetch MCP Server

This will install mcp-proxy and MCP Fetch Server.

Install dependencies:

$ uv pip install mcp-proxy mcp-server-fetch

The next step will start an SSE proxy and spawn a local stdio MCP server that can fetch web pages. The proxy server spawns the command without any environment variables set so we give the full path to uv.

$ mcp-proxy --sse-port 42783 -- /usr/local/bin/uv run mcp-server-fetch
...
INFO:     Uvicorn running on http://127.0.0.1:42783 (Press CTRL+C to quit)

The SSE server is now exposed at http://127.0.0.1:42783/sse. You can set flags to change the IP and port the proxy listens on.

Configure Model Context Protocol Integration

Open your Home Assistant instance and start setting up a new integration.

Manually add the integration

Set the SSE Server URL to your MCP proxy server SSE endpoint e.g. http://127.0.0.1:42783/sse. Make sure the URL ends with /sse.

The integration will create a new LLM API called mcp-fetch that is available to conversation agents. It does not add any other entities or devices.

Configure Conversation Agent

  1. Navigate to your existing conversation agent integration and reconfigure it

  2. Set the LLM Control to mcp-fetch

  3. Update the prompt to be something simple for now such as: You are an agent for Home Asisstant, with access to tools through an external server. This external server enables LLMs to fetch web page contents.

Screenshot of Conversation Agent Configuration

Try it Out

Open the conversation agent and ask it to fetch a web page:

Screenshot 2025-01-07 at 10 33 25 PM Screenshot 2025-01-07 at 10 34 10 PM
@nirnachmani
Copy link

nirnachmani commented Feb 9, 2025

Thank you. Can I use the LLM for Assist and mcp-fetch at the same time? i.e would the LLM still be able to control my home while using the mcp-fetch?

@allenporter
Copy link
Author

allenporter commented Feb 9, 2025

Not yet! Right now the only approach is to make a separate conversation entity, but in the future i'd like to make conversation entities able to support multiple LLM APIs.

@MorganBridget
Copy link

MorganBridget commented Feb 22, 2025

This is fantastic. I have wanted something just like this it’s like you’ve read my mind!! But yes 100% agree it would be nice to work with assist simultaneously.

@Hedda
Copy link

Hedda commented Feb 25, 2025 •
edited
Loading

Right now the only approach is to make a separate conversation entity, but in the future i'd like to make conversation entities able to support multiple LLM APIs.

Any chance some is working on an Fabric MCP server or better yet some kind of “Fabric integration” (AI tooling / AI agent) for Home Assistant?

fabric (from @danielmiessler) is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

Would be awesome to have integration(s) for Fabric's "Patterns" (currated crownsoured promts) as AI agents / tooling that can use Fabric pattern promts as tools can use from Home Assistant.

fabric intro video:

(Keep in mind that many of these were recorded when Fabric was Python-based, so remember to use the current install instructions)

Also check out this fabric origin story:

@Hedda
Copy link

Hedda commented Feb 25, 2025 •
edited
Loading

Another related tip is get inspiration from is AgentMark which is a framework (from puzzlet-ai) centered around keeping prompts in markdown files:

It allows you to:

  • Keep prompts in markdown + jsx format
  • Import components (these can be markdown files or mdx files)
  • Add logic, loops, conditionals, etc.
  • Call any LLM provider w/ the same syntax
  • Add type safety

@Hedda
Copy link

Hedda commented Mar 9, 2025 •
edited
Loading

Would it by the way be a good idea if could access the IT Automation Suggester integration via Assist conversation agent?

@Hedda
Copy link

Hedda commented Apr 14, 2025 •
edited
Loading

Any thoughts on if can integrate support for Google's new "A2A" (Agent2Agent) open protocol? An open protocol enabling communication and interoperability between opaque agentic applications.

@allenporter
Copy link
Author

allenporter commented Apr 14, 2025

I was reviewing their new Agent SDK but had not yet seen the agent to agent protocol. Will take a look.

@Hedda
Copy link

Hedda commented May 20, 2025 •
edited
Loading

@allenporter FYI, Microsoft just annnouned at their Microsoft Build 2025 conferance that the upcoming public preview of Windows 11 will get native support for Model Context Protocol (MCP) to power the agentic ecosystem on Windows 11. That should practially garantee that MCP will also be more broadly adopted soon:

image

MCP on Windows architecture

PS: Related to that news, recommend listen to The Verge Decoder podcast interview with Microsoft’s top AI leader Kevin Scott on the future of AI agents (in which he also highlight the importance on MCP):

@Hedda
Copy link

Hedda commented May 22, 2025

Well well, more great MCP news is that Google has now also announced at the Google I/O 2025 keynote that they too will fully embrace MCP:

https://www.youtube.com/watch?v=bDVpI23q8Zg&ab_channel=TheVerge

https://thenewstack.io/google-embraces-mcp/

https://cloud.google.com/blog/products/ai-machine-learning/ai-studio-to-cloud-run-and-cloud-run-mcp-server

https://cloud.google.com/blog/topics/developers-practitioners/use-google-adk-and-mcp-with-an-external-server

https://cloud.google.com/blog/products/ai-machine-learning/mcp-toolbox-for-databases-now-supports-model-context-protocol

https://cloud.google.com/blog/products/ai-machine-learning/build-mcp-servers-using-vibe-coding-with-gemini-2-5-pro

They did not state a timeline but at least with both Google AND Microsoft supporting MCP you can almost guarantee wide-spread adoption.

@Hedda
Copy link

Hedda commented May 22, 2025

fabric (from @danielmiessler) is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

Would be awesome to have integration(s) for Fabric's "Patterns" (currated crownsoured promts) as AI agents / tooling that can use Fabric pattern promts as tools can use from Home Assistant.

FYI, someone has now begun working on an MCP server for Fabric to allow integrating Fabric AI capabilities into MCP-enabled tools. See here:

@kirel
Copy link

kirel commented May 23, 2025

Here is an idea to work around the single mcp server limitation as long as HA doesn’t support more natively: https://www.reddit.com/r/homeassistant/s/Ce0LfCYvDe

@allenporter
Copy link
Author

allenporter commented May 23, 2025

It.now supports multiple

@kirel
Copy link

kirel commented May 23, 2025

Cool. I missed that. In a release already or on master?

@allenporter
Copy link
Author

allenporter commented May 23, 2025

Yes, it has been released in 2025.5..x if I remember right. Should be supported by all the integrations allowing multi select of tools in rhe options

@Hedda
Copy link

Hedda commented Jun 24, 2025 •
edited
Loading

FYI, just spottet that a "Fabric-MCP" (Fabric MCP Server) project was just now released (by @ksylvan), it is a new open-source Fabric MCP Server interface (for the Fabric AI framework) that makes all Fabric tools/patterns available as an MCP server. I believe should allow user to connect any MCP compatible application (like Home Assistant) to access the the Fabric AI framework via MCP?

See the related release announcement (with a demo) and discussion here:

"This project implements a standalone server that bridges the gap between Daniel Miessler's Fabric framework and the Model Context Protocol (MCP). It allows you to use Fabric's patterns, models, and configurations directly within MCP-enabled environments like IDE extensions or chat interfaces. Imagine seamlessly using Fabric's specialized prompts for code explanation, refactoring, or creative writing right inside your favorite tools!"

@stefanwatt
Copy link

stefanwatt commented Jul 4, 2025

I can't seem to connect my custom mcp server properly.
I tried with tree conversation agents (OpenAI, Anthropic and Google) and two frameworks (mcp-framerwork and mcp-go).

mcp-go

  • as soon as i enable my mcp-server in either OpenAI or Anthropic they will both fail instantly when i try to prompt them. OpenAI fails with a non-speaking error and Anthropic complains about the naming of my tools (which are like "melody-play") even tho they are within the provided regex
  • with Google Generative AI I was able to connect, but I had other issues with Google

mcp-framework

  • none of the Conversation Agents work. The only one where i can even enable my mcp-server is OpenAI, but it again fails with a non-speaking error when trying to converse
  • the other agents wont even allow me to enable my mcp-server. i get the error "value must be one of ['assist', 'mcp-01JZB871B8VDNJJ44YQ0CNC6N1']
    " when trying to submit

@allenporter
Copy link
Author

allenporter commented Jul 5, 2025

If you think there is a bug in home assistant feel free to file and issue report and we can dig in more. Hard to say given what's here. Lets pick one case and drill in.

@ksylvan
Copy link

ksylvan commented Jul 5, 2025

@Hedda was fabric-MCP useful to you? Is there anything that would make it better?

@wd021
Copy link

wd021 commented Jul 9, 2025

and share your 🧠🧠 prompts with God Tier Prompts!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment