Skip to content

Instantly share code, notes, and snippets.

View ronniegeraghty's full-sized avatar
🐋

Ronnie Geraghty ronniegeraghty

🐋
21 followers · 3 following
View GitHub Profile
@ronniegeraghty
ronniegeraghty / skill-description-bias.md
Last active March 27, 2026 19:07
AI Agent Skill Description Bias — An experiment showing agents extract answers from skill metadata without invoking the skill

AI Agent Skill Description Bias

Experiment

Question: Will an AI agent invoke a skill, or will it short-circuit and use information embedded directly in the skill's description? And if it does — what does that mean for observability?

Setup

A custom Copilot CLI skill called car-transmissions was created with the following description:

@ronniegeraghty
ronniegeraghty / gist:6596302512d316ece60cce5b8da07990
Created March 27, 2026 18:48
AI Agent Skill Description Bias — An experiment showing agents extract answers from skill metadata without invoking the skill
# AI Agent Skill Description Bias
## Experiment
**Question:** Will an AI agent invoke a skill, or will it short-circuit and use information embedded directly in the skill's description?
## Setup
A custom Copilot CLI skill called `car-transmissions` was created with the following description:
@ronniegeraghty
ronniegeraghty / EventGridNamespaceGOStarter.md
Last active May 7, 2024 18:56
Event Grid Namespaces Go Study Starter Files

Instructions for Starter Project set up

  1. Create a dir for the exercise.
  2. Within that dir create a eventSender and a eventReceiver dir.
  3. Within the eventSender dir run the following commands:
  • go mod init eventSender
  • go get github.com/Azure/azure-sdk-for-go/sdk/messaging/eventgrid/aznamespaces
  1. In the eventSender dir create a eventSender.go file and copy the contents of the envetSender.go file from this gist into it.
  2. Within the eventSender dir, use the following command to run the event sender program:
  • go run eventSender.go
  1. Within the eventReceiver dir run the following commands: