Honeyhive
HoneyHive is a modern AI observability and evaluation platform that enables developers and domain experts to collaboratively build reliable AI applications faster.
This is a first-class FlyMyAI MCP. Agents discover it automatically via tool search and call the actions below on demand - you never wire it up by hand. See the Composio catalog for how discovery works.
Connect
Honeyhive authenticates with an API key. Generate the credential in your Honeyhive account, then paste it into FlyMyAI the first time an agent uses a Honeyhive action.
Get your Honeyhive credential →
Fields to fill in FlyMyAI
| Field | Details |
|---|---|
HoneyHive API Key | The API key used for authenticating requests to the HoneyHive API. (required) |
Actions
Every action this integration exposes. Agents pick the right one from the task; you do not call them by name.
| Action | What it does | Required inputs |
|---|---|---|
HONEYHIVE_ADD_DATAPOINTS_TO_DATASET | Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings. | dataset_id, project, data, mapping |
HONEYHIVE_CREATE_BATCH_MODEL_EVENTS | Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive. | model_events |
HONEYHIVE_CREATE_BATCH_TOOL_EVENTS | Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request-use after gathering all event data. | events |
HONEYHIVE_CREATE_DATASET | Tool to create a dataset. Use when you need to initialize a new dataset within a project. | project, name |
HONEYHIVE_CREATE_TOOL | Tool to create a new tool. Use when you need to register a new function or plugin for invocation. | task, name, parameters, type |
HONEYHIVE_DELETE_DATAPOINT | Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier. | id |
HONEYHIVE_DELETE_DATASET | Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID. | dataset_id |
HONEYHIVE_END_EVALUATION_RUN | Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed. | run_id, status |
HONEYHIVE_GET_CONFIGURATIONS | Tool to retrieve a list of configurations. Use when you need to fetch all configurations for a specific project before making changes. | project |
HONEYHIVE_GET_DATASETS | Tool to retrieve a list of datasets. Use when you need to fetch datasets for a specific project with optional filters. | project |
HONEYHIVE_GET_METRICS | Tool to retrieve all metrics. Use when you need to list metrics for a specific project, after obtaining project context. | project_name |
HONEYHIVE_GET_PROJECTS | Tool to retrieve projects. Use when you need to list all available projects. | - |
HONEYHIVE_LIST_TOOLS | Tool to list all available Honeyhive tools. Use when you need to discover which functions or plugins are registered for use. | - |
HONEYHIVE_RETRIEVE_DATAPOINT | Tool to retrieve a specific datapoint by its ID. Use when you have a datapoint ID and need its full details. | id |
HONEYHIVE_RETRIEVE_DATAPOINTS | Tool to retrieve a list of datapoints. Use when you need to fetch datapoints for a project with optional filters. | project |
HONEYHIVE_RETRIEVE_EVENTS | Tool to retrieve events by filters. Use when you need to export events based on filter criteria, date range, and pagination. | project, filters |
HONEYHIVE_RETRIEVE_EXPERIMENT_RESULT | Tool to retrieve the result of a specific experiment run. Use when you need the status, metrics, and datapoint-level details of a completed experiment. | run_id, project_id |
HONEYHIVE_START_EVALUATION_RUN | Tool to initiate an evaluation run using external datasets. Use after selecting a project and events; optionally link a dataset. | project, name, event_ids |
HONEYHIVE_START_SESSION | Tool to start a new session. Use when you need to initiate a new tracking session and retrieve its session_id. | session |
HONEYHIVE_UPDATE_DATAPOINT | Tool to update a specific datapoint. Use when you need to modify fields of an existing datapoint. | id |
HONEYHIVE_UPDATE_DATASET | Tool to update an existing dataset. Use when you need to modify a dataset's details (name, description, datapoints, linked evaluations, or metadata) after confirming its ID. | dataset_id |
HONEYHIVE_UPDATE_EVENT | Tool to update an event. Use when updating event details by ID. | event_id |
HONEYHIVE_UPDATE_METRIC | Tool to update an existing metric. Use when you need to modify a metric’s properties after creation. Ensure you retrieve the metric first to verify its current state. | metric_id |
HONEYHIVE_UPDATE_PROJECT | Tool to update a project's name or description. Use when you need to modify an existing project by its ID after creation. | id |
Links
We love our partners - FlyMy.AI builds with the best. Thanks, Honeyhive!