Skip to content
Book Open access

A Large-Scale Dataset of MCP Implementations on GitHub

Apr 2026 · IEEE Working Conference on Mining Software Repositories · pp. 610-614 · 1 citation · ⚡ 1 influential · 10 references
Computer Science

TL;DR

This study presents the first large-scale, evidence-based dataset of real-world MCP implementation collected directly from GitHub and shows that Python and TypeScript dominate MCP development, with hybrid architectures emerging as the most common design pattern.

Abstract

The rapid emergence of the Model Context Protocol (MCP) has introduced a new standard for connecting large language models to external tools and services. Despite its rapid adoption in open-source development, systematic understanding of how MCP is implemented, structured, and maintained remains limited. This study presents the first large-scale, evidence-based dataset of real-world MCP implementation collected directly from GitHub. Using a hybrid pipeline that integrates the GitHub REST and GraphQL APIs with custom Python verification scripts, 3,238 candidate repositories were discovered, filtered, and validated through multi-stage evidence checks. Each verified project was classified by operational role (e.g., client, server, gateway) and exported in a reproducible JSONL schema. A manual review of a representative subset confirmed an overall precision of 83% at a 95% confidence level, and additionally revealed a set of repositories functioning primarily as educational samples, tutorials, or demonstration templates. A targeted exclusion rule was then applied to remove these non-operational repositories, resulting in a final dataset of 2,297 validated MCP projects. The analysis shows that Python and TypeScript dominate MCP development, with hybrid architectures emerging as the most common design pattern. By emphasizing transparent verification strategies, structured evidence tagging, and reproducible data organization, this work establishes a foundational benchmark for studying real-world MCP ecosystems and supports future research on integration, connectivity, and compatibility across the broader developer community.

Read PDF

Similar papers

Jul 2026

Specification-Driven DevOps for Multi-Service Environments

This study investigates whether a frontier LLM can generate Dockerfiles and Docker Compose configurations for multi-service applications using repository contents without access to developer-authored deployment artifacts and analytically derives a minimal explicit deployment specification for information that cannot be reliably inferred from repository artifacts.

Oleg Grynets, Kyrylo Fursov, V. Lyashkevych et al. · 0 citations
Open access 2026

Architecture-Centric Code Migration for Legacy Industrial Systems Using LLMs

This research focuses on Maven configuration and structure updates and explores how the CodeT5 model can automate the migration of Java 8 projects to Java 17, finding the model accelerates parts of migration but remains unsuitable for fully automated use.

Ayush Luhar, Dev Trivedi, Vatsal Patel et al. · 0 citations
Jul 2026

An Empirical Study of Model Context Protocol Applications

The Model Context Protocol (MCP) standardizes how large language model applications communicate with external tools, but leaves the application side unspecified: unlike traditional dependencies resolved through package managers, developers integrating MCP servers face no conventions for configuration, communication, or human oversight. This ecosystem is also under-researched, with existing work focused on servers rather than the applications consuming them. We conduct a large-scale study of 1,723 MCPApps mined from GitHub. We first derive MCPAppTax from a representative sample, then use an LLM-assisted pipeline to apply it across the full dataset, characterizing server integration across configuration, SDK use, and human-in-the-loop mechanisms. Our results show that the ecosystem has converged on some practices but not others: most MCPApps configure servers using files (85.2%) and use an official SDK (81.1%) to communicate with servers, yet no naming convention has emerged for configuration files. Human oversight diverges most, logging (90.8%) and enable/disable controls (77.2%) are common, but only 37.2% gate tool execution behind a blocking approval step, leaving the LLM able to invoke any enabled tool unconditionally in most MCPApps.

Muhammad Hamza Arshad Majeed, May Mahmoud, Sarah Nadi · 0 citations
Preprint Aug 2026

Doc2CI: A Multi-Service Study of CI Configuration Generation Using Large Language Models

A large empirical study on using LLMs to generate CI configurations from natural language across services and model families suggests that similarity and validity are distinct objectives for CI generation and motivate schema-aware evaluation and tooling for LLM-based configuration generation.

T. A. Ghaleb · 0 citations
Jul 2026

Not as Sweet by Another Name: An Empirical Study of Format Robustness in LLM Document Workflows

A format-aware metamorphic testing framework with three metamorphic relations is proposed to comprehensively evaluate the format robustness of end-to-end LLM document workflows and demonstrates that document format is not a neutral wrapper but a critical factor affecting the reliability of LLM software systems.

Xiaoyu Zhang, Xianyun Cheng, Tianlin Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.