AI: Claude Code Model Comparative Study in MAPI
TL;DR
This research would help developers to opt for the right model with the default option suggested by Cloud Code, in terms of effectiveness, correctness, time effectiveness, and LOC (lines of code).
Abstract
Claude Code is one of the agentic tools that can read, modify, executes and integrate with the IDE, development tools, which helps us to create or fix an issue [1]. The work can be accomplished by reading multiple files and processing the statement to get the right output. Claude code model supports various models, a few are free, and a few are paid service either monthly or yearly. In this research, sample .Net C# console simple application was developed, which would deliver MAPISend [3] and MAPISave[4] email options of the E3 instance developed with the following models: Sonnet-4.6[2], Opus3, Opus 4.6, Opus 4.7, Opus 4.8 [4] and Haiku [10]. The primary purpose is to analyze how each model performs for the same prompt on multiple trials to analysis which is best. It evaluates the efficiency, service offered, usage, correctness and architecture and output generated structure. Results: Finally, this research would help developers to opt for the right model with the default option suggested by Cloud Code, in terms of effectiveness, correctness, time effectiveness, and LOC (lines of code). Claude suggested Sonnet-4.6, comparatively Opus 4.8, based on Bench pro percentage Table 1. Based on real-time evaluation, the research concludes OPUS 4.8. high yields the better results compared to sonnet 4.6.