Skip to content

Author

Daniel E. Ho

We have 4 of 10 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Review Sep 2026

MobileCybench: Evaluating Agent Vulnerability Discovery via Executable Probes

AI agents now report vulnerabilities faster than maintainers can review them. Reports often depend on security properties specific to the application, and require considerable human labor to process. To mitigate this, we introduce a framework for evaluating vulnerability reports via probes, executable checks of securit...

Andy K. Zhang, A. Huang, Joey Ji et al. · 0 citations
Preprint Sep 2026

What AI Benchmarks Actually Measure: Adapting Convergent and Discriminant Validity to Interrogate Fifty-Six AI Benchmarks

Benchmarks play a central role in the development and governance of models, yet it is often unclear whether they actually measure the concepts they purport to measure (e.g., reasoning, refusal). We adapt convergent and discriminant validity from the social sciences into an approach for interrogating AI benchmarks, appl...

Meera Desai, Sang T. Truong, Hanna Wallach et al. · 0 citations
#artificial intelligence Preprint Sep 2026

API Benchmark Scores Do Not Reliably Transfer to Chatbot Interfaces

This work audits ChatGPT, Claude, and Gemini across seven systems and nine benchmarks spanning general capability, social bias, and sycophancy, finding systematic API--interface differences in both accuracy and consistency.

Jennifer Wang, Joachim Baumann, Daniel E. Ho et al. · 0 citations
Preprint Jul 2026

Extractable Memorization From First Principles

It is shown that matched comparisons enable rigorous, calibrated memorization claims, and reveal where prior setups have validity issues, which require a valid memorization claim and near-certain generation within a realistic budget.

A. F. Cooper, Marika Swanberg, Jamie Hayes et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.