Generative artificial intelligence has arrived on social media with large language models like chatgpt making features for AI-assisted production and communication mainstream. People have transformed how they make stuff and work with machines. This research analyses the effect of these advancements on the subjectivity...
Jingyu Xiao· Frontiers in Humanities and...· 0 citations
Interactive webpages underpin modern applications, but reproducing both their visual appearance and multi-step behavior remains challenging for multimodal large language models (MLLMs). Scalable training data must capture user actions, state transitions, and expected outcomes, while real-world webpage code is often ent...
Jingyu Xiao, Da-Sen Dai, Yuxuan Wan et al.· 0 citations
It is revealed that 68% of generated webpages exhibit at least one compatibility issue, underscoring the pervasive reliability concerns surrounding MLLM-generated front-end artifacts and developing XCompat, a lightweight offline compatibility issue detector that combines visual screenshots and the structural DOM tree f...
Ziyun Guo, Jingyu Xiao, Yu-Qiang Sun et al.· 0 citations
This work proposes a framework for quality-aware preference learning that guides LLMs toward generating criteria-compliant code and introduces a hybrid optimization objective that combines ranking loss with language modeling loss and KL divergence to enable effective comparative optimization.
Liang Lu, Yuan Jiang, Christoph Treude et al.· 2 citations
This work proposes ComUICoder, a component-based UI code generation framework that emphasizes semantic-aware segmentation, code reuse, and fine-grained refinement and significantly improves overall generation quality and code reusability on complex multipage websites.
Jingyu Xiao, Jiantong Qin, Shuo-Qiu Li et al.· Proceedings of the 32nd ACM...· 1 citation
Convergent Detour Hijacking is introduced, a text-only, runtime-independent attack that couples selection manipulation, malicious skill instructions, and tool-chain resource amplification largely separately and evaluates it across multiple LLM backends and 491 held-out tasks under single-task and multi-turn conditions.
Junliang Liu, Ruo-Yu Li, Wenxin Tang et al.· 1 citation
Results show that combining layout compaction, adaptive configuration, and instruction-aware pruning can make multimodal code understanding more efficient, and propose CodeShrink, an adaptive visual compression framework with three components.
Wenxin Tang, Jingyu Xiao, Zhen-Yu Liu et al.· arXiv.org· 1 citation
This survey reviews Multimodal Code Intelligence, covering systems that generate, edit, refine, or reason with code under visually grounded inputs and outputs and organizes benchmarks and methods into four domains: Graphical User Interface, Scientific Visualization, Structured Graphics, and Frontier Tasks and Framework...
VisualRepair is proposed, an MLLM-based framework for visual software issue repair comprising two core modules: Image Type-aware Tool Calling (ITTC), which classifies input images and dynamically invokes a tailored tool-calling chain for robust visual interpretation, and Dynamic Test-time Region Focusing (DTRF), which...
This work proposes ComUICoder, a component-based UI code generation framework that emphasizes semantic-aware segmentation, code reuse, and fine-grained refinement and significantly improves overall generation quality and code reusability on complex multipage websites.
Jingyu Xiao, Jiantong Qin, ShuoQiu Li et al.· Proceedings of the 32nd ACM...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
