DSAP Bench: Evaluating Safety Boundary Erosion in Large Language Models using Domain-Specific Adversarial Prompts
A Domain-Specific Adversarial Prompt (DSAP) dataset of 4,240 prompts aimed at testing safety boundaries of LLMs focusing on indirect adversarial prompts in the context of realistic professional settings is presented and novel information regarding the weaknesses of contemporary language models is provided.