TLDR AI · RESEARCH & INNOVATION

DETECT UNSAFE PROMPTS IN LANGUAGE MODELS

arxiv.org18 min read

Summary from the TLDR AI newsletter

GradSafe is a new method for detecting unsafe prompts in large language models without extensive training. It can identify unsafe prompts more effectively than current methods by analyzing the gradients of specific parameters.