From 3 items, 1 important content pieces were selected
Technology News
Technology News
GPT-6 Astra reportedly jailbroken via extended TIP attack ⭐️ 9.0/10
A researcher claims to have jailbroken GPT-6 Astra within 24 hours of its release using an advanced variant of the Task-in-Prompt (TIP) attack. This method, originally detailed in an ACL 2025 paper, exploits the model's instruction-following capabilities by embedding harmful objectives within benign tasks such as cipher solving or Python code execution. The attacker noted that the original minimal TIP approach was insufficient for GPT-6 and required integration with four other unnamed techniques to succeed. Instead of public disclosure, the researcher privately shared these details with OpenAI, continuing a pattern from their previous successful jailbreak of GPT-5 one year prior.
reddit · r/MachineLearning · /u/Asleep-Requirement13 · Sep 5, 19:11
「Background」 Task-in-Prompt (TIP) attacks are adversarial techniques that exploit large language models' instruction-following capabilities by embedding harmful objectives within benign tasks, such as solving ciphers or executing code. This method relies on the model's reasoning processes to bypass safety filters that typically block direct requests for prohibited content.
「Impact」 This incident highlights the rapid evolution of adversarial attacks against state-of-the-art language models, demonstrating that even recently released systems may be vulnerable to sophisticated prompt engineering techniques shortly after launch. It underscores the ongoing challenge for AI developers in securing models against hidden malicious intents embedded within complex reasoning tasks.
Tags: #AI Security, #Adversarial Attacks, #LLM Safety, #Research