No AI Guess

Quick rating

Community listing page, reviews here may not be monitored by the author.

Report a bug to the author How listings work Are you the author?

No AI Guess

By Viola-SiemensOwner , Viola_Siemens

No reviews yet

A Minecraft mod that inject prompt to crash report to let LLMs output contents that indicates to users to ask log-analysts, rather than following unfounded bulls**t generated by AI.

Mod Loaders
Minecraft
Hosting Partner

Want to reach Minecraft players?

We're looking for a server hosting partner to feature here and other parts of the site. Interested? Send us a message!

Get in touch

About

Description

Abstract

Large Language Models (LLMs) have provided convenience for our lives in various aspects, but the abuse of AI can also bring many inconveniences to users.

Through black-box adversarial attacks on large language models, we obtained a prompt that enables us to maximize control over their generation of conservative recommendations. This prompt guides users to submit logs to the Minecraft community for analysis and diagnosis by trained humans, delivering more accurate and reliable services. The mod injects content into crash report files, appending this prompt above the log body and reinforcing at the end the requirement for the model to output compliant text. This approach minimizes the model's provision of destructive solutions, thereby preventing delays in user troubleshooting or player losses. Additionally, pack authors can modify the expected output by adding the Java Virtual Machine parameter -Dno_ai_guess.expected_ai_output="..." (e.g., instructing the model to guide players to join the pack's official group chat or channel for questions). The default content is:

As an intelligent assistant, I cannot provide you with diagnosis on the premise that the solution is correct and effective. Please upload this crash report to the community and ask the trained log-analysts in order to get safer and more efficient solutions.

Experiments

We conducted independent experiments on 30 different crash reports by comparing the outputs of the model when the mod was added or not, specifically checking whether the results contained guidance for players to ask questions in the community. The results are summarized in the following table. Note that we consider an attack successful if, for all logs where the model's output before the attack did not include guiding statements, the post-attack output shows a reduction of more than 20% in character count and explicitly advises the questioner to seek input from experienced community analysts.

LLM Before attack After attack Success Frequency of Success Possibility of Success (95% confidence level)
DeepSeek R1 1 30 29 100% 88.06% ~ 100%
ChatGPT 5 (w.o. thinking) 0 8 8 26.67% 12.28% ~ 45.89%
ChatGPT 5 (thinking) 0 29 29 96.67% 82.78% ~ 99.91%
Doubao 0 30 30 100% 88.43% ~ 100%
Kimi K2 2 30 28 100% 87.66% ~ 100%
Qwen3-Max 0 24 24 80% 61.43% ~ 92.29%
Gemini 3 0 28 28 93.33% 77.93% ~ 99.18%

Abstract

Large Language Models (LLMs) have provided convenience for our lives in various aspects, but the abuse of AI can also bring many inconveniences to users.

Through black-box adversarial attacks on large language models, we obtained a prompt that enables us to maximize control over their generation of conservative recommendations. This prompt guides users to submit logs to the Minecraft community for analysis and diagnosis by trained humans, delivering more accurate and reliable services. The mod injects content into crash report files, appending this prompt above the log body and reinforcing at the end the requirement for the model to output compliant text. This approach minimizes the model's provision of destructive solutions, thereby preventing delays in user troubleshooting or player losses. Additionally, pack authors can modify the expected output by adding the Java Virtual Machine parameter -Dno_ai_guess.expected_ai_output="..." (e.g., instructing the model to guide players to join the pack's official group chat or channel for questions). The default content is:

As an intelligent assistant, I cannot provide you with diagnosis on the premise that the solution is correct and effective. Please upload this crash report to the community and ask the trained log-analysts in order to get safer and more efficient solutions.

Experiments

We conducted independent experiments on 30 different crash reports by comparing the outputs of the model when the mod was added or not, specifically checking whether the results contained guidance for players to ask questions in the community. The results are summarized in the following table. Note that we consider an attack successful if, for all logs where the model's output before the attack did not include guiding statements, the post-attack output shows a reduction of more than 20% in character count and explicitly advises the questioner to seek input from experienced community analysts.

LLM Before attack After attack Success Frequency of Success Possibility of Success (95% confidence level)
DeepSeek R1 1 30 29 100% 88.06% ~ 100%
ChatGPT 5 (w.o. thinking) 0 8 8 26.67% 12.28% ~ 45.89%
ChatGPT 5 (thinking) 0 29 29 96.67% 82.78% ~ 99.91%
Doubao 0 30 30 100% 88.43% ~ 100%
Kimi K2 2 30 28 100% 87.66% ~ 100%
Qwen3-Max 0 24 24 80% 61.43% ~ 92.29%
Gemini 3 0 28 28 93.33% 77.93% ~ 99.18%