a collection of thousands of prompts attempting to control the idiot genie of ChatGPT

2 years ago by David Gerard to c/techtakes

save

report

A collection of GPT system prompts and various prompt injection/leaking knowledge. - LouisShark/chatgpt_system_prompt

fasterandworse 20 points 2 years ago

it's like little toy tugboats trying to steer the titanic around icebergs

save

path: 0 11009470, hotness: undefined, score: 20, children: 0

bitfucker 5 points 2 years ago

So, you know LLM has a context window right? That means context overflow is a valid LLM attack strategy if you are somehow able to send more stuff than what is allowed.

save

path: 0 11017090, hotness: undefined, score: 5, children: 6

froztbyte 7 points 2 years ago

and your point is?

save

path: 0 11017090 11017538, hotness: undefined, score: 7, children: 5

bitfucker 5 points 2 years ago

Nothing? I'm pointing out another way to "attack" some LLM?

save

path: 0 11017090 11017538 11017702, hotness: undefined, score: 5, children: 4

ShakingMyHead 9 points 2 years ago

Probably would have been easier when the context window wasn't 128k.

Though what the point would be should someone actually achieve that eludes me a bit.

save

path: 0 11017090 11017538 11017702 11019437, hotness: undefined, score: 9, children: 3

bitfucker 10 points 2 years ago

I don't know man. Maybe a chat bot for help center that forgot they shouldn't give refund or non existent promotion?

save

path: 0 11017090 11017538 11017702 11019437 11019900, hotness: undefined, score: 10, children: 1

nfultz 1 point 2 years ago

I have LLMs translate novels, I can tell when they run over the window because they forget characters' gender half way through, things like that. Lots of legal documents are even longer, maybe.

save

path: 0 11017090 11017538 11017702 11019437 11050311, hotness: undefined, score: 1, children: 0

ShakingMyHead 1 point 2 years ago

save

path: 0 11011555, hotness: undefined, score: 1, children: 0

techtakes

@awful.systems

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

go to feed...

techtakes

@awful.systems

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

go to feed...