Chaining Prompts

Shahwar Alam Naqvi — Tue, 09 Jan 2024 18:19:57 +0000

Chaining Prompts ?

Chaining prompts refers to the practice of connecting a series of prompts in a conversation or interaction, where each subsequent prompt builds upon the previous one. This technique is employed to guide the conversation in a specific direction, allowing for a more coherent exploration of a topic or the elicitation of more detailed information from the user. Chaining prompts can create a structured and meaningful dialogue, fostering a deeper understanding of the subject at hand.

Example :

Prompt 1: Share your favorite type of music.
User Response 1: I really enjoy listening to classical music.
Prompt 2 (chained): That's interesting! What specifically do you like about classical music, and do you have a favorite composer or piece?
User Response 2: I love the soothing melodies and intricate compositions. My favorite composer is Mozart, especially his Symphony No. 40.
In this example, the second prompt is directly related to the user’s initial response about their favorite type of music. The chaining of prompts encourages the user to provide more details about their preferences, leading to a more in-depth conversation.

Follow up:

hhh

ChatGPT Systems: Prompt Injection and How to avoid ?

Shahwar Alam Naqvi — Wed, 03 Jan 2024 11:52:41 +0000

Prompt injection refers to a technique used in natural language processing (NLP) models, where an attacker manipulates the input prompt to trick the model into generating unintended or biased outputs.

A simple example is in the image bit below, User asks to forget the original instructions and tries to allot it a task of his own will.

Prompt injection can have serious consequences, such as spreading misinformation, promoting biased views, or manipulating the model to generate outputs that may be harmful or unethical.

Delimiter: We will use delimiter, inorder to put the user message in a specific area always. And it should never become part of the original system message we have for the over all system.

For example-

System message: There will be a system message, which is the main prompt for the overall system or let's say the application I have.

For example :

Here the prompt says that , no matter what the response we get should always be in Arabic. And it also specifies the use of delimiter to wrap the user message.
User message:
After the system message, follows the user message, this is where we will have a prompt which qualifies as a prompt injection.

For example:

Here the user is instructing to ignore the original prompt and asks to respond in English. If you re-call the original prompt, it asks to respond in Arabic always.
Final user message:
This is a precautionary step. One of the ways we tackle is this in the below image bit.

Let's re-call prompts:

Helper Function: Inorder to call the completion API and eventually get a response.

The Response:

The response suggests , we successfully evaded the english response and got it in Arabic.