Skip to main content
parwalrahul
Navigator
March 20, 2025
Quiz

Week 3 Exercise - Refining Prompt for Testing Task

  • March 20, 2025
  • 50 replies
  • 722 views

Objective:


The goal of this activity is to help you recognize the characteristics of a well-structured prompt and practice refining prompts to make them clear, specific, and actionable for the testing tasks.

Steps:

  1. Review the Given Prompt: Here’s a poor prompt for a testing task:

    "Give me some test data for this app."
     
  2. Identify Issues: Consider why this prompt might not yield useful results. Think about missing details like the type of app, testing scope, expected tests, usage of the output produced, output format, or any specific testing techniques.
     
  3. Improve the Prompt: Rewrite the prompt to make it more precise and useful
     
  4. Share and Discuss: Share your refined prompt with others and discuss how different refinements impacted AI responses.

50 replies

Ensign
April 1, 2025

Step 1 – Reviewing the Given Prompt
The original prompt is:
"Give me some test data for this app."

Step 2 – Identifying Issues
This prompt is too vague and lacks important details. Here’s why it might not yield useful results:

  • No app details: The AI doesn’t know what kind of app it is (e-commerce, banking, social media, etc.).

  • No testing scope: It doesn’t specify whether the test data is for functional testing, performance testing, security testing, or something else.

  • No expected data format: Should the data be in JSON, CSV, or plain text?

  • No specific scenarios: It doesn’t mention if the data is for valid cases, invalid inputs, edge cases, or boundary testing.

  • No indication of volume: Does the tester need just a few data samples or a large dataset for stress testing?

Because of these issues, the AI might generate random or generic data that isn’t useful for the actual testing needs.

Step 3 – Improving the Prompt
To make the request more precise, I refined the prompt as follows:

"Generate test data for an e-commerce web application to test the checkout process. The data should include valid and invalid customer details, different payment methods, and various shipping addresses. Provide the output in a structured JSON format with 10 unique test cases."

Step 4 – Reasoning Behind the Refinement

  • Added app details: Specified that it’s an e-commerce web application.

  • Defined the testing scope: Focused on the checkout process.

  • Included different test scenarios: Asked for valid and invalid customer details, payment methods, and shipping addresses.

  • Specified output format: Requested JSON format to ensure structured data.

  • Defined quantity: Mentioned 10 unique test cases to ensure enough variety.

Step 5 – Final Reflection
This refined prompt is much clearer and more actionable. AI will now provide meaningful, structured test data that aligns with the actual testing needs. By specifying details like app type, testing focus, format, and data variety, testers can get more relevant and usable results from AI.

parwalrahul
Navigator
April 1, 2025

this is the piece of the puzzle that makes your response really clear.

everyone should focus on these factors.

 

  • Added app details: Specified that it’s an e-commerce web application.

  • Defined the testing scope: Focused on the checkout process.

  • Included different test scenarios: Asked for valid and invalid customer details, payment methods, and shipping addresses.

  • Specified output format: Requested JSON format to ensure structured data.

  • Defined quantity: Mentioned 10 unique test cases to ensure enough variety.

https://testingtitbits.com/
Mustafa
Technical Community Manager
April 3, 2025

  

Important Note:


Hi, Everyone.

To anyone who attended the course, you have 15 days to submit your answers to all 4 of ​@parwalrahul's exercises before we close submissions on Friday the 18th of April. Certificates will start to be rolled out today, so keep any eye on your emails.

Thank you.

Only in Death does Duty End
Ensign
April 3, 2025

Exercise 3:

Steps:

Review the Given Prompt: Here’s a poor prompt for a testing task:

"Give me some test data for this app."
 
Identify Issues: Consider why this prompt might not yield useful results. Think about missing details like the type of app, testing scope, expected tests, usage of the output produced, output format, or any specific testing techniques.
 
Improve the Prompt: Rewrite the prompt to make it more precise and useful.

Refined Prompt: 

"As a functional tester for financial application banking app. Please provide me some positive and negative scenarios and test data to check whether application accept correct value. Please provide me data in .csv and and xls format which will later I will use for automation testing scripts."


 

Ensign
April 4, 2025

@parwalrahul  I missed the deadline for this assignment and am completing it now. My apologies.

 

On providing this prompt to ChatGPT -” Give me some test data for this app”,I received the following response: ‘Could you specify the app's functionality or what kind of test data you need? For example, do you need user login credentials, transaction data, form inputs, or something else? Let me know, and I'll generate relevant test data for you!

The prompt is vague and does not specify the requirement clearly. In other cases, this may also result in getting irrelevant test data.

 

I rewrote the prompt :

Prompt: Give me test data with the country name starting with C followed by the capital city in uppercase and currency with the symbol

Output : Received following output .

Country Capital City Currency
Canada OTTAWA Canadian Dollar (C$)
China BEIJING Chinese Yuan (¥)
Chile SANTIAGO Chilean Peso (CLP$)
Colombia BOGOTÁ Colombian Peso (COP$)
Croatia ZAGREB Euro (€)
Cuba HAVANA Cuban Peso (CUP$)
Cyprus NICOSIA Euro (€)
Czech Republic PRAGUE Czech Koruna (Kč)
Cameroon YAOUNDÉ Central African CFA Franc (FCFA)
Costa Rica SAN JOSÉ

Costa Rican Colón (₡)

 

 

Learning: You simply need to tell AI exactly what you want, and it will provide you with precise results.

Ramanan
Ace Pilot
April 4, 2025

Objective:


The goal of this activity is to help you recognize the characteristics of a well-structured prompt and practice refining prompts to make them clear, specific, and actionable for the testing tasks.

Steps:

  1. Review the Given Prompt: Here’s a poor prompt for a testing task:

    "Give me some test data for this app."
     
  2. Identify Issues: Consider why this prompt might not yield useful results. Think about missing details like the type of app, testing scope, expected tests, usage of the output produced, output format, or any specific testing techniques.
     
  3. Improve the Prompt: Rewrite the prompt to make it more precise and useful
     
  4. Share and Discuss: Share your refined prompt with others and discuss how different refinements impacted AI responses.

 

1.

Objective:


The goal of this activity is to help you recognize the characteristics of a well-structured prompt and practice refining prompts to make them clear, specific, and actionable for the testing tasks.

Steps:

  1. Review the Given Prompt: Here’s a poor prompt for a testing task:

    "Give me some test data for this app."
     
  2. Identify Issues: Consider why this prompt might not yield useful results. Think about missing details like the type of app, testing scope, expected tests, usage of the output produced, output format, or any specific testing techniques.
     
  3. Improve the Prompt: Rewrite the prompt to make it more precise and useful
     
  4. Share and Discuss: Share your refined prompt with others and discuss how different refinements impacted AI responses.

 

@parwalrahul ​@Mustafa 

Hello Rahul,

Here is my response below 🙂

1.Original Prompt (Not Ideal):

"Give me some test data for this app."

 2. What’s wrong with This Prompt?

This prompt is far too vague to be useful. Here are the main issues:

  • Which app are we talking about? There’s no context or details about the application or what it does.
  • What kind of testing is this for? It’s unclear whether it’s functional testing, regression, performance, or something else entirely.
  • What’s the purpose of the test data? Is it meant for manual testing, automation, edge case analysis?
  • What format should the data be in? Should it be a CSV file, JSON, or just plain text?
  • Are there any data boundaries to consider? Should it include valid and invalid inputs, boundary cases, or security-related scenarios?

Without these details, it’s really difficult to produce meaningful or usable test data.

3. Improved Prompt:

Please generate test data for the login module of a mobile banking application. Users need to enter a valid email address and password to log in. I need at least 5 valid and 5 invalid input combinations, including cases like empty fields, wrongly formatted emails, SQL injection attempts, and overly long inputs. The output should be in a table format with the following columns: Email, Password, and Expected Result (e.g., ‘Login Successful’ or a specific error message). This data will be used for both manual testing and automation scripts.

 

Thanks,

Ramanan

Hunt the bugs, ensure the hugs. Quality is everything.
parwalrahul
Navigator
April 4, 2025

@NitinMore : nice. thanks for doing the exercise.

https://testingtitbits.com/
parwalrahul
Navigator
April 4, 2025

@Yastho no worries. thanks for taking part in the exercise.

https://testingtitbits.com/
Ensign
April 10, 2025

@parwalrahul  week 3 exercise

Regarding the given prompt - "Give me some test data for this app." 


I have listed a few issues with the given prompt - ​​​​​

  1. Lack of Context: It doesn’t specify what "this app" is—its purpose, functionality, or domain (e.g., a banking app, game, or e-commerce platform).
  2. Undefined Scope: It’s unclear what kind of testing the data is for (e.g UI testing, performance testing, or edge cases).
  3. No Expected Output: It doesn’t indicate how the test data should be used or what outcomes are desired (e.g., validating inputs, triggering errors).
  4. Missing Format: There’s no guidance on how the data should be presented (e.g., a list, table, JSON, or raw values).

Improved prompt: 

Develop test data for a web-based ecommerce app that includes user registration, product search, and checkout features. The test cases should consider all relevant scenarios, including typical user inputs, erroneous inputs, and edge cases. The data should be delivered in a CSV file with clearly labeled columns 

parwalrahul
Navigator
April 11, 2025

Nice ​@DamiS 

https://testingtitbits.com/