Week 3 Exercise - Refining Prompt for Testing Task

Hello   @parwalrahul  Rahul,

Honestly, I thought if I give just application name its able to give me details, I have tried act as tester. But not got much details.

So Identified Issues:

• No app description:  What does the app do?  What is its purpose?  What kind of data does it process?
• No data structure: How is the data organized?  What are the fields or columns?  What are their data types?
• No data constraints: Are there any limitations on the data?
• No desired format:  What format do you want the data in? 

Improved the Prompt

Give me some test data for my movie review app.  The app stores movie titles (string), user IDs (integer), user ratings (integer from 1 to 5), and review text (string, max length 500 characters).  I need about 50 data points in CSV format to test the functionality of the rating system and the review display.:

​@Bharat2609 really smart one. you invoked the chain of thought prompting at the end.

it’s like a power hack to get it to generate stuff on all the diverse details that you have asked it to work on.

atomic prompting / chain of thought prompting is really not well used. you have shared a good example.

cheers!

​@KajalS good one. you mapped test data to the test design technique. nice way to get targeted test data.

your approach is also a unique one. cheers!

​@sarika77 did you got good results with your improved prompt? 

did you noticed some benefits or did it still hallucinated?

Yes ​@parwalrahul  after improving prompts, it’s giving good results I got test data exactly what I want. 

Improved the Prompt

Give me some test data for movie review web application.  It stores movie titles (string), user IDs (integer), user ratings (integer from 1 to 5), and review text (string, max length 500 characters).  I need about 50 data points in CSV format to test the functionality of the rating system and the review display.

Movie Title,User ID,User Rating,Review Text
Inception,101,5,An absolutely mind-blowing movie with incredible visuals and a complex, thought-provoking plot. Nolan at his best!
Titanic,102,4,A timeless love story set against the tragic sinking of the Titanic. Excellent performances and cinematography.
The Dark Knight,103,5,Heath Ledger's Joker steals the show in this dark and thrilling superhero masterpiece.
Avengers: Endgame,104,5,A satisfying conclusion to an epic saga. Emotional, action-packed, and visually stunning.
The Godfather,105,5,A masterclass in filmmaking. Perfectly executed in every way – acting, direction, and score.
The Shawshank Redemption,106,5,A deeply moving story about hope, friendship, and resilience. Tim Robbins and Morgan Freeman are outstanding.
Pulp Fiction,107,4,Quentin Tarantino's signature style shines through in this unpredictable, witty, and violent crime film.
Forrest Gump,108,5,A heartwarming tale that blends humor, history, and drama. Tom Hanks delivers a brilliant performance.
The Matrix,109,5,A groundbreaking sci-fi film with revolutionary visual effects and a captivating story.
Interstellar,110,4,An ambitious space odyssey exploring love, time, and survival. Visually mesmerizing but a bit dense at times.
Fight Club,111,5,A dark, satirical, and subversive film that challenges consumer culture. Truly unforgettable.
Jurassic Park,112,5,Steven Spielberg's thrilling adventure with lifelike dinosaurs and groundbreaking special effects.
The Lion King,113,4,A beautifully animated Disney classic with memorable songs and a timeless story.
Star Wars: A New Hope,114,5,The start of an iconic space saga. A landmark in sci-fi and film history.
The Lord of the Rings: The Fellowship of the Ring,115,5,A stunning adaptation of Tolkien's epic tale. Captivating from start to finish.
The Silence of the Lambs,116,5,A chilling psychological thriller with unforgettable performances from Anthony Hopkins and Jodie Foster.
Schindler's List,117,5,A harrowing and deeply impactful film about the Holocaust. A true masterpiece.
Goodfellas,118,5,Martin Scorsese's gripping tale of the rise and fall of a gangster. Powerful and brilliantly acted.
Saving Private Ryan,119,5,An intense, realistic portrayal of World War II. The opening D-Day scene is unforgettable.
The Sixth Sense,120,5,A suspenseful and emotional thriller with a shocking twist ending that will leave you speechless.
Gladiator,121,4,A gripping historical drama with a commanding performance by Russell Crowe.
The Prestige,122,5,An intricate, mind-bending tale of obsession, deception, and magic. Christopher Nolan excels again.
The Departed,123,5,An intense and unpredictable crime thriller with a stellar cast and gripping plot.
La La Land,124,4,A visually stunning and charming modern musical with captivating performances and music.
Whiplash,125,5,A tense and exhilarating exploration of ambition, obsession, and sacrifice. J.K. Simmons is phenomenal.
Blade Runner 2049,126,4,Visually stunning and thought-provoking, though slower-paced than its predecessor.
Black Panther,127,5,A culturally significant superhero film with great action and a compelling story.
Spider-Man: Into the Spider-Verse,128,5,A visually dazzling and creatively told animated Spider-Man film.
Coco,129,5,A beautifully animated and emotionally resonant film celebrating family and Mexican culture.
Inside Out,130,5,A clever and heartfelt exploration of emotions, beautifully animated by Pixar.
Frozen,131,4,A magical and visually stunning Disney hit with catchy songs and a heartfelt message.
Zootopia,132,5,An entertaining and socially relevant animated film with humor, heart, and a clever mystery.
Up,133,5,The opening sequence alone makes this Pixar classic unforgettable. Full of heart and adventure.
The Incredibles,134,4,A fun, action-packed superhero family film with great humor and animation.
Toy Story,135,5,The film that started it all for Pixar. Funny, heartwarming, and groundbreaking.
Finding Nemo,136,5,A visually stunning underwater adventure with humor, heart, and unforgettable characters.
WALL-E,137,5,A visually stunning and touching story about love, loneliness, and the environment.
The Grand Budapest Hotel,138,5,Wes Anderson's quirky and visually rich film, full of humor, heart, and eccentric characters.
The Social Network,139,5,An engrossing look at the creation of Facebook and the personal drama behind it.
The Wolf of Wall Street,140,5,An outrageous and darkly funny tale of greed, excess, and corruption.
Mad Max: Fury Road,141,5,A relentless, high-octane thrill ride with incredible practical effects.
Get Out,142,5,A brilliantly crafted and socially conscious thriller. Jordan Peele's debut is a knockout.
Parasite,143,5,A darkly comedic and gripping social satire with unexpected twists and masterful direction.
The Irishman,144,4,A contemplative and richly detailed gangster epic. Long, but rewarding.
Knives Out,145,5,A cleverly plotted and immensely entertaining modern whodunit with a stellar cast.
A Quiet Place,146,5,A tense, atmospheric horror film with minimal dialogue but maximum impact.
Her,147,4,A unique and poignant love story exploring technology, loneliness, and connection.
Moonlight,148,5,A beautifully crafted and emotionally resonant coming-of-age story.
The Revenant,149,5,A brutal, visually stunning survival tale with an intense performance by Leonardo DiCaprio.
Dunkirk,150,5,A tense and immersive World War II thriller with minimal dialogue and stunning visuals.
 

​@sarika77 cool and wonderful!

​@parwalrahul 

Thankyou

Given Prompt for Review: “ Give me some test data for this app.”


Issues identified with the Prompt:

Lack of Context: The prompt lacks clarity about the context, the type
of data required, and the app's functionality.
Vague Requirements: The requirement is vague; the only clear aspect is
that data is needed.
Unclear Testing Objective: The prompt does not specify what type of
testing the data is for, such as Functional, Security, or Performance
testing.
Unspecified Persona: It is unclear which user persona or role the data
is intended for or whether data is required for all personas.
Ineffective for AI: AI may not generate the expected dataset
accurately due to the generic nature of the prompt.

Prompts I came up with:

1. Provide test data for a Sales user when a Customer is logged into
Amazon and using Gift Vouchers.
2. Generate functional test data for an Amazon customer using Gift
Vouchers to complete a purchase.
 

ChatGPT Response: 

Here’s a sample test data for a Sales User when a customer is logged into Amazon and using Gift Vouchers:

Test Data for Sales User - Amazon Gift Vouchers

The refined AI Prompt impacted my response with below benefits:

• Increased specificity: Defined user roles and actions.
• Provided relevant data context: Specified the scenario.
• Clarified platform/application: Identified "Amazon" as the context.
• Specified functionality (Gift Vouchers): Narrowed the scope of data.
• Improved data relevance: Focused on the needed data.
• Enhanced data reliability: Led to more consistent outputs.
• Reduced AI bias: Avoided vague terms, preventing skewed results.

1. The given prompt is not clear because it doesn’t mention the type of app, what kind of test data is needed, or the format of the output.

2. Improved prompt: "Generate test data for a mobile banking app login. Include valid and invalid cases like correct login, wrong password, and locked account. Provide the data in a table format with input values and expected results."

3. This makes the prompt more specific and helps get useful test data.

4. A detailed prompt gives better and more accurate results for testing.

​@Kusumketu : giving user persona is always a great hack for extracting relevant outputs. I am glad that you did that.

All the best!

​@japankansara good one. clear mention of your specific cases and scenarios helps llms generate specific and curated answers. cheers!