Skip to main content

- - Learn
Products
Events
Groups
Support
Academy

Home
Discover
Discussions
Testing Strategies & Methodologies

Testing Strategies & Methodologies

Let's talk about testing your applications (manual, automatic, performance, ....)

68 Topics
175 Replies

When you subscribe we will email you when there is a new topic in Getting Started category

68 Topics

JamesMassaApprentice

posted in Testing Strategies & Methodologies

How to evaluate GenAI Summarization results

It is challenging to evaluate the results of GenAI applications because there are no expected results, only results from an acceptable range. For summarization GenAI use cases, what are the most common evaluation metrics?

posted in Testing Strategies & Methodologies

What are the QA trends that you are seeing right now?

People always make trends posts about 2024 2025 etc and they all have the same trends on them. AI Automation Performance etc …So my questions towards you is what are you seeing right now as a trend? What’s popped up more often?For me it would be A11Y - Accessibility testing, I see more and more people investing into it, many posts of it online. It might just be due to me not having much experience in it compared to other things.What are you spotting?

siddhantwadhwaniCrewman

published in Testing Strategies & Methodologies

DevTestOps with AI

1. Which approach in Generative AI is most effective for reducing false positives in automated test results?A. Supervised learning with predefined labels B. Reinforcement learning with continuous feedback loops C. Rule-based automation integrated with AI D. Traditional statistical analysis2. When leveraging Generative AI for code suggestions in a CI/CD pipeline, what is the key risk associated with hallucinations in Large Language Models (LLMs)?A. Excessive computational overhead B. Generation of incorrect or insecure code snippets C. Increased test execution time D. Lack of cross-platform compatibility 3. In the context of DevTestOps, what makes synthetic data generation using Generative AI superior to traditional data augmentation?A. Ability to mimic real-world scenarios without bias B. Faster generation time with minimal resources C. Elimination of manual effort in dataset creation D. Enhanced visualization for data analysis 4. Which is the most significant barrier to scaling Genera

posted in Testing Strategies & Methodologies

Could you share your experiences using AI-based tools for automating test maintenance and self-healing scripts? Are there any free solutions that offer these features?

As test suites grow, maintaining automated tests and handling script breakages can become challenging, especially with frequent application updates. I've read about AI-based tools that automate test maintenance and implement self-healing capabilities, which adapt scripts to changes in the UI or functionality.Could you share your experiences using these AI-driven solutions for automating test maintenance? Specifically, I'm curious about:How effective they’ve been in reducing manual intervention for script fixes Any free tools or open-source alternatives you've tried and their limitations How these tools integrate with existing automation frameworksI’d love to hear about any success stories or challenges you’ve faced while using them!

IOanPilot

posted in Testing Strategies & Methodologies

How to Set Up a Test Automation Project from Scratch?

How do you setup up a test automation project? Do you have a template that you use? Do you google each time you want to start. Do you reach for the documentation? I am curios what is your approach. Also, here is a link to a new resource I found on the topic that might help organize the test project creation, especially if you are just starting out

posted in Testing Strategies & Methodologies

What tools or approaches would you use to simulate simultaneous requests?

You're testing a payment gateway API responsible for handling financial transactions. Its primary function is to ensure that funds are transferred only when the account balance of the user is sufficient. In the test cycle, the following scenario was observed.Two simultaneous requests from two different devices for the same transaction-drawing money, for example, ₹10,000-an API processes both requests, deducting ₹20,000 from the account while it holds only ₹15,000.

KatCommunity Manager

posted in Testing Strategies & Methodologies

Poll📊: Faster and Higher-Quality Software Releases

What do you believe is the most significant factor contributing to faster and higher-quality software releases? Please select the option that you consider most important.

SaifApprentice

asked in Testing Strategies & Methodologies

Want to Start Career as a Automation Software Tester

I Learned the Course of QA Automation Testing using Selenium about a year ago but still I didn‘t get a Job. Please assist me to Start Career as a Fresher. of Automation Tester.

KatCommunity Manager

posted in Testing Strategies & Methodologies

Test Like A Developer, Develop Like A Tester

Which test automation tool has the most weekly downloads according to npmtrends? A) Cypress B) Playwright C) Puppeteer

IOanPilot

posted in Testing Strategies & Methodologies

What’s your favorite QA tool that has saved you the most time, and why?

I’m curious to know what’s the one QA tool that has saved you the most time during your testing process? Whether it’s for test automation, bug tracking, performance testing, or something else, I’d love to hear what tool you can’t live without and why it stands out to you.

asked in Testing Strategies & Methodologies

How do you ensure you don't miss important edge cases while testing large, complex tickets on the last day of the sprint?

When faced with testing large, complex tickets at the last minute, it’s easy to miss important edge cases, which can lead to undetected issues. How do you make sure you thoroughly cover all possible scenarios, including edge cases, given the limited time? What strategies or tools do you use to track these cases, and how do you prioritize the most critical ones to ensure comprehensive testing under pressure?

asked in Testing Strategies & Methodologies

Challenges with E-Delivery: What Strategies Can Help Ensure Reliable Software Releases?

I’m currently facing significant challenges with our e-delivery process that seem to impact the reliability and speed of our software releases. Despite thorough testing and successful build completions, we often encounter issues during deployment that lead to delays and frustration among team members and stakeholders.Here are some specific challenges we're experiencing:Inconsistent Build Artifacts: Different environments sometimes deploy artifacts that don't match what was tested, causing discrepancies in behavior. Communication Gaps: There seems to be a disconnect between the development and QA teams regarding the status and readiness of builds for delivery. Deployment Failures: We often see unexpected failures during e-delivery that weren't caught during testing, which leads to rollbacks and increased downtime. Dependency Management: Handling external dependencies (like APIs and libraries) can be tricky, and changes in those can break our deployments unexpectedly.I would love to hear

posted in Testing Strategies & Methodologies

Code Passed in Acceptance but Failing in Production – What Could Be the Cause?

We recently deployed a feature that passed all tests in our Acceptance environment (functional tests, regression, smoke tests), but after deployment to Production, we encountered issues such as broken functionality, unexpected errors, and performance slowdowns.Here’s the setup:Acceptance and Production environments are as close to identical as possible (same configurations, database versions, and server setups). Automated and manual tests ran successfully in Acceptance. The feature in question interacts with both third-party APIs and a legacy system.However, after deployment to Production, users are facing:API timeouts and failed calls to third-party services. Slower performance in certain areas of the application. Data inconsistencies when interacting with the legacy system.Has anyone experienced a similar issue where everything works fine in Acceptance, but things fall apart in Production? What are some potential causes or overlooked areas that could explain this discrepancy?I’m part

IOanPilot

posted in Testing Strategies & Methodologies

If you could only choose one, which testing approach would you eliminate from your workflow?

1️⃣ Automated Testing - Let the machines do the work, but at what cost?2️⃣ Manual Testing - Human touch is invaluable, or is it?3️⃣ CI/CD Pipeline Testing - Seamless integration or overkill?4️⃣ Exploratory Testing - Creative freedom or chaotic mess?5️⃣ Test-Driven Development (TDD) - Code-first or test-first?🎯 Vote and defend your choice in the comments!What would you sacrifice, and why? Let the debate begin!

asked in Testing Strategies & Methodologies

What are the typical root causes for functionality failures in situations where no apparent code or infrastructure changes were made?

Functionality failures in cases where no apparent code or infrastructure changes were made can be tricky to diagnose. Common root causes include environmental drift, where configurations or dependencies in the environment subtly change over time, leading to inconsistencies. Data-related issues, such as corrupted or outdated data, can also break functionality without any direct code changes. External factors like third-party APIs, services, or network-related issues may alter their behavior, impacting the application. Timing or concurrency issues can surface unexpectedly, especially in high-load scenarios. Finally, hidden bugs or edge cases may not have been caught during testing but reveal themselves later due to changing conditions.

IOanPilot

posted in Testing Strategies & Methodologies

How do you spot text generated by LLM/AI

Since we are testers we tend to spot pattern and issues even when we do not want to :smiley: .So i was wondering how do you spot a text that is generated by an LLM/AI.Please do not say I use a scanner.For me the tells are usually these 3* Using the prashe "In the world of"* Using words that one does not usually use in a day to day conversation like delve* The post is marked with emojis all the way.What about you?

asked in Testing Strategies & Methodologies

What’s your strategy for ensuring that automated tests provide fast feedback without sacrificing test coverage?

Automated testing is crucial for fast feedback, but there’s often a trade-off between speed and thorough test coverage. What strategies do you use to ensure that your automated tests deliver rapid feedback without sacrificing coverage? Share your approaches for balancing test execution time with maintaining comprehensive testing, especially in continuous integration environments.

asked in Testing Strategies & Methodologies

Has anyone integrated AI or ML into their test automation process? How has it impacted test effectiveness and speed?

AI and machine learning are transforming many areas of software development, including test automation. Has anyone here integrated AI or ML into their test automation process? How has it affected the effectiveness, speed, and accuracy of your tests? Share your experiences, including any benefits or challenges you've encountered along the way.

asked in Testing Strategies & Methodologies

What’s your approach to testing in a fast-paced DevOps environment where code changes are frequent?

In fast-paced DevOps environments, frequent code changes can make thorough testing a challenge. What’s your approach to ensuring high-quality testing without slowing down the development pipeline? How do you balance speed with accuracy, and what strategies or tools do you use to maintain test coverage and effectiveness in such a dynamic setting?

asked in Testing Strategies & Methodologies

What’s your approach to testing flaky tests? Any go-to strategies to make them more stable?

Flaky tests, which produce inconsistent results, can disrupt the development process and reduce confidence in test automation. What is your approach to identifying and managing flaky tests? Do you have any proven strategies or best practices for making them more stable and reliable in your test suite? We'd love to hear your methods for addressing this common challenge.

posted in Testing Strategies & Methodologies

Testing Real-Time Data Feeds

In scenarios where your application integrates with real-time data feeds (e.g., stock prices, sensor data), how do you approach automated testing? What tools or frameworks help simulate or validate such real-time interactions?

posted in Testing Strategies & Methodologies

Parallel Test Execution Challenges

When running automated tests in parallel, what are the most common challenges you've faced, and how did you overcome issues such as test data dependency or browser state? Do you have any strategies for efficiently managing resources?

posted in Testing Strategies & Methodologies

How do you address the 'black box' nature of AI algorithms when integrating them into your testing strategy?

AI models often operate as black boxes, making their decisions opaque. How do testers ensure they understand and trust AI-driven test results?

posted in Testing Strategies & Methodologies

How do you handle flaky tests in automation, and what steps do you take to diagnose and fix them?

Flaky tests can undermine confidence in automated testing. How do testers identify the root causes and resolve these issues?

asked in Testing Strategies & Methodologies

How do you integrate exploratory testing into an agile workflow without disrupting sprint schedules?

Exploratory testing is crucial for uncovering unexpected issues, but it can be hard to plan in a time-boxed environment like Agile. How do teams incorporate it effectively?

1
2
3

Page 1 / 3

Ask Question

ask the community

WELCOME VIDEO

Powered by Gainsight

ShiftSync Terms and Conditions

Sign up

Already have an account? Login

Username (can't be changed afterwards) *

E-mail address *

First Name *

Last Name

(Private)

Only you and moderators can see this information

*

Do you use Tricentis products?

(Private)

Only you and moderators can see this information

*

Tosca qTest NeoLoad Testim Testim Mobile Testim Salesforce Test Management for Jira Vera Data Integrity LiveCompare Test Automation for Enterprise SaaS testing SeaLights None

Give thanks – add your referrer’s name!

Password *

I agree to receive marketing communications according to the Privacy Policy and agree to the Tricentis General Terms of Use.

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

Copyright ©2024 Tricentis. All Rights Reserved.

Do Not Sell My Personal Information

Legal Information

Terms and Conditions