The Curious Case of testRigor’s AI

Sep 12, 2024By Liliya Frye
Liliya Frye

Imagine a world where software development is faster than ever before. We’re in 2030, where new applications are built quickly, new features are released daily, and testing is fully automated, continuous, and reliable. The days of spending endless hours on test maintenance are behind us. 

How Did We Get Here?

The evolution of software development life cycles (SDLC) demanded a radical shift in how we approached testing. As the pace of innovation accelerated, the need for efficient, reliable, and low-maintenance test automation became critical. 

Traditional tools like Selenium, Cypress, Playwright, and Appium, while powerful, on many occasions face challenges with flaky tests and high maintenance costs. 

Moreover, it takes a significant amount of time for Software Development Engineers in Test (SDETs) or Automation Engineers to write tests, and they are often able to do so only when the feature is stable. This delay adds to the overall cost and inefficiency. 

The software development industry needed a new solution, one that would use Specification Driven Development (SDD) to drastically reduce test maintenance, improve test coverage, and keep up with the rapid pace of modern software development life cycles.

This future solution is here right in front of you waiting to simplify your life and assure the quality.

Easy Test Automation

Meet testRigor a human manual tester emulator 🤖 that is driven by AI/ML which transforms how we approach testing. With @testRigor, you can build and maintain automated tests with ease, using natural language and minimal technical overhead. 

They train Large Language Machine Learning Models to understand and predict test case scenarios based on specific prompt commands.

Imagine building your automated tests 15 times faster and reducing your test maintenance by 90%, spending almost no time on upkeep, and focusing on what truly matters—delivering high-quality products to your users.

Testing Capabilities

  • Acceptance testing
  • Smoke testing
  • Regression testing
  • System End-to-End testing
  • API testing
  • Visual testing
  • SMS and phone call testing
  • 2FA and Captcha testing

Revolutionize Test Automation

  • Quick Automation: Your Manual QA Engineer can quickly build automation. testRigor’s intuitive interface allows you to learn the basics in just a few hours. No need for deep programming knowledge—just natural language commands that anyone can understand. However, scripts should follow a few requirements:
    • Each command used should look exactly like it’s shown in the documentation.
    • Each step should always be on its own new line.
    • All parameters should be in double quotes.
  • Import Test Cases: Bring existing test suites into testRigor from most test management tools like TestRail, Zephyr,  XRay, Azure DevOps, etc.
  • Build Tests Quickly: testRigor enables you to build test automation without writing code. With just a few simple phrases (click, generate, check, enter, switch tab, drag, hover, go back, restart app, call api, mock api call, upload file, send email, sms, change device orientation, etc.) you can create powerful, executable tests that mirror end-user behavior.  Click could be used for web and mobile applications, but tap only for mobile apps. By default, a directional relative location (on the right, on the left, above, below) means “directly” (directly below, directly above, etc).  

Think like a prompt engineer and provide more clarity in your test cases.

What might take 20 lines of code in traditional frameworks takes just two lines in testRigor.

Example:

click "Subscribe to Women In Tech Newsletter"
check that page contains "Sign in"

Functional End-to-End Testing: testRigor supports comprehensive end-to-end testing, interacting with your application at the user level. Due to the lack of dependency on locators, there is no need to worry about changes in XPaths, CSS Selectors, IDs, data-test-ids and other locators. 

Customer Satisfaction Survey Concept, Users Rate Service Experiences On Online Application, Customers Can Evaluate Quality Of Service Leading To Business Reputation Rating.

Edge Cases: You can use the Generate corner cases feature to cover edge cases proposed by AI.

  • Global Variables and Reusable Rules: You can parameterize test data (credentials, file uploading, repeatable text) in “Global Variables”. Avoid hard-coding any test data. 
    two women in suits standing beside wall
    Create “Reusable Rules” for repetitive steps in multiple test cases. 
    blue skies filled of stars
  • Inheritance and Shared Suites: You can inherit a shared code in the “Shared test suite” section for cross-browser and cross-platform testing between web, Android, and iOS applications so you can reuse the test suites, rules and data from a parent suite. 
    person holding pencil near laptop computer
  • Parallel Testing Across Browsers: Run your tests in parallel across 3,000 combinations of multiple OS, platforms and browsers—Chrome, Safari, Firefox, and Edge —on up to 1,000 servers, ensuring that your application works flawlessly across different environments. For example, with the Shared test suite feature the same test case can verify Calendar controls in multiple browsers and OS that have different mechanisms to render Calendar’s data time picker.

TestRigor supports the latest version of OS and browsers. For different versions of operating systems and browsers, you can use LambdaTest, BrowserStack, Sauce Labs, and Kobiton which can be easily integrated with testRigor. Look at this video on how to execute testRigor tests on LambdaTest. 

  • Record and Playback Testing: testRigor TestCase Recorder Chrome plug-in can record user actions and generate steps that will automatically populate in testRigor suite. The plug-in only works if you have a testRigor account, including a trial one, and you are logged in. I noticed you’ll need to correct and clean up some steps after Recorder’s auto population as it would miss some logic or steps. Here is an instruction on how to use testRigor Recorder.
  • API Testing: testRigor extends beyond UI testing, supporting API calls and mocking responses (headers, body and/or http status code). It’s ideal for happy path and negative testing of servers that are still unstable or testing of third-party API calls which could be expensive when calling the real services. This versatility allows you to ensure your application’s quality across layers.

Example: 

mock api call POST "https://jsonplaceholder.typicode.com/todos" with headers "Content-Type:application/json" and "Accept:application/json" and body "{\"desc\":\"New Todo\"}"
returning payload "Todo created" and http code 200

  • Mobile Testing: You can test on Safari and Chrome mobile browsers and native applications on iOS and Android. The difficulty of writing automation tests via Appium and then running them on multiple real devices is a known fact. It's very hard to automate push notifications. With testRigor you’d save the time it takes to set up the Appium server locally. You don’t have to configure mobile emulators in your local environment and you can start scaling your test instantly on physical devices through testRigor and LambdaTest. Most importantly you can automate push notifications of multiple events and identify issues that could cause your customers to churn.
  • SMS, Email and Phone Call Testing: You can send text messages, email and make/receive phone calls via seamless integration with Twilio. 

Example:

check that sms to "+12345678901" is delivered

  • Testing Tables: testRigor supports tables for all kinds of operations including but not limited to: validations, clicks, hover, entering data (enter … into), drag and drop, etc. If the verifying tables test fails – you should use relative locations instead. Keep in mind you can refer to elements of the table by specifying row and column. You can also construct SQL-like expressions containing one or multiple columns with different validations. 

The following boolean operators are supported:

    • AND
    • OR
    • NOT
    • Brackets ()

Example:

check that table with "Country" equal to "United States" and "City" equal to "Saint Petersburg" and "State" equal to "Florida" at column "Status" contains "Flourishing"

  • CI/CD Integration: There’s a special Bash/PowerShell script code that you can copy and paste into your existing CI/CD pipeline. A bash script is for Linux-based systems and a PowerShell script is for Microsoft systems. Then it will trigger testRigor. Your CI will fail if testRigor fails and pass if testRigor succeeds.
    people sitting at the table
  • Speed Optimization: Set your own timeouts and delays for Login or Signin, conditional searches, file download or upload, interacting with dropdowns, delay after form filled out, switching tabs delay, special timeouts for native elements in Android applications, hold before scroll or swipe for iOS applications, etc.  
    two gray pencils on yellow surface
  • AI and LLM Testing: You can verify chat bots or any ML apps for positive messages or validate true or false of natural language statements. 

Example:

 check that "chat" "contains a positive message" using ai

  • Graphs and Diagrams Testing: You can test that a graph’s image on the web page shows positive growth. This is possible using testRigor’s Vision AI. It will invoke AI to analyze the screen and do validations that were only possible to do manually previously. 

Example:

check that page "contains an image of graph of positively growing function" using ai

woman using MacBook Pro with person in white top
  • Minimal Maintenance: One of the most significant challenges in automation is maintaining tests as applications evolve. TestRigor’s AI doesn't rely on locators therefore it’s more stable than any self-healing tool, suggesting fixes based on new functionality and eliminating the need for constant manual updates.
  • Find and Replace Test Steps: When your test cases fail you’ll see on the left panel next to Errors the numbers of failures and severity of issues marked by color. You can analyze failures, and fix the test steps right away with the “Find and Replace Test Steps” feature. You can fix the issue for all shared suites.
    person on stage
  • Reporting: You can get reports with historical data going back up to a year. You will receive the reports for each test suite run via email, Slack or Microsoft Teams  with details of how many test cases were executed, how many tests passed/failed, time it took to run it. 

However, as of the time of this writing, the reporting is not detailed enough as it doesn't provide the names of passed/failed test cases, and you can’t add the bug ID to failed test cases like in TestRail. 

The alternative solution is the other reporting tools that TestRigor integrates with TestRail, Jira, Zephyr, Xray, ReportPortal, Microsoft Azure DevOps. By understanding your target audience you can provide the appropriate summary and context. 

When To Use TestRigor?

With Specification Driven Development for web, desktop, mobile web, and mobile native applications, testRigor attempts to simplify the process, save 30-40% of developers' time previously spent on fixing bugs, reduce overhead, and offer reliable tests from an end-user perspective. 

It’s an incremental shift-left approach with testing early during the software development life cycle and testing smaller pieces or modules before complete feature delivery. With natural language and leveraging AI-driven automation, TestRigor significantly reduces the complexity and effort required to maintain a robust testing suite. 

Tests are stable and reliable since many parameters are auto-analyzed when selecting specific elements and it integrates seamlessly into the CI/CD pipelines. 

If you have limited resources and tight deadlines, AI can help you generate test cases, or you can import existing tests from TestRail or other test management tools and/or build thousands of low maintenance test cases within a few months from scratch. 

This tool is the ideal choice for teams looking to accelerate their delivery time and increase automation coverage 100 times faster compared to Selenium or Appium frameworks by utilizing Manual Testers, QA Engineers, Business Analysts, Product Owners or Product Managers who can automate critical business logic flow within hours, reduce the number of bugs escaping into production, and deliver high-quality software consistently.

Engineers can easily update tests for branches from Git in CI/CD, test locally from the Command-Line Interface and add more functional tests for new features alongside the code.

TestRigor with AI-backed features is the best way to test massive applications like Salesforce, SAP, ServiceNow, Oracle, Workday and other CRM and ERP software. As these applications evolve, their integrations with existing systems in the organization are also affected. It can create challenges from a maintenance perspective. With testRigor, you can execute effective regression tests in minutes and formulate additional test cases quickly.

Integrations

TestRigor integrates with the following tools:

  • Scalability: LambdaTest, BrowserStack, Sauce Labs and Kobiton
  • Test Management: TestRail, Zephyr, Xray, Azure DevOps
  • Issue Tracking: Jira, Pivotal Tracker, Microsoft Azure DevOps
  • Incident Management: PagerDuty
  • SMS/Email/Calls: Twilio
  • BDD: CucumberStudio
  • CI/CD: Jenkins, Github Actions, GitLab, CircleCI, Azure DevOps

Try It Now

Experience the future of testing yourself. You can use a Public Open Source version that is free forever, however, all your tests and test runs will be public. Or you can start a free 14-day trial that is completely private and you’ll need to select a paid plan at the end of the trial. For a more personalized experience, request a demo and discover how TestRigor can transform your testing processes.

Hundreds of millions of automated tests across thousands of customers have already been run on testRigor’s platform, proving its effectiveness and reliability over various industries. Whether you’re a startup looking to scale or an enterprise needing to streamline your testing processes, testRigor offers a solution that meets your needs.

The future of testing is here, and it’s autonomous.