Overview

AI-Powered Intelligent TestingStably’s exploratory testing agent analyzes your PR feature specifications, and automatically perform comprehensive testing:
  • Analyzes code changes & PR description to understand what functionality needs testing
  • Intelligently navigates through your application
  • Tests edge cases and feature userflows
  • Posts detailed test reports with findings and UI/UX feedback
  • Skips testing for changes that it can’t test

Exploratory Testing

Perfect for: Augmenting your PR review process and can be used in conjunction with your PR code review bots

Setup Process

1

Install GitHub App

The first step is to connect your GitHub repository to Stably:
  1. Navigate to Settings > GitHub PR Testing in your Stably dashboard
  2. Click Install GitHub App
  3. This will connect your GitHub repository to Stably and enable automated testing on pull requests
GitLab and API-based triggers are coming soon for our exploratory testing agent.
2

Configure Repository

Next, configure which repository and branch Stably should monitor:
3

Configure Exploratory Testing

The final step involves setting up how the exploratory agent will operate:

How Exploratory Testing Works


Regression Testing

Perfect for: Running your existing test suites automatically on every PR to ensure new changes don’t break existing functionality.

Setup Process

1

Create Test Suite

First, ensure you have test suites created in your Stably project:
  • Record or generate test cases covering your application’s critical paths
  • Organize tests into logical test suites
  • Configure test data and authentication as needed
2

Set Up CI Integration

Configure your CI/CD pipeline to run tests automatically:
3

Configure Test Maintenance

Enable AI Auto Heal to keep tests up-to-date automatically:
  • Tests automatically adapt to minor UI changes
  • Configure healing sensitivity in Settings > AI Agents
  • Set exploration cycle limits for auto-healing behavior

Best Practices

Configuration Tips
  • Use descriptive custom prompts to provide context about your application
  • Set up authentication properly so the agent can access all necessary parts
  • Update PR templates regularly to keep them current with your testing needs
Team Workflow
  • Review test reports and check the detailed findings in PR comments
  • Act on feedback and address any issues raised by the exploratory agent
  • Iterate on configuration and refine setup based on testing results
Optimization
  • Monitor test coverage to ensure the agent tests the right areas
  • Adjust custom prompts and fine-tune instructions based on outcomes
  • Keep test accounts and credentials current

Combining Both Approaches

For maximum coverage and confidence, we recommend using both testing approaches together:
  • Exploratory Testing discovers new issues and validates user experience
  • Regression Testing ensures existing functionality remains stable
  • Both provide complementary coverage for comprehensive PR validation
You can enable both types of testing simultaneously. Stably will run them efficiently and provide consolidated reporting.

Troubleshooting