# Natural Language Test Creation

## Describe the Test.  Pie Runs It.

Create automated tests in plain English. No selectors to configure. No scripts to maintain. No code to debug. Just describe what you want tested and watch it execute.

[Try it free](https://app.pie.inc/start) [See how it works](https://pie.inc/product/custom-tests/#how-it-works)

Results in minutes  
Zero code required  
<60s  
Prompt to running test  
90%  
Less effort vs scripting  
0  
Lines of code required  
Live  
Watch execution in real-time

## Test scripts take hours.  Prompts take seconds.

Traditional test automation means learning frameworks, writing code, debugging selectors, and maintaining scripts that break with every UI change. Pie flips the model.

| Traditional            | With Pie       |
|------------------------|----------------|
| Create test            | 2-4 hours      | < 1 minute  |
| Skills needed          | Selenium, Cypress... | Plain English |
| Maintenance            | 20-40 hrs/month| Self-healing |

## Create. Validate. Automate.

Build tests in plain English, verify they work live, then let Pie run them on every release.

### 1. Write in Plain English

Describe the test like you'd explain it to a teammate. No special syntax required.

```plaintext
"Test checkout with an expired credit card"
"Verify admin can't access user-only pages"
```

### 2. Watch It Execute Live

Pie's AI agent navigates your app using computer vision. See every click, every assertion in real-time.

```plaintext
Navigating to checkout...
Entering expired card...
Verifying error message...
```

### 3. Get Clear Results

Pass or fail with screenshots, execution replay, and step-by-step reasoning.

Test Passed  
Error message displayed correctly.

## Real Examples

### Just Tell Pie What to Test

Real prompts. Real tests. No syntax to memorize.

#### Authentication

```plaintext
"Navigate to Register. Enter a unique email, create password 'Test123!', accept terms, click Sign Up. Log out. Return to Login, enter same credentials, sign in. Verify dashboard loads."
```

Tests complete signup → logout → login flow with verification

#### E-commerce

```plaintext
"Go to Shop > Products. Add first item to cart. Increase quantity to 2, verify total updates. Checkout with test card 4111111111111111."
```

Full checkout flow with quantity updates and payment

#### CMS

```plaintext
"Go to Admin > Content > Pages. Create page with unique title, add body text, set to Draft, save. Search for the page, change to Published, save. Verify it appears in Published list."
```

Create, update, and verify content publishing workflow

#### Edge Case

```plaintext
"Navigate to Contacts. Create contact with unique name. Search for it, select it, click Delete. Confirm deletion. Search again and verify no results found."
```

Create-delete-verify pattern for data integrity testing

#### Pro tips for great prompts

- Use `>` for navigation: `Settings > Users > Roles`
- Say "unique email" or "unique name" for auto-generated data
- End with "verify" for explicit assertions

## Use Cases

### Test What Automated Tools Can't

Discovery builds your baseline. Custom Tests handle the scenarios that require domain knowledge.

#### Edge Cases

Boundary values, special characters, Unicode input, maximum field lengths. The inputs that break apps in production.

```plaintext
"Enter 10,000 character description and submit"
```

#### Negative Testing

Invalid inputs, unauthorized access attempts, error handling. Verify your app fails gracefully.

```plaintext
"Try accessing /admin as a regular user"
```

#### Regression Tests

That bug you fixed last month? Create a test to make sure it stays fixed forever.

```plaintext
"Verify cart total includes tax for CA addresses"
```

#### Smoke Tests

Critical path validation after every deploy. Know within minutes if login, checkout, or core flows work.

```plaintext
"Complete full checkout with saved payment method"
```

#### Feature Flags & A/B Tests

Test both variants of an experiment. Verify feature flags enable/disable correctly.

```plaintext
"Test checkout flow with new_ui flag enabled"
```

#### Manual Test Migration

Upload your spreadsheet of manual test cases. Pie converts them into automated tests.

```plaintext
Import from CSV, Excel, or TestRail
```

## Iterative Testing

### Your First Prompt Doesn't Need to Be Perfect

Watch the test run live. See exactly what the agent does. If it takes a wrong turn, add clarification and rerun. The agent adapts to your feedback.

```plaintext
Initial prompt  
"Test the Safe Zone feature"
```

Agent feedback

```plaintext
Tapped circle button instead of square. Buttons are visually similar.
```

Your clarification

```plaintext
"The delete button is under the three-dot menu"
```

Test passes

Safe Zone feature tested successfully. Test saved to regression suite.

## Complete Coverage

### Discovery Builds the Foundation.  Custom Tests Fill the Gaps.

#### Autonomous Discovery

Point Pie at your app. We explore every feature, every flow, every edge of your UI. In hours, you have a regression suite that would take weeks to build manually.

- 100+ tests generated automatically  
- Core user flows covered  
- Regression baseline established

#### Custom Tests

You know things about your app that no AI can discover on its own. Custom Tests let you encode that domain knowledge into your test suite.

- Edge cases only your team knows  
- Specific bugs from customer reports  
- Complex business logic validation

Both run together in your regression suite. Import existing test cases. Add new ones anytime.

## Start Testing in Minutes

No scripts to write. No selectors to maintain. Describe what needs testing and watch it happen.

[Try it free](https://app.pie.inc/start) [Talk to sales](https://calendly.com/jinoo-pie/demo)

## Frequently Asked Questions

### How do I create a custom test?

Describe the test in plain English. 'Log in as admin, navigate to settings, change notification preferences, verify changes persist after logout.' Pie interprets the intent and executes it. No code, no selectors, no scripting language to learn.

### What if Pie misinterprets my test description?

You watch the test execute live. If the agent takes a wrong turn, add clarification and rerun. Most tests work correctly on the first or second attempt. The agent learns from your feedback.

### How do Custom Tests work with Autonomous Discovery?

They're complementary. Discovery generates your baseline test suite automatically. Custom Tests let you add specific edge cases, regression scenarios, and tests for flows only your team knows about. Both run together in your regression suite.

### Can I import my existing manual test cases?

Yes. Upload a CSV of your manual test bank and Pie converts them into executable automated tests. No rewriting required.

### How long do custom tests take to run?

Most tests complete in 2-5 minutes. You can watch the entire execution live or let it run and review results later.

### What platforms are supported?

Web apps, iOS, Android, React Native, Flutter. If a human can interact with it, Pie can test it.