Playwright has introduced a powerful new feature: Playwright Agents, new in Version 1.56. These agents can generate test plans, create tests based ...
For further actions, you may consider blocking this person and/or reporting abuse
I am getting below exception while executing code .
Error: Playwright Test did not expect test() to be called here.
Most common reasons include:
at seed.spec.ts:3
1 | import { test, expect } from '@playwright/test';
2 |
Just a quick input as I was seeing the article and relate it to our team as were also seeing unexpected Playwright test failures or config headaches, there one of the QA of OpenObserve suggested us to use a Reporting and Analytics tool named TestDino. We tried it in our team and it gave good results.
import { defineConfig, devices } from '@playwright/test';
export default defineConfig({
testDir: './tests',
testMatch: ['*/.spec.ts'], // only runs .spec.ts files
fullyParallel: true,
forbidOnly: !!process.env.CI,
retries: process.env.CI ? 2 : 0,
workers: process.env.CI ? 1 : undefined,
reporter: [['html', { open: 'never' }]],
use: {
baseURL: 'thinking-tester-contact-list.herok...',
trace: 'on-first-retry',
headless: false,
screenshot: 'only-on-failure',
video: 'retain-on-failure',
},
projects: [
{
name: 'chromium',
use: { ...devices['Desktop Chrome'] },
},
],
// optional web server (disable if not needed)
// webServer: {
// command: 'npm run start',
// url: 'localhost:3000',
// reuseExistingServer: !process.env.CI,
// },
});
this is playwright.config.ts file.could you please look into it ?
I am getting the same.. pls assist
Hi! I just joined (and new to playwright) and was curious if there was any ability for Playwright to be used in TDQ .... basically confirming data quality and expectations?
An example of what I mean is like - verification that there are XX people in a metropolitan area (as an example.) .... If we know that there are 1000 people in an area but the database posts next month that there are 10,000 people.... does Playwright have the ability to signal that discrepancy? We already have notifications as to null data... but trying to automate that manual verification of that data.
Thank you!
@debs_obrien Thanks this is great explanation. Just curious, these agents are using playwright MCP server under the hood , or we need to have playwright map server configured as well as a pre-requisite.
Getting below error for me and my whole team. unable to find any answers anywhere... pls assist folks.
There is a bug opened for this:
github.com/microsoft/playwright/is...
@debs_obrien As a huge Playwright fan, this functionality really has me super excited and I am starting to play around and "test" it a little.
I am also very curious about the security behind these agents? Coming from a security software industry, I am super reluctant to just have any AI access my Automation "secrets". Some of my project store the secrets (credentials, api keys, database connection strings etc) in Azure Keyvault and others in appsettings for instance. I do not feel comfortable running my automation tests, extracting these sensitive information via my secret provider service, and have the Playwright agents access it in any way?
Does Playwright use a RAG at all? and how safe is it to have the Playwright planner for instance, access a website and then logging in with credentials either from storage state or provided via my secret provider service (a function I built in my framework)?
Thanks Deb .. Explained very well.
Interesting, but when I try the step "In VS Code open chat mode and select the Playwright Planner Agent" I press ctrl+alt+i and I see no chat mode selection.
I enabled agent mode in VSCode according to this document (it would be nice if you mention it as a prerequisite) code.visualstudio.com/docs/copilot...
But the planner agent does not really open any browser on my pages (I added a page.goto(...) in my seed file).
Interesting. Thanks. Am using VS Code Insiders which is the latest build of VS Code. They should be releasing this week and that should fix some issues. Thought agent mode was turned on by default
Hello @debs_obrien is there a plan to release these agents to .net version of playwright?