page.waitForLoadState ( Testing clerk sign up )

[tanushmahalka]

Reproduction

import { shortest } from '@antiwork/shortest'

shortest('Sign up using email and password', { 
  email: "[email protected]", 
  password: "test" 
})

Its kinda stuck here:

and then I get an execution error
Test Execution Error: page.waitForLoadState: Timeout 30000ms exceeded.

[m2rads]

Which version are you using?

[tanushmahalka]

Which version are you using?

@antiwork/shortest": "^0.1.1"

[m2rads]

Could you try running your tests with npx shortest --debug-ai and let me know if you see any issues?
Also are you running this against your localhost?

[tanushmahalka]

Also are you running this against your localhost?

Yes

Could you try running your tests with npx shortest --debug-ai

[m2rads]

Thanks for the sc. Seems like the initial page load is timing out. Here are couple things you can try to trouble shoot this issue:

1. Try version 0.1.0 see if the same issue happens
2. Try running your tests in headless mode: pnpm shortest --headless
3. For testing clerk you can also do something like below. Make sure to setup your clerk dev env to accept email code.

import { shortest } from "@antiwork/shortest";
import { clerk, clerkSetup } from "@clerk/testing/playwright";

let frontendUrl = process.env.PLAYWRIGHT_TEST_BASE_URL ?? "http://localhost:3000";

shortest.beforeAll(async ({ page }) => {
  await clerkSetup({
    frontendApiUrl: frontendUrl,
  });
  await clerk.signIn({
    page,
    signInParams: {
      strategy: "email_code",
      identifier: "[email protected]",
    },
  });

  await page.goto(frontendUrl + "/dashboard");
});

shortest("your test case")

4. Double check your shortest.config.ts file and make sure it's similar to the one below:

import type { ShortestConfig } from "@antiwork/shortest";

export default {
  headless: false,
  baseUrl: "http://localhost:3000",
  testDir: "app/tests",
  anthropicKey: process.env.SHORTEST_ANTHROPIC_API_KEY,
} satisfies ShortestConfig;

If none of the above works please let me know. Thank you!

[tanushmahalka]

so sorry, it seems like all of them are resulting in a timeout,
including the beforeAll callback is not signing things in..

Must be a problem with my setup

import type { ShortestConfig } from '@antiwork/shortest';

export default {
  headless: false,
  baseUrl: 'http://localhost:3000',
  testDir: 'app/__tests__',
  anthropicKey: process.env.ANTHROPIC_API_KEY
} satisfies ShortestConfig; 

[m2rads]

Hhhm that's interesting. I will see if I can reproduce this issue on my end.

In the meantime, do you have any other projects to try this one? Let's see if the issue is specific to your project or not. Thank you!

[m2rads]

Hi @tanushmahalka just following up on this. Were you able to run this on a different project? Please let me know if this issue persist across different project and we can open a bug.

Unfortunately I have not been able to replicate this issue on my end yet but I will improve the waitForLoad mechanism. Please let me know if have any other questions.

[m2rads]

This issue got reported again in issue: #188. I will close this one and track the fix there.