Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SUGGESTION] Performance bottleneck for non-cached tests #181

Open
gladyshcodes opened this issue Dec 26, 2024 · 2 comments
Open

[SUGGESTION] Performance bottleneck for non-cached tests #181

gladyshcodes opened this issue Dec 26, 2024 · 2 comments

Comments

@gladyshcodes
Copy link

What

Speed up test execution by finding ways to addressing issues outlined below.

Why

While working on #179, I have found that screenshooting perhaps takes the most time when test runs in --no-cache mode. Sometimes, screenshots are taken several times when there's no need for it. Also, delay before making a screenshot is about a second or so.

@m2rads
Copy link
Contributor

m2rads commented Dec 27, 2024

That is a good observation and I here is my plan to speed it up. Here's an outline of what I have in mind:

  • Instead of saving screenshots in the folder, we can save it in the memory thus making efficient use of space and
  • Adding screenshots automatically after executing an action. (Currently we wait for AI to instruct us when to take sc)
  • Performing multiple actions per screenshot whenever possible. (Not sure if this is possible with Computer use API yet)

I think implementing these simple changes should speed up the AI execution by 2x at least.

@slavingia, @gladyshcodes Wdyt?

@slavingia
Copy link
Contributor

Makes sense. I pinged Anthropic to see if they'd support multiple actions in one step.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants