[Tracking]: Component Testing Enhancements 🔧

[JReinhold]

🧑‍🤝‍🧑 Who: @JReinhold, @ndelangen and @ghengeveld

This is a tracking issue for the Component Testing Enhancements 🔧 project. The purpose of this issue is to keep tracking of the overall status of the project and tasks, and plan everything around it. This project is a continuation of #29088 and is related to #29529 and #29530.

⚠️ Problem

There was a few unresolved items in #29088 that we want to work on to improve the Component Testing experience. Further more, we're continuously receiving feedback on the new feature that we want to address.

Tasks

Must Haves

Preview Give feedback

1. E2E tests for Testing improvements #29745
   +0
   
2. [Bug]: Test addon init should update framework in Next projects #29796
   addon: test bug nextjs +3
   
3. Test addon should install coverage provider out of the box #29797
   addon: test bug sev:S2 +3
   
4. [Bug]: Addon test includes stories in coverage reports #29613
   addon: test bug sev:S2 +3
   
5. [Bug] some stories are visible in the index but not in Vitest, or vice versa #29771
   bug portable stories sev:S2 +3
   
6. [Bug] staticDirs API not compatible with vitest plugin #29772
   bug portable stories sev:S2 +3
   
7. [Bug] Vitest Plugin ignores custom scripts in preview config #29775
   bug portable stories sev:S2 +3
   
8. [Bug] HTML Injection ignored by vitest plugin #29776
   bug portable stories sev:S2 +3
   
9. [Bug] custom configuration ignored by Vitest plugin #29778
   bug portable stories sev:S2 +3
   
10. [Bug] Storybook environment variables not fully supported in Vitest plugin #29779
    bug portable stories sev:S2 +3
    
11. [Bug]: Sidebar context menu behaves incorrectly in reffed entrys #29686
    bug composition sev:S2 +3
    
12. [Request] Support for portable stories and experimental vitest-addon addon-svelte-csf#213
    enhancement next +2
    
13. [Bug]: Cannot find module 'react-dom/client' with portable stories in React 17 projects. #26842
14. [Bug]: Test discrepancy handling is not accurate #29703
    addon: test bug sev:S2 +3
    
15. Testing Module doesn't communicate properly that Vitest is unresponsive/restarting #29784
    +0
    
16. Additional telemetry #29349
    addon: test feature request telemetry +3
    
17. Improve UI for component tests in story menu #29647
    4 of 4
    addon: test feature request +2
    
18. Bug: Investigate global-setup storybook spawn script sometimes not killing Storybook process #28890
    bug sev:S2 +2
    
19. [Bug]: Test progress updates causes the whole sidebar to scroll (roughly once every second) #29652
    +0
    
20. [Bug]: Error: Cannot find module '@storybook/experimental-addon-test/internal/coverage-reporter' in monorepo setups #29785
    sev:S2 +1
    
21. [Bug]: Focused test run tooltip is present in static builds #29741
    +0
    
22. [Bug]: The content of the testing module is pushed down when tests are run #29742
    +0
    
23. [Bug]: Testing module can get in a non-escapable state if runs are not completed #29650
    addon: test bug +2
    
24. [Bug]: Testing module's "fatal error" state isn't removed after a succesful run #29767
    +0
    
25. Document Component Testing changes in 8.5 #29794
    +0
    
26. [Bug] viteDefaultClientConditions should not be applied in Vite 5 projects #29799
    +0
    
27. Show sub-test provider toggle state in main testing module #30009
    +0
    

Expandable Scope

Preview Give feedback

1. [Bug]: Failing stories without 'dev' tag can't be seen in the sidebar #29653
   feature request +1
2. [Feature request]: Element highlighting in addon-interactions #25073
   addon: interactions feature request +2
   
3. [Bug]: Showing/hiding the context menu can cause the whole sidebar to reflow #29651
   sev:S4 +1
   
4. [Bug]: Vitest/Test Addon doesn't work if space in path #29572
   addon: test bug windows +3
5. [Bug]: Not able to run storybook 8.4.2 tests with vitest, compilation error with react-swc #29602
   addon: test bug +2
6. [Bug] SB Channel events are not doing anything in portable stories #29773
   bug portable stories sev:S3 +3
7. [Bug] Preview API hooks aren't behaving as expected in portable stories #29774
   bug portable stories sev:S3 +3
8. [Bug] manual setup required for addon annotations in portable stories #29780
   bug portable stories sev:S3 +3
9. [Bug] framework and addon preview annotations not automatically applied in portable stories #29781
   bug portable stories sev:S3 +3
10. [Bug] Storybook experimental features ignored in portable stories #29782
    bug portable stories sev:S3 +3
11. [Bug]: CSF Parsing error: Expected 'ObjectExpression' but found 'undefined' instead in 'Identifier' #29567
    bug csf sev:S3 +3
12. [Bug]: Play function results carry over from story to story when navigating #29575
    addon: test bug sev:S3 +3
13. [Bug] Vitest plugin does not detect custom vite config paths #29777
    bug portable stories sev:S4 +3
14. [Bug] internal dependencies unavailable in portable stories #29783
    bug portable stories sev:S4 +3

Needs Triage

Preview Give feedback

1. [Bug] revisit dependency optimization behavior #29812
   bug builder-vite performance issue portable stories +4
2. [Bug]: Storybook index crashes when directories match glob as stories #28954
   bug portable stories sev:S3 +3
3. Introduce portable stories support for HTML #28896
   feature request html portable stories +3
4. Introduce portable stories support for Preact #28898
   feature request portable stories preact +3
5. Introduce portable stories support for Web components #28891
   feature request portable stories web-components +3
6. Introduce portable stories support for Angular #28897
   angular feature request portable stories +3
7. Add Storybook to the Vitest Ecosystem CI
8. Tech debt: Combine TestManager and VitestManager
9. Support showing the sidebar context menu for root entries #30010
   addon: test feature request +2
10. Improve shown testing/running state on sidebar entries #30011
    +0
11. [Bug]: Focused Test results leak to global results #30028
    addon: test bug sev:S2 +3
    
12. [Bug]: Test suites cannot always be found by Vitest #30048
    addon: test bug +2
13. [Bug]: At the end of a test run, the description briefly flashes "Not run" #30053
    addon: test bug sev:S3 ui +4
14. Unhandled error message could be more helpful #30087
    addon: test feature request +2