Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[js/webgpu] Enable graph capture with memcpy and fix duplicated dispatch #22883

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

axinging
Copy link
Contributor

@axinging axinging commented Nov 19, 2024

With this change and #21363, whisper-tiny-decoder runs from ~80-100ms to ~60-63ms.

@axinging axinging marked this pull request as draft November 19, 2024 07:22
@axinging axinging changed the title [js/webgpu] Donot record with computePassEncoder when capturing [js/webgpu] Enable graph capture with memcpy Nov 19, 2024
@axinging axinging force-pushed the record_nit branch 5 times, most recently from bac23ea to 61f4de5 Compare November 26, 2024 01:40
@axinging axinging changed the title [js/webgpu] Enable graph capture with memcpy [js/webgpu] Enable graph capture with memcpy and fix duplicated dispatch Nov 26, 2024
@axinging axinging marked this pull request as ready for review November 26, 2024 02:36
@axinging
Copy link
Contributor Author

@xhcao @hujiajie @jchen10, PATL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant