Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce chance of save-jobs.ipynb failing in CI #2386

Merged
merged 5 commits into from
Nov 26, 2024
Merged

Conversation

frankharkins
Copy link
Member

@frankharkins frankharkins commented Nov 25, 2024

The problem is service.jobs() by default only gets the past 10 jobs. Usually this is fine, but there's a chance the past 10 jobs we've submitted have all been cancelled or have failed.

This PR reduces the change of CI failing by increasing the number of jobs we collect. We can remove the limit by setting limit=None, but this takes too long to execute. I've picked 1000 as a compromise.


This is ready for review, but don't merge until after #2382 is merged. When that happens, I'll pull main and re-run this notebook to update it.

Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

Copy link
Collaborator

@Eric-Arellano Eric-Arellano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would 500 be reasonable? Idk how much of a difference it would make in performance

@frankharkins
Copy link
Member Author

frankharkins commented Nov 25, 2024

I actually didn't really notice much difference between 10 and 1000, just setting it to None took a long time (I never actually let it complete, just CTRL+C'd it). I could probably increase it more.

@Eric-Arellano
Copy link
Collaborator

Sg, 1000 makes sense then.

@frankharkins frankharkins added this pull request to the merge queue Nov 26, 2024
Merged via the queue into main with commit bc03c60 Nov 26, 2024
4 checks passed
@frankharkins frankharkins deleted the FH/save-jobs branch November 26, 2024 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

save-jobs notebook is failing to execute
2 participants