Let the training dialogs email progress reports through viame monitor - #1900
Open
mattdawkins wants to merge 2 commits into
Open
Let the training dialogs email progress reports through viame monitor#1900mattdawkins wants to merge 2 commits into
mattdawkins wants to merge 2 commits into
Conversation
The desktop and web training dialogs gain an optional address field. It is passed to viame train as --monitor-email, which starts VIAME's training monitor next to the run to email start, error, epoch and completion reports. Mail delivery is configured on the training machine through VIAME_SMTP_SERVER and friends, so DIVE only carries the recipient. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01W1C4QY6hxjHaUPJfWPfQuu
Collaborator
|
For this I would rather have some standardized way that VIAME reports back progress (either throught a file, function or standarized stdout) that could then be used by desktop and web to report back progress. For Web we would then use the girder way for sending the email and for desktop we could present popup dialogs or other options. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an optional Email progress reports to field to the desktop and web training dialogs. The address is passed to
viame trainas--monitor-email, which starts VIAME's training monitor next to the run (VIAME/VIAME main 879c9a753 and later). The monitor emails a start message, validation statistics every few epochs, error/deadlock notices and a final finished/failed report, and keepstrain.logplus a status trail in the run's output directory.Mail delivery is configured on the training machine rather than in DIVE:
VIAME_SMTP_SERVER(andVIAME_SMTP_USER/VIAME_SMTP_PASSWORD) in the environment of DIVE Desktop or of the training worker, or a local sendmail on Linux. Without either the reports still go to the status trail. Documented in the training section of the pipeline docs.Changes:
Api.runTrainingtakes a trailing optionalmonitorEmail; the desktop job args and the server'sRunTrainingArgs/TrainingJobcarry it through.--monitor-emailwhen set.isValidEmailhelper validates the field in both dialogs; the train button stays disabled while the address is malformed.Verified with typecheck, lint and the client unit tests; the desktop path was exercised end to end against a local VIAME build with a debugging SMTP server.
🤖 Generated with Claude Code
https://claude.ai/code/session_01W1C4QY6hxjHaUPJfWPfQuu