Skip to content

Postprocessing#735

Merged
fbarreir merged 7 commits into
masterfrom
postprocessing
Jun 1, 2026
Merged

Postprocessing#735
fbarreir merged 7 commits into
masterfrom
postprocessing

Conversation

@fbarreir
Copy link
Copy Markdown
Contributor

@fbarreir fbarreir commented Jun 1, 2026

No description provided.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR improves clarity and maintainability of JEDI post-processing code by adding module/class/method docstrings and tightening inline comments, plus some light refactoring of variable naming and control flow in the post-processing daemon loop.

Changes:

  • Added descriptive docstrings to ATLAS production/analysis post-processors and the JEDI PostProcessor worker/threads.
  • Refactored PostProcessor.start() variable naming and loop structure for readability.
  • Clarified (and reworded) several inline comments around dataset handling, email notification, and task lifecycle steps.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 5 comments.

File Description
pandajedi/jedipprocess/AtlasProdPostProcessor.py Adds docstrings/comments describing production post-processing steps (with one doc step needing correction).
pandajedi/jedipprocess/AtlasAnalPostProcessor.py Adds docstrings/comments for analysis post-processing and email notification flow (with doc/inline-comment mismatches to fix).
pandajedi/jediorder/PostProcessor.py Adds module/class/method docstrings and refactors the daemon loop/worker code; introduces a real exception-handling hazard to fix.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines 81 to +83
except Exception:
errtype, errvalue = sys.exc_info()[:2]
tmpLog.error(f"failed in {self.__class__.__name__}.start() with {errtype.__name__} {errvalue}")
# sleep if needed
loopCycle = 60
timeDelta = naive_utcnow() - startTime
sleepPeriod = loopCycle - timeDelta.seconds
if sleepPeriod > 0:
time.sleep(sleepPeriod)
err_type, err_value = sys.exc_info()[:2]
tmp_log.error(f"failed in {self.__class__.__name__}.start() with {err_type.__name__} {err_value}")
Comment on lines +86 to +90
loop_cycle = 60
elapsed = naive_utcnow() - start_time
sleep_period = loop_cycle - elapsed.seconds
if sleep_period > 0:
time.sleep(sleep_period)
Comment thread pandajedi/jedipprocess/AtlasAnalPostProcessor.py Outdated
Comment thread pandajedi/jedipprocess/AtlasAnalPostProcessor.py Outdated
Comment thread pandajedi/jedipprocess/AtlasProdPostProcessor.py
fbarreir and others added 3 commits June 1, 2026 14:31
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@fbarreir fbarreir merged commit e05c6d4 into master Jun 1, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants