Update/cleanup and 2024

[jomatthi]

This PR documents the status of the code base used to derive the cut based top tagging WP and the templates/datacards for the SF presented in the proposed DP note.

The summary below has been produced by GitHub's copilot.
This pull request introduces significant updates across the configuration, calibration, and dataset management for the analysis framework, with a focus on supporting 2024 data, improving calibration logic, and enhancing dataset handling. The most notable changes include the addition of a new dataset configuration module, major improvements to the default calibration pipeline (including 2024-specific logic and more modular calibrators), and various configuration updates for file systems, job management, and resource sharing.

Key changes:

Calibration and Analysis Logic

• Major overhaul of topsf.calibration.default.py to support 2024 configurations:
  • Adds new derived calibrators for Puppi jets and subjets.
  • Implements conditional logic for calibration steps based on the data-taking year, including special handling for 2024.
  • Adds recalculation of muon pt using tuneP for highPt muons, improved logging, and dynamic inclusion of jet ID calibrators.
• Refines jet lepton cleaning in topsf.calibration.jets.py to clarify raw factor handling and improve code clarity. [1] [2]
• Updates tau32 category binning in topsf/config/categories.py for clearer naming and more flexible bin definitions.

Dataset Management

• Adds a new module topsf/config/datasets.py to load and register datasets from a YAML file, enabling more structured and scalable dataset configuration for different analysis campaigns.

Weights

• Refactors calculation and application of weights to be more flexible.

Configuration and Infrastructure

• Updates law.cfg:
  • Adds new modules and adjusts default datasets and modules for improved workflow.
  • Expands WLCG file system support and introduces new configuration blocks for DESY storage and caching.
  • Changes resource sharing defaults (e.g., enables htcondor_share_software).
  • Updates scheduler host and job file directory handling for better job management. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11]

Submodule Updates

• Updates the cmsdb and columnflow submodules to their latest commits.