Skip to content

additional checks and data validation tools are included in the RDBES data upload process #231

Description

@luciazarauz

At the RCG TM 2025, the ISSG Overviews presented a smapling overviews summarizing the data uploaded in CS files, and highligthing some inconsistencies. The group recommended that additional checks and data validation tools are included in the RDBES data upload process, to prevent errors and suggested to post an issue in RDBES gitHub.
Here we present a proposal for these checks, but please, contact the ISSG if further details or clarifications are needed

  1. DEsampScheme: Don’t allow “National Routine”
  2. BVvalueMeas: validation rules depend on the variable BVtypeMeas. In the table below there is a proposal for basic checks
<style> </style>
Condition Type Basic checks
BVtypeMeas  = Age Integer  
BVtypeMeas = Maturity BVvalUnitScale  = SMSF String Code List: stages and substages. WKSMSF 2018 Maturity Scale. Table provided by WGBIOP is pesented below
BVtypeMeas = Sex String Code List: proposed M, F, T, U (for male, female, transitioning or undetermined)
BVtypeMeas = InfoGenetic String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = OtolithCollected String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = Stock String Code List (ices)
BVtypeMeas = ScaleCollected String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = InfoParasite String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = IlliciumCollected String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = InfoGonad String Code List: Y/N (https://vocab.ices.dk/?ref=316)
BVtypeMeas = SpecimenState   Not sure. Same as SAspecState? https://vocab.ices.dk/?ref=1668
BVtypeMeas = LengthTotal Integer The measured length in mm
BVtypeMeas = LengthPinched Integer The measured length in mm
BVtypeMeas = LengthCarapace Integer The measured length in mm
BVtypeMeas = LengthMantle Integer The measured length in mm
BVtypeMeas = WeightLive Integer The measured weight in g
BVtypeMeas = WeightGutted Integer The measured weight in g
BVtypeMeas = WeightMeasured Integer The measured weight in g
BVtypeMeas is not NA   BVvalueMeas cannot be NA

this is the table provided by WGBIOP for maturity scales:

<style> </style>
Stage Code Description
A. Immature    
B. Developing Ba Developing but functionally immature (first-time developer)
B. Developing Bb Developing and functionally mature
C. Spawning Ca Actively spawning
C. Spawning Cb Spawning capable
D. Regressing/Regenerating Da Regressing
D. Regressing/Regenerating Db Regenerating
E. Omitted spawning    
F. Abnormal    

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions