Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
425c48e
Create 30_near_real_time_qc_process.md
yingniu Feb 17, 2026
bf8b557
Update 30_near_real_time_qc_process.md
yingniu Feb 17, 2026
bf765f4
add info re: NRT data & sources
ianjonsen Feb 18, 2026
9444142
Add QC for NRT data info
ianjonsen Feb 19, 2026
76b5753
Added ArgosQC workflow details;
ianjonsen Feb 19, 2026
804bef7
update to config setup etc
ianjonsen Feb 20, 2026
1a092fd
Update 30_near_real_time_qc_process.md
jdpye Feb 20, 2026
4679af5
How to set up a config file for WC tags - partial update
ianjonsen Feb 25, 2026
6f814c2
WC config setup How To
ianjonsen Feb 25, 2026
24bb44f
full WC config How to
ianjonsen Feb 26, 2026
141e475
tweak
ianjonsen Feb 26, 2026
039eeed
tweak
ianjonsen Mar 19, 2026
b704790
spelling, etc edits
ianjonsen Mar 19, 2026
8de99a7
addressed comments 1, 3, 4 from Glasgray
ianjonsen Mar 19, 2026
bee72fc
add a separate How To addressing Jon's PR comment
ianjonsen Mar 19, 2026
704cad2
rename lesson & add Ying's notebook title
ianjonsen Mar 20, 2026
d8ae60b
add SMRU NRT QC how To
ianjonsen Mar 27, 2026
1034fc8
SMRU How To complete
ianjonsen Apr 1, 2026
ff63c42
WC How To complete
ianjonsen Apr 1, 2026
cac5c12
added SMRU details to 30_near_real...
ianjonsen Apr 1, 2026
7179fcc
typo
ianjonsen Apr 1, 2026
4811a40
Add files via upload
yingniu Jul 7, 2026
c14654a
Add files via upload
yingniu Jul 7, 2026
e85df67
Add files via upload
yingniu Jul 7, 2026
f712505
Add files via upload
yingniu Jul 7, 2026
6e44f25
Add files via upload
yingniu Jul 7, 2026
f84935f
Delete fig/smru_config_harvest.png
yingniu Jul 7, 2026
bad7e04
Add files via upload
yingniu Jul 7, 2026
e712d66
Delete fig/smru_config_harvest.png
yingniu Jul 7, 2026
d900226
Add files via upload
yingniu Jul 7, 2026
29ad502
Delete fig/smru_config_harvest.png
yingniu Jul 7, 2026
c6011bc
Add files via upload
yingniu Jul 7, 2026
b5a5736
Delete fig/smru_config_harvest.png
yingniu Jul 7, 2026
6e90195
Add files via upload
yingniu Jul 7, 2026
ad50f31
Delete fig/wc_config_model_params.png
yingniu Jul 7, 2026
ca62d95
Add files via upload
yingniu Jul 7, 2026
3d6de05
Delete fig/wc_config_model_params.png
yingniu Jul 7, 2026
315a35c
Add files via upload
yingniu Jul 7, 2026
0df5e85
Add files via upload
yingniu Jul 7, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
322 changes: 322 additions & 0 deletions _episodes/30_near_real_time_qc_process.md

Large diffs are not rendered by default.

46 changes: 46 additions & 0 deletions _episodes/31_near_real_time_qc_how_to_WildlifeComputers.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
---
title: "Near Real Time (NRT) Animal Tagging Location Data Quality Control (QC) Process: Wildlife Computers"
teaching: 120
exercises: 0
questions:
- "How to receive metadata & data access from a researcher to set up satellite data harvesting"
- "How to use the metadata to create a config file"
- "How to push that config file somewhere so it can be processed regularly by the RT process"
- "How to process a dataset that is no longer real-time - delayed-mode"
---


## How to receive metadata & data access from a researcher to set up satellite data harvesting for Wildlife Computers tags
### Metadata
The minimum metadata required by the QC process is:

1. species common name.
2. species scientific name.
3. release site (e.g., Sable Island).
4. release country.
5. tag serial number(s) and PTT ID(s).

Use whatever method for obtaining these metadata from the researcher works for you.

### Data access
Ensure you have a Wildlife Computers (WC) Portal account & a security key pair set up (see 30_near_time_qc_process). Ask the researcher to setup sharing for their tag datasets via the WC Portal. The data owner(s) will need the email address the node manager used for their WC Portal user account. If the researcher does not know how to do this, refer them to the information on p. 19 in [document (p 19)](https://static.wildlifecomputers.com/Portal-and-Tag-Agent-User-Guide-2.pdf).

Once data sharing is setup, within R you can verify access to the researcher's data via the WC Portal API using the ArgosQC utility function `wc_get_collab_ids`:
```
ArgosQC:::wc_get_collab_ids((a.key = "...", s.key = "...")
```
Where the `a.key` and `s.key` values are your WC access and secret key pair. Executing this function with R returns a data.frame of all data owners' (collaborators) ID's and email addresses who have set up data sharing with the node manager:
![](../fig/wc_owner.ids.png){width=300}

If this function does not return a data.frame (or results in an error) then data sharing has not been setup correctly in the WC Portal and you will need to troubleshoot with the researcher.

## How to use the metadata to create a config file
All details for constructing `ArgosQC` config files are in this [Jupyter notebook](https://github.com/ocean-tracking-network/rt-sat-to-obis/blob/add_conda_env/ArgosQC_WildlifeComputers_Project_Config.ipynb).

## How to push that config file somewhere so it can be processed regularly by the RT process
Details on how to do this are in this [Jupyter notebook](https://github.com/ocean-tracking-network/rt-sat-to-obis/blob/add_conda_env/ArgosQC_WildlifeComputers_Project_Config.ipynb).

## How to process a dataset that is no longer real-time - delayed-mode
Tag datasets that are no longer real-time (deployments have ended) may be processed in the same manner as real-time datasets, except that the QC process only needs to be run once.


38 changes: 38 additions & 0 deletions _episodes/32_near_real_time_qc_how_to_SMRU.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
---
title: "Near Real Time (NRT) Animal Tagging Location Data Quality Control (QC) Process: SMRU"
teaching: 120
exercises: 0
questions:
- "How to receive metadata & data access from a researcher to set up satellite data harvesting"
- "How to use the metadata to create a config file"
- "How to push that config file somewhere so it can be processed regularly by the RT process"
- "How to process a dataset that is no longer real-time - delayed-mode"
---


## How to receive metadata & data access from a researcher to set up satellite data harvesting for SMRU tags
### Metadata
The minimum metadata required by the QC process is:

1. species common name.
2. species scientific name.
3. release site (e.g., Sable Island).
4. release country.
5. SMRU campaign id(s) (e.g., ct190).

Use whatever method for obtaining these metadata from the researcher works for you.

### Data access
Ensure you have the researcher's username and password to access the data on the [SMRU server](https://www.smru.st-andrews.ac.uk/protected/technical.html). The server page is accessible to anyone to view SMRU tag deployments by registered project, but access to data within individual deployment "campaigns" are behind a WAF.

Once you have the researcher's username and password, these can be entered in the config file `harvest` block.

## How to use the metadata to create a config file
All details for constructing `ArgosQC` config files are in this [Jupyter notebook](https://github.com/ocean-tracking-network/rt-sat-to-obis/blob/add_conda_env/ArgosQC_SMRU_Project_Config.ipynb)

## How to push that config file somewhere so it can be processed regularly by the RT process
Details on how to do this are in this [Jupyter notebook](https://github.com/ocean-tracking-network/rt-sat-to-obis/blob/add_conda_env/ArgosQC_SMRU_Project_Config.ipynb)

## How to process a dataset that is no longer real-time - delayed-mode
Tag datasets that are no longer real-time (deployments have ended) may be processed in the same manner as real-time datasets, except that the QC process only needs to be run once.

Binary file added fig/smru_config_harvest.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/smru_server.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_config_akey_skey.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_config_model_params.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_config_owner.id.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_config_tag.list.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_dataset_uuids.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_owner.ids.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_portal_account_settings.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_portal_create_account.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_portal_login.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_portal_security_keypair.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_qc_lat_ssmfit.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_qc_map1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_qc_map12.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_qc_map3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_qc_map6.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_qc_map_reroute.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added fig/wc_tag.list.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.