Data validation: Difference between revisions

From Biolovision Help
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:
<!--In such system, data quality is important!
Entering a wrong species, choosing the wrong line in the list, confusing some species that are very similar, having an exceptionnal observation that needs more information, that happens.
To ensure quality of the data, we have two systems to validate it on areas where a local portal exist only.
NB: For NaturaList, the filter occurs only when the data is synchronised, not before:
-Automatic filter
Locally set by administrator of the Local portal. If an observation is done outside the limits set, a yellow or blue mark is automatically set.
The observer receives an automatic e-mail to notice him/her.
-Manual filter:
Many validators work to enhance the data quality. If one of them sees something that needs to be verified, he will put manually a yellow or blue mark.
The observer receives an automatic or personallised e-mail to notice him/her.
Please consider the work of validators and stay polite and human when answering!
After verification, or the species is approved and the mark is removed, or the observation is rejected and a red mark is set. You can delete the data or keep it only for you and the mark will stay and indicates that others do not see it.<br/>
</br>
<center>
<table border="1" width="75%" ;>
<tr style="padding: 25px; text-align: center; font-family: sans serif; color: black; background-color: LightGray">
<th></th>
<th>Automatic filter</th>
<th>Manual filter</th>
<th>Visible to other users</th>
<th>Action needed</th>
</tr>
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white; border=">
<td>[[File:Capture 2022-12-12 at 20.20.19.png|650px|frameless|center]]</td>
<td style="color:green">YES</td>
<td style="color:green">YES</td>
<td style="color:green">YES</td>
<td style="color:green">YES</td>
</tr>
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white;">
<td>[[File:Capture 2022-12-12 at 20.20.27.png|700px|frameless|center]]</td>
<td style="color:green">YES</td>
<td style="color:green">YES</td>
<td style="color:red">NO<sup>1</sup></td>
<td style="color:green">YES</td>
</tr>
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white;">
<td>[[File:Capture 2022-12-12 at 20.20.38.png|700px|frameless|center]]</td>
<td style="color:red">NO</td>
<td style="color:green">YES</td>
<td style="color:red">NO<sup>1</sup></td>
<td style="color:red">NO</td>
</tr>
</table>
</center>
<p style="margin-left: 120px; font-size:10pt">
<sup>1</sup> Visible to observer and administrators.<br/><br/>
<br/>
<br/>
<center>
<table border="1" width="70%" ;>
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white; border=">
<td>[[File:Capture 2022-12-12 at 20.20.19.png|650px|frameless|center]]</td>
<td>Automatic filter, differs from one area to another.<br />
Manual filter when there is an incongruency of data (ex. name and picture do not match).<br />
Visible to all users.</td>
</tr>
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white; border=">
<td>[[File:Capture 2022-12-12 at 20.20.27.png|700px|frameless|center]]</td>
<td>Requires additional information. <br />
Visible to observer and administrators only. </td>
</tr>
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white;">
<td>[[File:Capture 2022-12-12 at 20.20.38.png|700px|frameless|center]]</td>
<td>Invalid data. It will not be used. <br />
Visible only to observer.</td>
</tr>
</table>
</center>
<br/>
<br/>
If you submit an exceptional record, the rarity module will automatically open asking you for more details. This form will help the local rarities comittee to validate or invalidate or reject your observation. You can learn more about the rarity module at Various > [[Modules#Rarity_Comitee_(RC)_Module| Rarity Committee Module]].-->
<br/>
<br/>


Line 185: Line 82:
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white;">
<tr style="padding: 25px; text-align: center; font-family: sans-serif; color: black; background-color: white;">
<td>[[File:Capture 2023-03-02 at 14.51.33.png|700px|frameless|center]]</td>
<td>[[File:Capture 2023-03-02 at 14.51.33.png|700px|frameless|center]]</td>
<td style="color:red">YES</td>
<td style="color:green">YES</td>
<td style="color:green">YES</td>
<td style="color:red">YES</td>
<td style="color:green">YES</td>
<td style="color:red">YES<sup>2</sup></td>
<td style="color:green">YES</td>
<td style="color:green">YES<sup>2</sup></td>
</tr>
</tr>



Revision as of 17:00, 6 March 2023


Errors may occur when typing or identifying species. On occasions, exceptional observations may take place. To ensure the quality of the data in our systems, validation filters are applied when observers submit data. These, search for exceptional data in areas covered by a local portal, and may ask observers to provide more details in order to validate or reject the observation:

  • Automatic validation

Filter locally set by administrators of the Local portal covering the area the observation takes place at. When an observation falls outside the parameters determined by the local administrators, a yellow or blue mark is automatically displayed next to the observation (see table below for meaning of markings). The observer then receives an automatic e-mail to inform them.

Blue dot: informs caution to other users. There is possibly a mistake in the data (ie. wrong species, or the species is not particularly rare but is often seen at a different altitude or environment).
Yellow dot: the observation is probably correct but details need to be confirmed (ie. the species is in the right place, but the number of individuals is uncommon, or the hour the observation took place seems unusual).
Red dot: the observation has 'been rejected. It means that even if your observation is right, you did not provide enough proof to validate it and it cannot be included in the statistics.


  • Manual validation:

The yellow or blue mark indicating the observation is either incorrect or requires more information, is displayed manually by an authorised validator. The observer can receive either an automatic or a personalised e-mail informing them.

If you see a marking next to any of your observations, please do check the spam folder if you did not receive an email informing you -your email provider may have filtered the message. Reply to the email and/or correct as requested. Validators will see your corrections and decide if your data is accepted or rejected.
Please, consider the valuable work of validators and stay polite. To become a validator or know more about it, please refer to the local portal the data are linked to.

    NOTE:
    • When data is submitted through NaturaList, filters apply at synchronisation.
    • Data submitted from areas with no local partner is not validated.



Automatic filter Manual filter Visible to other users Action needed
Capture 2022-12-12 at 20.20.19.png
YES YES YES YES
Capture 2022-12-12 at 20.20.27.png
YES YES NO1 YES
Capture 2022-12-12 at 20.20.38.png
NO YES NO1 NO
Capture 2023-03-02 at 14.51.33.png
YES YES YES YES2

1 Visible to observer and administrators.
2 Opens Rarity Committee Module.


After verification, an observation may be:

-Accepted: all markings disappear.
-Rejected: the yellow or blue marking associated to an observation becomes red. The observation remains at the observer’s list of observations but is invisible to other users.


Homologation by the Rarity Committee


Besides the usual validating process, some exceptional observations may be sent to the local rarities committee for homologation. When this is the case, a module will open asking for additional details. See more about the Rarity Committee Module at Web interface > Modules > Rarity Committee Module.

A Rarity Committee is an independent group of ornithologist evaluating if uncommon observations could be considered for scientific purposes. They are normally concerned about the area and time of the year the observation takes place, and data of first breeding.

See all rarity committees in Europe at www.aerc.eu.