{"id":3756,"date":"2019-08-23T09:00:19","date_gmt":"2019-08-23T07:00:19","guid":{"rendered":"https:\/\/ist.blogs.inra.fr\/afs\/?p=3756"},"modified":"2019-08-22T10:32:25","modified_gmt":"2019-08-22T08:32:25","slug":"guidelines-for-reviewers-how-to-review-a-data-paper","status":"publish","type":"post","link":"https:\/\/ist.blogs.inrae.fr\/afs\/2019\/08\/23\/guidelines-for-reviewers-how-to-review-a-data-paper\/","title":{"rendered":"Guidelines for reviewers: How to review a data paper?"},"content":{"rendered":"<script type='text\/javascript' src='https:\/\/d1bxh8uas1mnw7.cloudfront.net\/assets\/embed.js'><\/script><p><a href=\"https:\/\/ist.blogs.inra.fr\/afs\/wp-content\/uploads\/sites\/5\/2015\/11\/AFS-DataPapers2015-light_Page_2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-thumbnail wp-image-1553\" src=\"https:\/\/ist.blogs.inra.fr\/afs\/wp-content\/uploads\/sites\/5\/2015\/11\/AFS-DataPapers2015-light_Page_2-150x150.jpg\" alt=\"AFS-DataPapers2015-light_Page_2\" width=\"150\" height=\"150\" srcset=\"https:\/\/ist.blogs.inrae.fr\/afs\/wp-content\/uploads\/sites\/5\/2015\/11\/AFS-DataPapers2015-light_Page_2-150x150.jpg 150w, https:\/\/ist.blogs.inrae.fr\/afs\/wp-content\/uploads\/sites\/5\/2015\/11\/AFS-DataPapers2015-light_Page_2-50x50.jpg 50w\" sizes=\"auto, (max-width: 150px) 100vw, 150px\" \/><\/a><\/p>\n<p>Data papers aim at describing a dataset made available to a larger community. Data papers are a scientific valuable production and should provide all required information for a large use of the data. The data paper should be completed by a metadata file that describes the dataset, and by the dataset itself, made available in an open repository.<\/p>\n<p>Reviewers will carefully consider: <em>(a)<\/em> the quality of the manuscript, <em>(b) <\/em>the quality, completeness and reusability of the dataset, and <em>(c) <\/em>the relevance of the dataset and its potential contribution to the progress of science.<\/p>\n<p>They will not review the whole data set, whose quality is under the responsibility of the authors (see our related blog post \u201c<em><a href=\"https:\/\/ist.blogs.inra.fr\/afs\/2019\/07\/24\/guidelines-for-authors-how-to-share-your-datasets\/\">Guidelines for authors: how to share your datasets?<\/a>\u201d<\/em>).<\/p>\n<p>&nbsp;<\/p>\n<h4><b><span style=\"color: #008000\">Quality of the manuscript<\/span> <\/b><\/h4>\n<p>Usual criteria for assessing manuscript quality including style, consistency, clarity. The review will address following questions:<\/p>\n<ul>\n<li>Is a <strong>DOI<\/strong> provided for the database and is the dataset accessible via the given identifier?<\/li>\n<li>Is the <strong>metadata<\/strong> template filled out as recommended?<\/li>\n<li>Do <strong>title<\/strong> and <strong>key message<\/strong> accurately reflect the content of the data paper?<\/li>\n<li>Is the Data Paper internally <strong>consistent<\/strong>, suitably <strong>organized<\/strong> and written in proper English?<\/li>\n<li>Are relevant <strong>non-textual media<\/strong> (e.g. tables, figures) appropriate?<\/li>\n<li>Have <strong>abbreviations<\/strong> and <strong>symbols<\/strong> been properly defined?<\/li>\n<li>Is the <strong>context<\/strong> of prior research properly described, citing relevant articles and datasets?<\/li>\n<\/ul>\n<h4><span style=\"color: #008000\"><b>Quality<\/b><b> of the <\/b><b>dataset<\/b><br \/>\n<\/span><\/h4>\n<p>Although publication of a data paper does not guarantee the overall quality of the dataset, there is a need to check whether suitable and reproducible methods have been used to obtain the data, and whether the data are displayed in a sensible way. The dataset must be a long-term resource, stable, complete, permanent and of good quality. The review will address following questions:<\/p>\n<ul>\n<li>Are the data <strong>logically<\/strong> and <strong>consistently<\/strong> organised? Are they easily <strong>readable<\/strong> and <strong>usable<\/strong>?<\/li>\n<li>Is anything missing in the manuscript or the data resource itself that would prevent <strong>replication <\/strong>of the measurements, <strong>reproduction<\/strong> of the figures or other representations?<\/li>\n<li>Are the <strong>methods<\/strong> used to generate the data (including calibration, code and suitable controls) described in <strong>sufficient detail<\/strong> and suitable to maintain of integrity of the dataset?<\/li>\n<li>Have possible <strong>sources of error<\/strong> (including methods, calculation and interpretation) been appropriately addressed in the protocols and\/ or the paper?<\/li>\n<li>Are the data consistent internally and described using <strong>applicable standards<\/strong> (e.g. in terms of file formats, file names, file size, units and metadata)?<\/li>\n<li>Does the manuscript provide an accurate description of the data? And how to <strong>access<\/strong> them (e.g. link and\/or data access policy)?<\/li>\n<li>Are the<strong> methods<\/strong> used to process and analyse the raw data <strong>appropriate<\/strong>? Are they sufficiently well documented that they could be <strong>repeated<\/strong> by third parties? Accepted formats are: 1) datasets, deposited additionally to scientific datasets in the repository; 2) links to online published papers; 3) a section in the body of the manuscript dedicated to material and method.<\/li>\n<li>Are the data files complete and match the description in the <strong>Metadata<\/strong>?<\/li>\n<\/ul>\n<h4><b><span style=\"color: #008000\">Utility and contribution of data set<\/span><\/b><\/h4>\n<ul>\n<li>Does the data resource cover a scientifically important region(s), time period(s) and\/or group(s) of taxa to be worthy of a <strong>separate publication<\/strong>?<\/li>\n<li>Is the dataset sufficiently <strong>original <\/strong>to merit publication as a data paper?<\/li>\n<li>Is there any potential of the data being <strong>useful<\/strong> in the future?<\/li>\n<li>Are the <strong>use cases<\/strong> described in the data paper consistent with the data presented? Would other possible use cases merit comments in the paper?<\/li>\n<li>Are all <strong>conclusions <\/strong>made in the data paper substantiated by the underlying data?<\/li>\n<li>Are the<strong> depth<\/strong>, <strong>coverage<\/strong>, <strong>size<\/strong>, and\/or <strong>completeness <\/strong>of the data sufficient for the types of application or research questions outlined by the authors?<\/li>\n<\/ul>\n<hr \/>\n<p>Contact us for more information at <a href=\"mailto:annforsci@inra.fr\">annforsci@inra.fr<\/a><\/p>\n<p>Read the related posts on our blogs:<\/p>\n<p><a href=\"https:\/\/ist.blogs.inra.fr\/afs\/2019\/07\/18\/annals-of-forest-science-promotes-open-science-by-publishing-data-papers\/\"><em>Annals of Forest Science promotes Open Science by publishing data papers<\/em><\/a><\/p>\n<p><a href=\"https:\/\/ist.blogs.inra.fr\/afs\/2019\/07\/24\/guidelines-for-authors-how-to-share-your-datasets\/\"><em>Guidelines for authors: how to share your datasets?<\/em><\/a><\/p>\n<p><a href=\"https:\/\/ist.blogs.inra.fr\/afs\/2015\/11\/20\/publishing-data-papers-in-annals-of-forest-science-detailed-guidelines-for-a-smooth-preparation-and-submission\/\"><em>Publishing data papers in Annals of forest science: detailed guidelines for a smooth preparation and submission<\/em><\/a><\/p>\n<p class=\"title single-title\">\n","protected":false},"excerpt":{"rendered":"<p>Data papers aim at describing a dataset made available to a larger community. Data papers are a scientific valuable production and should provide all required information for a large use of the data. The data paper should be completed by a metadata file that describes the dataset, and by the dataset itself, made available in [&hellip;]<\/p>\n","protected":false},"author":106,"featured_media":1552,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,6,42],"tags":[],"class_list":["post-3756","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-editorial-board-2","category-posts-edited-by-editors","category-for-referees","cat-3-id","cat-6-id","cat-42-id","has_thumb"],"_links":{"self":[{"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/posts\/3756","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/users\/106"}],"replies":[{"embeddable":true,"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/comments?post=3756"}],"version-history":[{"count":0,"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/posts\/3756\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/media\/1552"}],"wp:attachment":[{"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/media?parent=3756"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/categories?post=3756"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ist.blogs.inrae.fr\/afs\/wp-json\/wp\/v2\/tags?post=3756"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}