<div dir="ltr">Dear all,<div><br></div><div>in regard of licensing I agree a bit with the reviewer that "requiring" CC0 to make a model public, will not foster publishing them in a reproducible and repeatable way. The reason for absence of a "a one for all" license is the different purposes, aims, and dependencies of a model. For example, if the model is calibrated against data that is licensed with a CC-BY-SA-ND-NC license, the model cannot be published under CC0.(?) </div><div><br></div><div>I suggest to state that </div><div><br></div><div>"</div><div><span style="background-color:rgb(255,255,0)">We therefore recommend that models and their associated data should be published under a Creative Commons license which provide a simple, standardized way to give permission to share and use creative work. For maximizing reproducibility and integration, we suggest that the most permissive licence possible should be chosen. In that regard the CC0 license would be the ideal choice (effectively waiving interests of the creator in their works and therefore emulating the public domain in jurisdictions where this is necessary. </span></div><div><span style="background-color:rgb(255,255,0)">"</span></div><div><span style="background-color:rgb(255,255,0)"><br></span></div><div><span style="background-color:rgb(255,255,255)">I have NOT yet incorporated this suggestion to the manuscript, as I am not leading the revision of that section. I really feel that being more flexible on the licensing issue is important. I hope that you can agree to my suggestion.</span></div><div><span style="background-color:rgb(255,255,255)"><br></span></div><div><span style="background-color:rgb(255,255,255)"><br></span></div><div><span style="background-color:rgb(255,255,255)">Kind regards</span></div><div><span style="background-color:rgb(255,255,255)">Alexander</span></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, 1 Jan 2022 at 13:25, William Waites <<a href="mailto:wwaites@ieee.org">wwaites@ieee.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I agree with Sheriff’s sentiment but find the voice confusing.<br>
For example, most of the authors of *this* paper were not<br>
involved in “our reproducibility study”. It is also unclear if<br>
“we decided to continue with CC0” refers to BioModels or the<br>
present paper.<br>
<br>
I would prefer an explanation from first principles with<br>
BioModels as a good example. Something like the text below.<br>
<br>
(Aside #1. I removed the word “sophisticated” from Sheriff’s<br>
text. Feel free to put it back. I’ve observed the pattern,<br>
particularly around the pandemic, of pointing to complicated<br>
models as better evidence of something than can be got with<br>
simpler models. As though being complicated is a virtue. This<br>
is more akin to the original meaning of the word sophisticated<br>
which is a scientific anti-pattern. That’s not what Sheriff<br>
meant, but I’d like to avoid using that word at all, especially<br>
in a context that suggests it’s something good.)<br>
<br>
(Aside #2. For software, I personally prefer copyleft licenses<br>
and not usually public domain. In the academic sphere this<br>
*should* not pose a problem because of the norm that says you<br>
have to make your code available otherwise the paper that <br>
crucially relies on it isn’t worth the bits it’s encoded in.<br>
However it’s not at all obvious that it’s enough to rely on<br>
good practice for this since there’s plenty of bad practice<br>
out there. There is some progress with journals and funders<br>
enforcing better practice. This is just an alternative mechanism<br>
to the legal jiu-jitsu of copyleft.)<br>
<br>
Best wishes for the new year,<br>
-w<br>
<br>
<br>
<br>
—<br>
<br>
There are practical and moral reasons why models should be<br>
freely available. To ensure a high standard of scientific<br>
work, it is important to be able to reproduce and verify<br>
results. This requires software and data for models to be<br>
freely available and that the barriers to running them <br>
be minimal. To facilitate scientific progress, it is<br>
ideal to be able to build upon the work of others. This<br>
requires not only that software and data are available but<br>
that reuse and modification is allowed. Finally, there is<br>
a moral argument that work produced using public funds <br>
should be publicly available. This concept is well embedded<br>
in some segments of the community, for example in the case<br>
of federally funded work in the United States, but we hold<br>
it as a general principle.<br>
<br>
Models are a combination of software and data. The legal <br>
treatment of these differs across jurisdictions with software<br>
generally subject to copyright law and data subject to database<br>
rights. This is not universal. The common denominator is the<br>
maximally permissive concept of “public domain” which exists<br>
in some jurisdictions where no restrictions are placed on use,<br>
reuse, modification and creation of derivative works, and, <br>
crucially, combination of multiple (possibly derivative) works<br>
into a new whole. However, the public domain does not exist<br>
as a concept in all jurisdictions and in others it is not<br>
possible to simply place a work in it. To solve this problem,<br>
the CC0 license (formulated with respect to copyright law<br>
and database rights) emulates the public domain in jurisdictions<br>
where this is necessary. We therefore recommend that models,<br>
and their associated data are published under CC0 terms.<br>
<br>
An example of this approach is the BioModels database. BioModels provides model curation and annotation service, where the models’<br>
reproducibility is assessed and annotated with controlled<br>
vocabularies. BioModels aims to make models discoverable. The <br>
BioModels database offers search engines to search and locate<br>
models and model components (<a href="https://www.ebi.ac.uk/biomodels/parameterSearch" rel="noreferrer" target="_blank">https://www.ebi.ac.uk/biomodels/parameterSearch</a>). The BioModels<br>
reproducibility study ( Tiwari et al. 2021,<br>
<a href="https://doi.org/10.15252/msb.20209982" rel="noreferrer" target="_blank">https://doi.org/10.15252/msb.20209982</a>), strongly recommends<br>
that authors make their models public, but more specifically <br>
through public repositories such as BioModels (<a href="https://www.ebi.ac.uk/biomodels" rel="noreferrer" target="_blank">https://www.ebi.ac.uk/biomodels</a>).<br>
We also recommend that authors submit model codes, parameter sets,<br>
and simulation conditions needed to reproduce simulation<br>
studies. Overall this will greatly facilitate model reuse.<br>
<br>
We further recommend that models published in this way should<br>
not require proprietary software or resources in order to be<br>
used. Requiring such resources greatly hampers reproducibility, verification and reuse. To achieve these goals, such <br>
dependencies typically require rewriting the models ab initio<br>
with the original model code serving the much less useful <br>
(but still not worthless) function of documentation. While<br>
there are benefits to reformulating existing models — a <br>
reimplementation might be more efficient or clearer and more<br>
elegant — a hard requirement to do so in all cases simply<br>
leads to wasted resources.<br>
<br>
_______________________________________________<br>
Vp-reproduce-subgroup mailing list<br>
<a href="mailto:Vp-reproduce-subgroup@lists.simtk.org" target="_blank">Vp-reproduce-subgroup@lists.simtk.org</a><br>
<a href="https://lists.simtk.org/mailman/listinfo/vp-reproduce-subgroup" rel="noreferrer" target="_blank">https://lists.simtk.org/mailman/listinfo/vp-reproduce-subgroup</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div style="font-family:sans-serif;font-size:13px;white-space:pre-wrap;padding:2px 0px 2px 13px;color:rgb(54,57,79)"><div style="font-stretch:normal;line-height:normal;white-space:normal;padding:2px 0px;color:rgb(35,35,73)">Alexander Kulesza</div><div style="font-stretch:normal;font-size:11px;line-height:normal;white-space:normal;padding:2px 0px;color:rgb(52,70,115)">Team leader</div><div style="font-stretch:normal;font-size:11px;line-height:normal;white-space:normal;padding:2px 0px;color:rgb(82,135,189)">Modeling & simulation / Biomodeling</div><div style="font-stretch:normal;font-size:11px;line-height:normal;white-space:normal;padding:2px 0px;color:rgb(128,134,150)"><a href="mailto:alexander.kulesza@novadiscovery.com" style="color:rgb(128,134,150)" target="_blank">alexander.kulesza@novadiscovery.com</a></div><div style="font-stretch:normal;font-size:11px;line-height:normal;white-space:normal;padding:2px 0px;color:rgb(128,134,150)">+33 7 82 92 44 62</div><div style="white-space:normal;width:100px;margin:15px 0px;font-size:28px;color:rgb(35,35,73)"><div style="font-family:Montserrat,arial;font-weight:600;letter-spacing:-1px">nova</div><div style="font-size:9px">DISCOVERY</div></div><div style="color:rgb(51,51,51);font-stretch:normal;font-size:11px;line-height:normal;white-space:normal;padding:2px 0px;margin:0px"><a href="http://www.novadiscovery.com/" title="Visit our website" style="color:rgb(128,134,150)" target="_blank">www.novadiscovery.com</a></div><div style="font-stretch:normal;font-size:11px;line-height:normal;white-space:normal;padding:2px 0px;color:rgb(128,134,150)">1 Place Verrazzano, 69009 Lyon<br>+33 9 72 53 13 01</div></div></div></div>
<br>
<i style="color:rgb(187,187,187);font-family:sans-serif;font-size:10px;text-align:justify">This message is intended only for the personal and confidential use of the designated recipient(s) named above. If you are not the intended recipient of this message you are hereby notified that any review, dissemination, distribution or copying of this message is strictly prohibited. Email transmission cannot be guaranteed to be secure or error-free. Therefore, we do not represent that this information is complete or accurate and it should not be relied upon as such. All information is subject to change without notice.</i>