The JTLA promotes transparency in research by strongly encouraging authors to include full data sets, analytic and/or coding scripts, and relevant software whenever possible in order to facilitate replication studies and secondary analyses.
From our perspective, transparency in research aims to make the process of research – including data collection, coding, and analysis – clearly visible to all readers. While the peer-review process provides careful scrutiny of research as it is described in a manuscript, transparency in research provides readers full access to the data, methodology (including coding and analysis scripts), and, whenever possible, tools used in data analysis. The end goal is to make research as open, understandable, and clearly replicable as possible.
As JTLA encourages and supports authors in making their research transparent,
we anticipate that several challenges will arise. Some of these challenges may relate to:
- Protection of human subjects (e.g., extent to which data can be made available without infringing on the rights of subjects);
- Providing access to analytic tools (e.g., IRT software, SPSS, etc.)
that are copyrighted;
- Providing access to tests and testing tools that are copyrighted
or under development;
- Providing readers access to large data sets (e.g., TIMSS or NAEP)
used as part of a research study.
As the JTLA encounters issues such as these, the challenges, factors influencing decisions, and the ultimate decisions themselves will be fully documented on this page. Over time, we anticipate that this page will resemble a running record of the challenges and decisions made as we endeavor to promote transparency in research.