Image for ReplicationWiki
Statistics (2019/07/16)
Pages: 16,678
Users: 241 (5 active)
Properties: 33
Categories: 3350
Templates: 27
Forms: 5
Wikiapiary: Link
Table of Contents

A database of empirical studies (so far mainly in economics), the availability of replication material for them and of replication studies. It can help teaching replication to students. Seminars at several faculties internationally were already taught for which the information of this database was used. In the starting phase the focus was on some leading journals in economics. Replication results can be published as replication working papers of the University of Göttingen's Center for Statistics. Teaching and providing access to information will raise awareness for the need for replications, provide a basis for research about the reasons why replications so often fail and how this can be changed, and educate future generations of scientists about how to make research replicable. The starting phase of this project was funded by the Institute for New Economic Thinking (INET).


Pageviews have increased very substantially to more than 5.9 million as of July 16, 2019, especially after the very widely used pages of the Research Papers in Economics (RePEc) service IDEAS link back to each article page of the wiki that links to an entry at their pages (cf. this example and check in their entry under "lists"). Several academic blogs and the media reported. The American Economic Association lists the wiki as useful resource for economists, the Economics Network recommends it for the teaching of econometrics, and several academic journals point their readers to it.[1] [2] [3] [4] It was presented at the Spring Meeting of Young Economists in Aarhus, 2013, the Economics Network conference in Exeter, 2013, the American Economic Association Annual Meeting in Philadelphia, 2014, the Annual Meeting of the French Economic Association in Lyon, 2014, the joined conference of the Econometric Society and the European Economic Association in Toulouse, 2014, the 2014 Research Transparency Forum of the Berkeley Initiative for Transparency in the Social Sciences, the 2015 National Conference on Teaching and Research in Economic Education (CTREE) in Minneapolis, USA, the Annual Meeting of the Austrian Economic Association (NOeG 2015), in Klagenfurt, the IACSEE Conference “Political and economic systems under challenge – assessing the role and potential of citizenship education” in July 2015 Göttingen, in the session on Replication in Economics during the American Economic Association Annual Meeting, 2016, in San Francisco, the RepScience2016 - 1st International Workshop on Reproducible Open Science, Hannover, Germany, 2016, the Statistical Week, Augsburg, Germany, 2016, the Beyond the Numbers Workshop, St Louis, USA, 2016, the 2017 American Economic Association Annual Meeting in Chicago, and the American Political Sciences Association Annual Meeting, Boston, USA, 2018.
Even though quite a number of researchers have registered, few participate actively. To change this we try to get more students involved and to further expand the database to let it cover a significant part of the empirical literature in economics and other social sciences.
We also need to fix some technical issues, e.g., with the forms we use so far only one replication can be entered for every original study but the most interesting studies get replicated more often. We can display this with a boilerplate but the code is too difficult to understand for most users. We plan to solve this with multiple instance templates and subobjects. There is also a bug with the placement of the slideshow on the main page. And searchability has to be improved significantly because the standard ask form is not user friendly. We are currently trying to get easily clickable properties on each page with category pages that show where else to find the same values like for methods and software used. This already works for authors and JEL codes. It still would not allow combined searches that are pivotal in order to find studies as researchers need it. That is why we are hoping for a cooperation with a software company that offers an improved search. We use the Community portal to keep track of plans for improvement.