An international, multi-stakeholder survey about metadata awareness, knowledge, and use in scholarly communications
One of the goals of Metadata 20/20’s Research Communications Committee was to figure out how to engage and motivate researchers to invest in the metadata supporting scholarly outputs. Early on, the committee discovered that researchers are difficult to engage because they are a diverse and busy audience, and because metadata requirements are as varied as the panoply of research fields in the current scholarly communications landscape.
With this challenge facing the committee, the group decided to take a different approach to understanding researchers. Publishers, librarians, and data repository managers each interact with researchers and work with metadata. If the researchers are hard to pin down, why not approach the infrastructure around the researchers to study perceptions of metadata encountered by researchers?
This approach proved fruitful enough to produce a viable dataset about the perceptions and use of metadata in scholarly communications. Researchers were represented in the study, as were publishers, librarians, and repository managers. A survey to each of these groups produced results that confirmed known information: librarians, publishers, and repository managers on the whole know more about metadata than researchers. It also produced surprises: researchers and repository managers are more closely aligned in metadata needs than librarians and publishers. The gap between researchers and either librarians or publishers is worth studying further. Maybe lamentations about a lack of researcher investment by librarians and publishers is due in part to librarians and publishers??
The full analysis and data sets of this work are now published and Metadata 20/20 hopes that they will provide a starting point to improve the metadata landscape in scholarly communications.
Background: The Metadata 20/20 initiative is an ongoing effort to bring various scholarly communications stakeholder groups together to promote principles and standards of practice to improve the quality of metadata. To understand the perspectives and practices regarding metadata of the main stakeholder groups (librarians, publishers, researchers and repository managers), we conducted a survey during summer 2019. The survey content was generated by representatives from the stakeholder groups.
Methods: A link to an online survey (17 or 18 questions depending on the group) was distributed through multiple social media, listserv, and blog outlets. Responses were anonymous, with an optional entry for names and email addresses for those who were willing to be contacted later.
Results: Complete responses (N=211; 87 librarians, 27 publishers, 48 repository managers, and 49 researchers) representing 23 countries on four continents were analyzed and summarized for thematic content and ranking of awareness and practices.
Conclusions: Across the stakeholder groups, the level of awareness and usage of metadata methods and practices was highly variable. Clear gaps across the groups point to the need for consolidation of schema and practices, as well as broad educational efforts in order to increase knowledge and implementation of metadata in scholarly communications.
The following outputs resulted from this study:
|Analysis of the data collected during the 2019 survey. Each stakeholder group is analyzed separately and cross-stakeholder themes and insights are shared. The paper concludes with recommended areas for future study.|
|Kathryn A. Kaiser, Michelle Urberg, Maria Johnsson, Jennifer Kemp, Alice Meadows, Laura Paglione (2021). An international, multi-stakeholder survey about metadata awareness, knowledge, and use in scholarly communications. Quantitative Science Studies. https://doi.org/10.1162/qss_a_00133|
Key Librarian Themes
Key Publisher Themes
Key Repository Manager Themes
Key Researcher Themes
|This appendix represents an analyzed data set of the raw data collected for the Metadata 20/20 survey. The purpose of the data summary is to draw attention to the unique responses of each stakeholder group. The authors of this article jointly analyzed and developed this analysis.|
|Kaiser, K., Urberg, M., Johnsson, M., Kemp, J., Meadows, A., & Paglione, L. (2021). Metadata 2020 metadata usage survey methods and results summary (Version 0.1.0). Zenodo. https://doi.org/10.5281/zenodo.4666086|
|This document records the finalized version of the survey that was distributed, following IRB approval, to a broad number of communities. The questions were answered by participants self-identifying as researchers, publishers, librarians, and repository managers. The purpose of these questions was to assess how metadata is understood by stakeholders in the scholarly communications life cycle. To the designers’ best knowledge, no other survey had previously attempted to analyze knowledge about, and perceptions of metadata associated with publication. The survey was conceived as a primary output by the Metadata 20/20 Researcher Communications Project and the survey instrument was developed with the assistance of stakeholder groups active in Metadata 20/20.|
|Metadata 2020, Kaiser, K., Urberg, M., Johnsson, M., Kemp, J., Meadows, A., & Paglione, L. (2021). Metadata 2020 metadata usage survey questions (Version 0.1.0). Zenodo. https://doi.org/10.5281/zenodo.4666192|
|This document contains the Excel spreadsheet with all of the raw, unanalyzed responses to the Metadata 20/20 Survey. Each stakeholder group is represented with its own tab. In addition, one tab contains all of the responses, another the demographics for the survey. The responses in these tabs may include incomplete responses. Two other tabs contain comparisons of how each stakeholder group has self-prioritized metadata fields and metadata schema, which are discussed in this paper further. The responses from each of the stakeholder groups consists of 87 librarians, 27 publishers, 48 repository managers, and 49 researchers from 23 countries.|
|Paglione, L., Kaiser, K., Urberg, M., Johnsson, M., Kemp, J., & Meadows, A. (2021). Data from: An international, multi-stakeholder survey about metadata awareness, knowledge, and use in scholarly communications [Excel spreadsheet]. Dryad, Dataset. https://doi.org/10.5061/dryad.4f4qrfj8s|