News
Text and data mining | publisher policies
The Library subscribes to numerous full-text databases and journals. This article discusses everything you need to know about publishers' policies regarding text and data mining within these databases.
What is text and data mining?
Text mining, also text data mining (TDM), involves transforming unstructured text into a structured format to identify meaningful patterns and new insights. You can use text mining to analyse extensive collections of textual materials (scientific articles, eBooks, or datasets) to find key concepts, new insights, trends, and hidden relationships.
TDM options with WUR licenced resources
Text and data mining clauses are becoming more common in our licence agreements with publishers. However, the terms may vary between publishers. In general, text mining is allowed for non-commercial research. However, most publishers have guidelines and policies that govern the use of their databases by text-mining tools and set limits to the speed & volume of the data that can be downloaded, its storage and dissemination. These guidelines and policies must be followed.
When you use TDM within licensed databases you should consider several legal and ethical aspects.
- Always comply with copyright law and always check the publisher licences.
- You also have to protect sensitive and personal data under GPDR (Dutch AVG) and privacy regulations
- Always adhere to the principles of integrity and ethical handling of data.
Please note that access to the Library’s full-text databases can be revoked when the license terms and conditions are breached.
Which publishers allow TDM?
The following is a selection of publishers that permit TDM on their data.
Licenced databases | TDM allowed
Clarivate Analytics| Web of Science | Web of Science API's
- Elsevier | ScienceDirect | Text and data mining
- JSTOR | JSTOR | JSTOR text mining support
- Oxford University Press| OUP Journals | Legal policy Text and data mining
- Springer Nature | SpringerLink | Text and data mining policy
- Sage | Sage Journals | Text and data mining policy
- Taylor and Francis | T&F Journals | Text and data mining
- Wiley | Wiley Online Library | Text and data mining
Non-licenced & freely available databases | TDM allowed
- BioMedCentral | BioMedCentral | Access-to-data
- Crossref | Crossref Search | Text and data mining
- National Library of Medicine | PubMed | Tools
- OECD| OECD | API
- PLOS (Public Library of Science) | PLoS | Text and data mining
- World Bank |World Bank | Developer information overview
Questions?
If you have questions on text and data mining or if the resource you are interested in, is not listed here, please mail us at the Servicedesk Facilities.