Volume index - Journal index - Article index - Map ---- Back


Comunicar Journal 54: Shared Science and Knowledge. Open Access, Technology and Education (Vol. 26 - 2018)

Co-creation and open innovation: Systematic literature review

https://doi.org/10.3916/C54-2018-01

María-Soledad Ramírez-Montoya

Francisco-José García-Peñalvo

Abstract

Open science, as a common good, opens possibilities for the development of nations, through innovations and collaborative constructions, which help to democratize knowledge. Advances in this area are still emerging, and the open science, cocreation of knowledge and open innovation triangle, is presented as an opportunity to generate an original contribution from research to open educational theory and practices. The study analyzed the articles that addressed this triangle, in order to identify the contexts and challenges that arise in open innovation and the cocreation of knowledge to promote open science. The method was a systematic literature review (SLR) of 168 articles published in open access format, from January 2014 to May 2017 in the Web of Science and Scopus databases. In the validation process, the York University criteria were used: inclusion and exclusion, relevance of the pertinent studies, evaluation of the quality / validity of included studies and description of data / basic studies. The findings showed that the mostwidely publicized contexts were in the United States and Brazil, in the business and academic sectors (closely followed by the social sector), and the challenges were open to innovation, opening and research. The research concludes that the context and practices of collaboration are substantial elements for innovation and open science.

Keywords

Open science, citizen science, knowledge, collaboration, openness, innovation, knowledge cocreation, validation

PDF file in Spanish

PDF file in English

1. Introduction and state of the art

The democratization of knowledge, as a common good, has been driven by open science. Álvarez and Sintas (2012) have posited that the paradigm of open science is re-enforced with the commitment for e-Science that implies the collaborative use of resources that are geographically distributed but interconnected through the Internet. Other areas of open and collaborative science are found in what is named “crowd science”, “citizen science”, or “network-connected science”. Franzoni and Sauermann (2014) have mentioned two important characteristics: participation in a project is open to a wide base of potential contributors, and the intermediate consumables, such as data or problem-solution algorithms, are openly available. An important part of open science is comprised, without a doubt, by ethical processes to maintain high standards of integrity and consciousness, where the sharing and communication of knowledge requires that it be worked upon starting with a training course for scientists that integrates ethics in the sciences, training in history and the philosophy of science and their cultural impact (UNESCO, 2004). In these ethical guidelines, the participation, the collaboration and the public policy are of great help for endorsing this training and the practices needed to make knowledge accessible to everyone.

The support for open science is differentiated according to the contexts and the policies of the research and development councils. García-Aristegui and Rendueles (2014) have mentioned that the criticism of the monopolist power can be explained from at least two very different political perspectives (liberal or institutionalist), with divergent consequences in the conception of the organization, financing and the scientific research programs. Lasthiotakis, Kretz, and Sá (2015) have identified approaches utilized by Canada, the U.S. and the United Kingdom to push forward open science, as a step towards the understanding of how politics and policy in this sphere are evolving. Along the same lines, the drive towards open access has been gradual in India, although it still lacks the support of national bodies that could provide a greater push and sustainability (National Knowledge Commission, 2007). Likewise, Mulder (2013) makes allusions that many other countries (for example, Brazil, China, Indonesia, Japan, Korea, Poland, South Africa, Turkey, United Kingdom, Vietnam) have introduced specific measures or subsidies. This is in contrast with the Latin American sphere, where the policies of support for open science are very recent in some countries (Argentina, Peru, Mexico) and there is still a lack of extension in the countries in the region (Betancourt, Celaya, & Ramírez-Montoya, 2014; Ramírez-Montoya, 2015). The drive for open science brings with it practices of innovation that can greatly affect the development of many countries, especially if the myths that for diverse motives have been associated with the movement of open knowledge are eradicated.

Speaking about open science implies relating it to the capacities of openness and linkage. Dahlander and Gann (2010) systemically worked on the term “open innovation” with the aim of clarifying the definition of “openness”, such as used in “open innovation”, and the research indicated that open innovation in the educational process would imply the visualization of internal factors or openness (institutional processes and strategies) and internal ones as well (link to the exterior). Other authors (García-Peñalvo, García-de-Figuerola, & Merlo-Vega, 2010; Lichtenthaler, 2011; Olalla, Sandulli, Menéndez, & Duarte, 2014; Rodríguez-Ferradas & Alfaro-Tanco, 2016) are in agreement, through their studies, in that the models of open innovation do not only depend on internal factors of the enterprises such as their R&D capacity or their technological stock available, but intrinsic factors of the industry in which the enterprise operates also intervene. From this perspective, once again, the elements of the context (internal or external) are related to the type of knowledge for administering the processes of open construction and innovation in the organizations and in science itself.

The interrelation between open science, innovation and co-creation has important vacuums in research. Randhawa, Wilden, and Hohberger (2016) conducted a systematic revision, and they found absences in knowledge in existing research, among which we find that the researchers do not sufficiently base their work on theoretical perspectives that are external to the field to examine multiple facets of open innovation. Likewise, the studies that are centred in open innovation businesses are focused on role of knowledge, without delving into technology and R&D from the perspective of the innovative company. Another challenge is presented by Huizingh (2011) when the author concludes that the dependence of the context of open innovation is one of the less-understood subjects; more research on the characteristics of the external and internal environments that affect their performance is required. Accordingly, Wallin and Von Krogh (2010) have said that the challenge is to find the place of knowledge, and later try to integrate diverse domains of knowledge in open innovation. Užiene (2015) alerts that the limits become blurred in the co-creation of something new, and in this sense, the intangible resources, such as intellectual capital, become a factor of influence for open innovation. Sloep and Berlanga (2011) state, through a study of formal and informal networks, that co-construction requires bonds of trust, the creation of profiles in the learning networks, and the creation of instances of support among the participants. Along the same lines, and related to informal learning, García-Peñalvo and others (2013) define a methodology for the co-creation of an e-portfolio of informal learning activities that could act as the focal point for decision-making for a person and the company he or she works for.

It is from these absences that this article is presented, which has as the main objective the analysis of recent studies (2014-17) that have been conducted on the structuring of open science, co-creation of knowledge and open innovation, in order to understand what research has been conducted on this triangle, the contexts within which these practices have been developed, and which challenges have been detected to subscribe to open science. The results of this study will contribute knowledge that allows for the construction of theoretical frameworks and the contribution of directions for the practice of open access to knowledge.

2. Materials and methods

To conduct the study, a systematic review of the literature (SRL) was utilized as the strategy for identifying the most relevant studies on the challenges that open innovation and the open co-creation of knowledge have, within the field of open science. The SRL is used to identify, evaluate and interpret the available data within a period from a specific field of research. The process of this revision is based, in general terms, on the guidelines established by Brereton, Kitchenham, Budgen, Turner, and Khalii (2007), focused on the conducting of SRL in software engineering, and in specific terms, on the contributions by Higgins and Green (2006), Kitchenham (2004), Centre for Reviews and Dissemination de York University (2009). The three phases of the review are shown in Figure 1.

3. Results

The steps taken in each phase and the results that emerged are described below.

a) Phase 1: Planning the review. The planning stage consisted in carrying out a strategy to direct the dataset search, which implied starting with questions that emerged due to the lack of knowledge detected, keywords, the choosing of specialized databases and defined search criteria. In the initial exploration, systematic searches and formal summaries of the literature were conducted to identify and classify the results of the studies on a subject in particular (Kitchenham, 2004). The objective of this study was focused on answering the following Research Questions:

• RQ1 How many studies are there in the Scopus and Web of Science (WoS) databases on open innovation, co-creation of open knowledge and open science, from January 2014 to May 2017, in open access journals?

• RQ2 What contexts (academic, business, social, cultural) have been the object of study in open science?

• RQ3 What are the challenges for open innovation and the co-creation of knowledge to drive open science?

The protocol for the review and the guidelines on how to select and evaluate the relevant studies was developed in the following manner:

• Search resources: Scopus (DB-S) and WoS (DB-W) databases.

• Categories and keywords: Open innovation, co-creation of knowledge and open science.

• Inclusion and exclusion criteria: Period of time: from January 2014 to May 2017; Type of document: articles; Type of Journal: open access; Defined field of study: open science; Language: English.

b) Phase 2: Management. The management phase was conducted to provide answers to RQ1: How many studies are there in the SCOPUS and Web of Science (WoS) databases on open innovation, co-creation of open knowledge and open science, from January 2014 to May 2017, in open access journals? The process, following the recommendations by Higging and Green (2006) was comprised of the evaluation and extraction of the article’s data by two people, independently and following a protocol of objectives of the review and steered for each new review. The first search included the keywords in both databases (DB-S and DB-W); in the second search, only the articles that were found in open access journals, as related to the inclusion and exclusion criteria, were selected, and the duplicates were eliminated. In a third round, health and medicine subjects were eliminated, as they did not have any relation to open science (Table 1).

The 168 delimited articles are accessible in the database (https://goo.gl/eS7tH6).

The extraction of data was conducted on the 168 articles selected that included all the criteria defined. They were classified to answer the research questions and are presented in Tables 1 and 2.

From the 168 articles, the countries that had the greatest number of publications were: United States (18), Brazil (15), Germany (13), Spain (13), Finland (11) and the United Kingdom (10). Figure 2 shows the geographical distribution, where the size of the circles graphically indicates the number of publications that each country has generated.

c) Phase 3: Report of the results. Lastly, to create the report for RQ2: Which contexts (academic, business, social, cultural) have been chosen as the object of study in open science? And RQ3: What are the challenges (difficulties, problems, areas of opportunity) for open innovation and the co-creation of knowledge to drive open science? A validation process was conducted where the criteria by the University of York, Centre for Reviews and Dissemination (2009) were used: Criteria of inclusion and exclusion of the review, coverage of the relevant studies, evaluation of quality/ validity of the studies included and description of data / basic studies.

In RQ2: What contexts (academic, business, social, cultural) have been chosen as the object of study in open science? Content analysis was conducted to identify the publication’s sector. The results were drawn in Tableau, by number of articles, which at the same time, were organized according to the year. Figure 3 uses colour to identify the occurrence of the publications to outline data on the sectors addressed in the articles: academic, business, social and cultural.

The studies analyzed show that the open science experiments have been most commonly conducted in the business sector (Bauer, Berleant, Cornell, & Belford, 2015; Hackseq Organizing Committee, 2017; Katsikis, Lang, & Debreczeny, 2016; Krause & Schutte, 2016; Oumlil & Juiz, 2016; Arabito & Pitrelli, 2015; Poehlman, Rynge, Branton, Balamurugan, & Feltus, 2016; Pernet & Poline, 2015; Rodríguez-Ferradas & Alfaro-Tanco, 2016; Sarrión-Viñes & Vidal, 2016; Seguí-Mas, Signes-Pérez, Shim, & Park, 2016; Yang & Wang, 2016; Yoon, Shin, & Lee, 2016; Zander & Kralisch, 2016).

This was followed by articles related to the academic sector (Bond-Lamberty, Smith & Bailey, 2016; Bubela, Guebert, & Mishra, 2015; Carey, Davis, Ferreras, & Porter, 2015; Lahti, Ilomäki & Tolonen, 2015; Lee, Workman, & Jung, 2016; Lenart-Gansiniec, 2016; Schmidt, Orth, Franck, Kuchma, Knoth, & Carvalho, 2016; Labastida i Juan, 2015; Tandon, Singh, Clover, & Hall, 2017; Yun, Jeong, & Park, 2016).

In third place we find the articles from the social sector (Ayris, 2017; Castillo-Molina, 2016; Chalk, 2016; Das & al., 2016; Schuurman, De-Marez, & Ballon, 2016; Joly, Dalpé, So, & Birko, 2015; Higham, Batty, Bettencourt, Greetham, & Grindrod, 2017; Hormia-Poutanen & Forsström, 2016; Jørgensen.& al., 2015; McCormick, Liu, Ibanez, & Jomier, 2014; Ojasalo & Tähtinen, 2016; Okret-Manville, 2016; Lhoste & Barbier, 2016; Tukiainen, Leminen, & Westerlund, 2015; Naqshbandi, Singh, & Ma, 2016).

In RQ3: What are the challenges (difficulties, problems, areas of opportunity) for open innovation and the co-creation of knowledge to drive open science? A content analysis was conducted, keywords from the challenges described by the authors in their text descriptions were defined, and these data were cross-referenced with the contexts identified, with the results used to create a diagram in Tableau (Figure 4). The findings show that there was a greater incidence in three great areas: innovation, openness and research, in the more-common contexts (business, academic and cultural).

On the challenge of open innovation, for example in the social sector, Hughes (2017) states the need to create new forecasting models that include a combination of analysis of technological sequencing and great data tools within the organizations, the government and industry, at the same time that experts from the entire spectrum of open innovation are profited from. In the business sector, Tripathi (2016) postulates fomenting collaboration to work in open innovation in businesses and to promote the intensity of R&D, the ability and the capacity to take on risks, as well as the nature of the business and industry.

Another major challenge was the “openness”, such as the capacity of the converging of instances of openness that allows for the dissemination into diverse sectors, for example, in the business sector. Buttliere (2014) states that the best way to realign the individual and group motives would probably be the creation of a centralized platform that is easy to use, with a profile, a review of specific scientific stories, based on the previous interaction of the system, a sophisticated section (public) of discussion and the impact of metrics that use the associated data. Also in the academic sector, Carey, Davis, Ferreras, and Porter (2015) bet for pedagogy with support from open education resources, to create a greater teacher commitment in the integration and mobilization of diverse sources of knowledge in teaching.

On the area of research, for example, in the social sector, Aleksic and others (2015) mention that it should be fomented in the community that is constantly (and consciously) up to date on the principles of open science, so that the published documents are improved, to increase the confidence in the reproducibility of the work, and in the last case, to provide strategic benefits to the authors and their institutions. Likewise, in the business sector, Mccormick, Liu, Jomier, Marion, and Ibanez (2014) mention the supporting of research communities with the most modern infrastructure of verification of reproducibility, as the challenge.

4. Discussion and conclusions

Open science opens a wide spectrum of possibilities for production of resources and use in social and cultural areas for collective creation, and with this, to propound shared knowledge. In recent years, technologies and the internet have made open practices possible, and at the same time, the academic community has been contributing evidence on the findings that have emerged. However, the empirical contributions still have areas of opportunities to explore (mainly within social and cultural contexts); from this perspective, this article focused on the treatment, through a review of recent literature (2014-17), of the triangle between shared science, co-construction, and open innovation, as the new meeting point for opportunities to support theoretical frameworks and open practices.

The context (defined as the space where it is constructed) can mark a substantial difference in the possibilities of innovation and open science. The data analyzed allowed for the finding, in the length of time explored in both databases (SCOPUS and WoS), of 168 open access articles. The context data placed most of the publications in the United States, Brazil and Germany (Figure 2). Likewise, the publication contexts (Figure 3) mainly pointed to the business and academic contexts (followed very closely by the social sector). Huizingh (2011), and Wallin and Von-Krogh (2010) are in agreement when pointing to the importance of finding the context to try to integrate the knowledge of how open science and innovation are being shaped. Beginning with these data, different issues for theoretical frameworks can be found that contextualize the open scientific knowledge, from the contextual and disciplinary views where these open practices are being developed, up to the possibilities of joint construction. Aspects such as the objectives, the reasoning and the contributions are comprehensible when they are analyzed in light of the publications that are being contributed. More interestingly, was detecting that the cultural sector represents an area of opportunity for the subject of open science.

Open science brings with it the possibility of shared co-construction and the generation of open innovation, to contribute to the public sphere as well as private contexts. Although the contributions have been provided in the last decades, there is still much to be done in the practices of open access. The authors of the articles analyzed demonstrate the challenges they found in order to keep on expanding the subject of open science. In Figure 4, the areas of opportunity that are still in need of work are highlighted: innovation, openness and research. Sloep and Berlanga (2011), and Užiene (2015) warn on the difficulties of delimiting the co-creation of something new and the collaboration that they contribute to open science. Collaborative construction becomes, in this sense, substantial for the continued contribution in the area of open science.

The intersection of the triangle between shared science, co-construction, and open innovation gives rise to an interesting opportunity of analysis for linking it to ethical considerations. Most notably, the implications to science, more specifically within the contexts of education, humanities, communication, media literacy studies, qualitative data, citizen science, among other subjects that were addressed in this article, requires a special view to nurture scientific research, contribute possibilities for development, and the use of technologies with open access. The UNESCO (2004) subscribes to paying attention to training processes on ethics competencies to work on standards of integrity, agreement and collaboration. Although reality makes us see that the advances in science could play a destructive role, they can also play another role in the assertiveness of tending to needs and problems that could create better conditions of life in a world that requires positive energy from all.

In addition to the ethical implications, the data found in this study link other consequences for science, in the sense that new forms of construction of knowledge, new participating actors, new interrelations of disciplines, new possibilities for opening the knowledge created, and new tools for the transferring of this knowledge became evident. These implications can become engines for innovation, the resolution of problems and the creative planning of possibilities for civil society. However, there is still a long road ahead, from the public policies, the systems of funding, the closed systems linked to business models that are unrelated to the common good, to the promotion of changes that push for a culture of collaboration that promotes open knowledge for society. Open science therefore represents an interesting issue for the learning processes in any area and context.

This article presents original data that can support future studies on open science, co-construction, and educational innovation. The database of the articles can be used as a foundation for studies that analyze other theoretical/ practical elements (types of practices, methodologies, tools, among other aspects). The study of the literature review was delimited to open-access articles, intending to be consistent with the possibilities of openness to knowledge. However, due to this delimitation, a great number of articles were not analyzed (Table 1), and this could be a limiting factor in the generalizing of the data that emerged, and at the same time, it could also be a new possibility for the continuous contribution to the subject of science and shared knowledge. Thereby, the present document is an invitation for the continuous search for shared construction alternatives that support the democratization of knowledge through open practices.

Funding agency

This work was partially supported by CONACYT-SENER (Mexico) through the Project “Laboratorio BiNacional para la Gestión Inteligente de la Sustentabilidad Energética y Formación Tecnológica” (Ref. 266632), by the project CONACYT-I0028-2016-04 (Mexico) “Aumento de la visibilidad de RITEC mejorando la experiencia de usuario y su interoperabilidad con el Repositorio Nacional” (Ref. 000000000280318) and by the Ministry of Economy and Competitiveness (Spain) through the project “DEFINES” (Ref. TIN2016-80172-R).

References

Aleksic, J., Alexa, A., Attwood, T.K., Hong, N.C., Dahlö, M., Davey, R., ... Lahti, L. (2015). An open science peer review oath. F1000Research, 2015, 3, 271. https://doi.org/10.12688/f1000research.5686.2

Álvarez, E.G., & Sintas, J.L. (2012). Ciencia abierta, e-ciencia y nuevas tecnologías: Desafíos y antiguos problemas en la investigación cualitativa en las ciencias sociales. Intangible Capital, 8(3), 497-519. https://doi.org/10.3926/ic.384

Arabito, S., & Pitrelli, N. (2015). Open Science training and education: challenges and difficulties on the researchers’ side and in public engagement. Journal of Science Communication, 14(04), C01_en. (https://goo.gl/MYUB8V).

Ayris, P. (2017). Brexit - and its potential impact for open access in the UK. Insights, 30(1), 4-10. https://doi.org/10.1629/uksg.336

Bauer, M.A., Berleant, D., Cornell, A.P., & Belford, R.E. (2015). WikiHyperGlossary (WHG): An information literacy technology for chemistry documents. Journal of Cheminformatics, 7(1), 22. https://doi.org/10.1186/s13321-015-0073-7

Betancourt, M.C., Celaya, R., & Ramírez-Montoya, M.S. (2014). Open educational practices and technology appropriation: The case of the regional open Latin American community for social and educational research. RUSC, 11(1), 4-17. https://doi.org/10.7238/rusc.v11i1.1794

Bond-Lamberty, B., Smith, A.P., & Bailey, V. (2016). Running an open experiment: Transparency and reproducibility in soil and ecosystem science. Environmental Research Letters, 11(8), 084004. https://doi.org/10.1088/1748-9326/11/8/084004

Brereton, P., Kitchenham, B.A., Budgen, D., Turner, M., & Khalil, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software, 80(4), 571-583. https://doi.org/10.1016/j.jss.2006.07.009

Bubela, T., Guebert, J., & Mishra, A. (2015). Use and misuse of material transfer agreements: Lessons in proportionality from research, repositories, and litigation. PLoS Biol, 13(2), e1002060. https://doi.org/10.1371/journal.pbio.1002060

Buttliere, B.T. (2014). Using science and psychology to improve the dissemination and evaluation of scientific work. Frontiers in Computational Neuroscience, 8, 82. https://doi.org/10.3389/fncom.2014.00082

Carey, T., Davis, A., Ferreras, S., & Porter, D. (2015). Using open educational practices to support institutional strategic excellence in teaching, learning & scholarship. Open Praxis, 7(2), 161-171. https://doi.org/10.5944/openpraxis.7.2.201

Castillo-Molina, Y.Y. (2016). Propuesta de un modelo para gestionar la innovación abierta en los Núcleos de Innovación del Cauca-Colombia. Revista Gestión de las Personas y Tecnología, 9(25), 72-85. (https://goo.gl/S9WdCL).

Centre for Reviews and Dissemination (Ed.) (2009). Systematic Reviews. CRD’s guidance for undertaking reviews in health care. York, UK: CRD, University of York. (https://goo.gl/731Ehh).

Chalk, S.J. (2016). The open spectral database: An open platform for sharing and searching spectral data. Journal of Cheminformatics, 8(1), 55. https://doi.org/10.1186/s13321-016-0170-2

Dahlander, L., & Gann, D.M. (2010). How open is innovation? Research Policy, 39(6), 699-709. https://doi.org/10.1016/j.respol.2010.01.013

Das, S., Glatard, T., Rogers, C., Saigle, J., Paiva, S., MacIntyre, L., ... MacFarlane, D. (2016). Cyberinfrastructure for open science at the Montreal Neurological Institute. Frontiers in Neuroinformatics, 10, 53. https://doi.org/10.3389/fninf.2016.00053

Franzoni, C., & Sauermann, H. (2014). Crowd science: The organization of scientific research in open collaborative projects. Research Policy, 43(1), 1-20. https://doi.org/10.1016/j.respol.2013.07.005

García-Aristegui, D., & Rendueles, C. (2014). Abierto, libre… y público. Los desafíos políticos de la ciencia abierta. Argumentos de Razón Técnica, 17, 45-64. (https://goo.gl/Xoh3a1).

García-Peñalvo, F.J., Conde, M.A., Johnson, M., & Alier, M. (2013). Knowledge co-creation process based on informal learning competences tagging and recognition. International Journal of Human Capital and Information Technology Professionals, 4(4), 18-30. https://doi.org/10.4018/ijhcitp.2013100102

García-Peñalvo, F.J., García-de-Figuerola, C., & Merlo-Vega, J.A. (2010). Open knowledge: Challenges and facts. Online Information Review, 34(4), 520-539. https://doi.org/10.1108/14684521011072963

Hackseq Organizing Committee (2017). Hackseq: Catalyzing collaboration between biological and computational scientists via hackathon. F1000Research, 6, 10. https://doi.org/12688/f1000research.10964.1

Higgins, J.P., & Green, S. (Eds.) (2006). Cochrane handbook for systematic reviews of interventions 4.2.6. The Cochrane collaboration. (https://goo.gl/6uU6tM).

Higham, D.J., Batty, M., Bettencourt, L.M., Greetham, D.V., & Grindrod, P. (2017). An overview of city analytics. Royal Society Open Science. https://doi.org/10.1098/rsos.161063

Hormia-Poutanen, K., & Forsström, P. (2016). Collaboration at international, national and institutional level – Vital in fostering open science. Liber Quarterly, 26(1), 3-12. https://doi.org/10.18352/lq.10157

Hughes, S.F. (2017). A new model for identifying emerging technologies. Journal of Intelligence Studies in Business, 7(1), 79-86. (https://goo.gl/yKd3fA).

Huizingh, E.K. (2011). Open innovation: State of the art and future perspectives. Technovation, 31(1), 2-9. https://doi.org/10.1016/j.technovation.2010.10.002

Joly, Y., Dalpé, G., So, D., & Birko, S. (2015). Fair shares and sharing fairly: A survey of public views on open science, informed consent and participatory research in biobanking. PloS One, 10(7), e0129893. https://doi.org/10.1371/journal.pone.0129893

Jørgensen, P.S., Barraquand, F., Bonhomme, V., Curran, T.J., Cieraad, E., Ezard, T.G., … Zimmerman, N. (2015). Connecting people and ideas from around the world: Global innovation platforms for next-generation ecology and beyond. Ecosphere, 6(4). https://doi.org/10.1890/ES14-00198.1

Katsikis, N., Lang, A., & Debreczeny, C. (2016). Evaluation of open innovation in B2B from a company culture perspective. Journal of Technology Management & Innovation, 11(3), 94-100. https://doi.org/10.4067/S0718-27242016000300011

Kitchenham, B.A. (2004). Procedures for performing systematic reviews. Keele University: Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1. (https://goo.gl/wQcMaS).

Krause, W., & Schutte, C.S. (2016). Developing design propositions for an open innovation approach for SMEs. South African Journal of Industrial Engineering, 27(3), 37-49. https://doi.org/10.7166/27-3-1625

Labastida-i-Juan, I. (2015). The time has come for managing and sharing research data in universities. Journal of Science Communication, 14(4). (https://goo.gl/y1qndm).

Lahti, L., Ilomäki, N., & Tolonen, M. (2015). A quantitative study of history in the English short-title catalogue (ESTC), 1470-1800. Liber Quarterly, 25(2), 87-116. https://doi.org/10.18352/lq.10112.

Lasthiotakis, H., Kretz, A., & Sá, C. (2015). Open science strategies in research policies: A comparative exploration of Canada, the US and the UK. Policy Futures in Education, 13(8), 968-989. https://doi.org/10.1177/1478210315579983

Lee, S.H., Workman, J., & Jung, K. (2016). Perception of time, creative attitudes, and adoption of Innovations: A cross-cultural study from Chinese and US College Students. Sustainability, 8(11), 1193. https://doi.org/10.3390/su8111193

Lenart-Gansiniec, R. (2016). Relational capital and open innovation - In search of interdepencies. Acta Universitatis Agriculturae et Silviculturae Mendelianae Brunensis, 64(6), 2007-2013. https://doi.org/10.11118/actaun201664062007

Lhoste, E., & Barbier, M. (2016). FabLabs. L’institutionnalisation de Tiers-Lieux du ‘soft hacking’. Revue d’Anthropologie des Connaissances, 10(1), 43-69. https://doi.org/10.3917/rac.030.0043

Lichtenthaler, U. (2011). Open innovation: Past research, current debates, and future directions. Academy of Management Perspectives, 25(1), 75-93. https://doi.org/10.5465/amp.2011.59198451

McCormick, M.M., Liu, X., Ibanez, L., & Jomier, J. (2014). ITK: Enabling reproducible research and open science. Frontiers in Neuroinformatics, 8, 13. https://doi.org/10.3389/fninf.2014.00013

Mulder, F. (2013). The LOGIC of national policies and strategies for open educational resources. International Review of Research in Open and Distance Learning, 14(2), 96-105. https://doi.org/10.19173/irrodl.v14i2.1536

Naqshbandi, M.M., Singh, S.K., & Ma, P. (2016). The link between organisational citizenship behaviours and open innovation: A case of Malaysian high-tech sector. IIMB Management Review, 28(4), 200-211. https://doi.org/10.1016/j.iimb.2016.08.008

National Knowledge Commission. (2007). Report to the Nation 2007. New Delhi: Government of India. (https://goo.gl/WbkkAE).

OECD (Ed.) (2012). Connected minds: Technology and today’s learners. Paris: OECD. https://doi.org/10.1787/9789264111011-en

Ojasalo, J., & Tähtinen, L. (2016). Integrating open innovation platforms in public sector decision making: Empirical results from smart city research. Technology Innovation Management Review, 6(12). (https://goo.gl/ottFqt).

Okret-Manville, C. (2016). Academic social networks and open access: French researchers at the crossroads. Liber Quarterly, 25(3), 118-135. http://doi.org/10.18352/lq.10131

Olalla, M. F., Sandulli, F.D., Menéndez, J.F., & Duarte, A.R. (2014). ¿Cómo afectan las características de la industria a la relación entre la capacidad de I+D y la adopción de innovación abierta de entrada? Economía Industrial, 391, 23-32. (https://goo.gl/73V968).

Oumlil, R., & Juiz, C. (2016). An Up-to-date Survey in barriers to open innovation. Journal of Technology Management & Innovation, 11(3), 137-152. https://doi.org/10.4067/S0718-27242016000300016

Pernet, C., & Poline, J.B. (2015). Improving functional magnetic resonance imaging reproducibility. GigaScience, 4(1), 1-8. https://doi.org/10.1186/s13742-015-0055-8

Poehlman, W.L., Rynge, M., Branton, C., Balamurugan, D., & Feltus, F.A. (2016). OSG-GEM: Gene expression matrix construction using the open science Grid. Bioinformatics and Biology Insights, 10, 133-141. https://doi.org/10.4137/BBI.S38193

Ramírez-Montoya, M.S. (2015). Acceso abierto y su repercusión en la sociedad del conocimiento: Reflexiones de casos prácticos en Latinoamérica. Education in the Knowledge Society, 16(1), 103-118. https://doi.org/10.14201/eks2015161103118.

Randhawa, K., Wilden, R., & Hohberger, J. (2016). A bibliometric review of open innovation: Setting a research agenda. Journal of Product Innovation Management, 33(6), 750-772. https://doi.org/10.1111/jpim.12312

Rodríguez-Ferradas, M.I., & Alfaro-Tanco, J.A. (2016). Open innovation in automotive SMEs suppliers: An opportunity for new product development. Universia Business Review, 50, 142. https://doi.org/10.3232/UBR.2016.V13.N2.05

Schmidt, B., Orth, A., Franck, G., Kuchma, I., Knoth, P., & Carvalho, J. (2016). Stepping up open science training for European research. Publications, 4(2), 16. https://doi.org/10.3390/publications4020016

Schuurman, D., & Tõnurist, P. (2017). Innovation in the public sector: Exploring the characteristics and potential of living labs and innovation labs. Technology Innovation Management Review, 7(1), 7-14. (https://goo.gl/pqVcQy).

Schuurman, D., De-Marez, L., & Ballon, P. (2016). The impact of living lab methodology on open innovation contributions and outcomes. Technology Innovation Management Review, 6(1), 7-16. (https://goo.gl/DmwJRP).

Seguí-Mas, E., Signes-Pérez, E., Sarrión-Viñes, F., & Vidal, J.A. (2016). Bibliometric analysis of the international literature on open innovation and absorptive capacity. Intangible Capital, 12(1), 51-72. https://doi.org/10.3926/ic.685

Shim, S.O., & Park, K. (2016). Technology for production scheduling of jobs for open innovation and sustainability with fixed processing property on parallel machines. Sustainability, 8(9), 904. https://doi.org/10.3390/su8090904

Sloep, P., & Berlanga, A. (2011). Learning networks, networked learning. [Redes de aprendizaje, aprendizaje en Red]. Comunicar, 37(19), 55-63. https://doi.org/10.3916/C37-2011-02-05

Tandon, R., Singh, W., Clover, D., & Hall, B. (2017). Knowledge democracy and excellence in engagement. IDS Bulletin, 47(6), 19-35. https://doi.org/10.19088/1968-2016.197

Tripathi, S.S. (2016). Open innovation in Indian organizations: Types of collaboration. Technology Innovation Management Review, 6(5), 15-23. (https://goo.gl/yqXrbb).

Tukiainen, T., Leminen, S., & Westerlund, M. (2015). Cities as collaborative innovation platforms. Technology Innovation Management Review, 5(10), 16-23. (https:// goo.gl/UrrtGB).

UNESCO (Ed.) (2004). Ética de la Ciencia y la Tecnología. Contacto, XXIX(3-4). (https://goo.gl/FGvb8S).

Užiene, L. (2015). Open innovation, knowledge flows and intellectual capital. Procedia-Social and Behavioral Sciences, 213, 1057-1062. https://doi.org/10.1016/j.sbspro.2015.11.525

Wallin, M.W., & Von-Krogh, G. (2010). Organizing for open innovation. Organizational Dynamics, 39(2), 145-154. https://doi.org/10.1016/j.orgdyn.2010.01.010

Yang, M., & Wang, J. (2016). Overflow mechanism and demonstration of knowledge flow on enterprise endogenous innovation by the three-dimensional space: Based on the open innovation perspective. International Journal of Security and Its Applications, 10(3), 321-332. https://doi.org/10.14257/ijsia.2016.10.3.28

Yoon, B., Shin, J., & Lee, S. (2016). Open innovation projects in SMEs as an engine for sustainable growth. Sustainability, 8(2), 146. https://doi.org/10.3390/su8020146

Yun, J.J., Jeong, E., & Park, J. (2016). Network analysis of open innovation. Sustainability, 8(8), 729. https://doi.org/10.3390/su8080729

Zander, F., & Kralisch, S. (2016). River basin information system: Open environmental data management for research and decision making. ISPRS International Journal of Geo-Information, 5(7). https://doi.org/10.3390/ijgi5070123