Mixed-methods, e-research, technologies, learning design, educational research, case study, literature review, Delphi study


Nowadays, technologies play a key role in educational research processes, especially in the context of complex designs or integrative perspectives (qualitative and quantitative). Affordances provided by new tools and technological devices are constantly impacting the way educational research is carried out. Consequently, this growing importance (and dependence on) technology for educational research calls for a deeper reflection, not only about its clear benefits, but also about its potential drawbacks and limitations. This paper explores this tension in a specific mixed-methods research design aimed at understanding the barriers preventing the adoption of Learning Design (LD) tools/methods, a significant problem in the research field of Technology Enhanced Learning (TEL). Different actors (teachers and researchers) were involved in the research design, which included a systematic literature review, a Delphi study and a case study. Such an articulated design required the adoption of technologies to support the process in all its phases. The paper describes the main methodological implications of the employed technologies in the different methods applied and in the overall research. The conclusions of the paper highlight that while technologies definitely support a higher level of complexity and articulation of the research design, they might also lead to superficial or biased results.

View infography


Asensio-Pérez, J.I., Dimitriadis, Y., Pozzi, F., Hernández-Leo, D., Prieto, L.P., Persico, D., & Villagrá-Sobrino, S.L. (2017). Towards teaching as design: Exploring the interplay between full-lifecycle learning design tooling and teacher professional development. Computers & Education, 114, 92-116.

Link DOI | Link Google Scholar

Balacheff, N., Ludvigsen, S., de-Jong, T., Lazonder, A., & Barnes, S. (2009). Technology- enhanced learning: Principles and products. Springer.

Link DOI | Link Google Scholar

Bennett, S., Agostinho, S., & Lockyer, L. (2017). The process of designing for learning: Understanding university teachers’ design work. Educational Technology Research and Development, 65(1), 125-145.

Link DOI | Link Google Scholar

Bottino, R.M., Ott, M., & Tavella, M. (2011). Scaffolding pedagogical planning and the design of learning activities: An on-line system. International Journal of Knowledge Society Research, 2(1), 84-97.

Link DOI | Link Google Scholar

Cole, Z.D., Donohoe, H.M., & Stellefson, M.L. (2013). Internet-based Delphi research: Case based discussion. Environmental Management, 51(3), 511-523.

Link DOI | Link Google Scholar

Creswell, J.W. (2014). Research design: Qualitative, quantitative and mixed methods approaches. Sage.

Link DOI | Link Google Scholar

Dagnino, F.M., Dimitriadis, Y.A., Pozzi, F., Asensio?Pérez, J.I., & Rubia?Avi, B. (2018). Exploring teachers’ needs and the existing barriers to the adoption of Learning Design methods and tools: A literature survey. British Journal of Educational Technology, 49(6), 998-1013.

Link DOI | Link Google Scholar

Dalkey, N., & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458-467.

Link DOI | Link Google Scholar

Dimitriadis, Y., & Goodyear, P. (2013). Forward-oriented design for learning: Illustrating the approach. Research in Learning Technology Supplement, 21, 1-13.

Link DOI | Link Google Scholar

Duca, D., & Metzler, K. (2019). The ecosystem of technologies for social science research (White paper). Sage.

Link DOI | Link Google Scholar

Duval, E., Sharples, M., & Sutherland, R. (2017). Technology enhanced learning: Research themes. Springer.

Link DOI | Link Google Scholar

Ertmer, P.A., & Ottenbreit-Leftwich, A. (2013). Removing obstacles to the pedagogical changes required by Jonassen's vision of authentic technology-enabled learning. Computers & Education, 64, 175-182.

Link DOI | Link Google Scholar

Fielding, N.G. (2012). Triangulation and mixed methods designs: Data integration with new research technologies. Journal of Mixed Methods Research, 6(2), 124-136.

Link DOI | Link Google Scholar

Goodyear, P., & Retalis, S. (2010). Technology-enhanced learning: Design patterns and pattern languages. Sense Publishers.

Link DOI | Link Google Scholar

Greene, J.C. (2007). Mixed methods in social inquiry. John Wiley & Sons.

Link Google Scholar

Hai-Jew, S. (2015). Enhancing qualitative and mixed methods research with technology. Hershey, PA: Information Science reference. IGI Global.

Link DOI | Link Google Scholar

Hernández-Leo, D., Asensio-Pérez, J.I., Derntl, M., Pozzi, F., Chacón-Pérez, J., Prieto, L.P., & Persico, D. (2018). An integrated environment for learning design. Frontiers in ICT, 5, 9.

Link DOI | Link Google Scholar

Hernández-Leo, D., Chacón, J., Prieto, L.P., Asensio-Pérez, J.I., & Derntl, M. (2013) Towards an Integrated Learning Design Environment. In D. Hernández-Leo, T. Ley, R. Klamma, A. Harrer (Eds.), Scaling up Learning for Sustained Impact. EC-TEL 2013. Lecture Notes in Computer Science (pp. 448–453). Springer.

Link DOI | Link Google Scholar

Hesse-Biber, S., & Griffin, A.J. (2013). Internet-mediated technologies and mixed methods research: Problems and prospects. Journal of Mixed Methods Research, 7(1), 43-61.

Link DOI | Link Google Scholar

Katsamani, M., & Retalis, S. (2013). Orchestrating learning activities using the CADMOS learning design tool. Research in Learning Technology, 21, 1-12.

Link DOI | Link Google Scholar

Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature reviews in Software Engineering. EBSE Technical Report EBSE-2007-01. University of Durham.

Link Google Scholar

Landeta, J., (2006). Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change, 73(5), 467-482.

Link DOI | Link Google Scholar

Laurillard, D. (2012). Teaching as a design science. Building pedagogical patterns for learning and technology. Routledge.

Link DOI | Link Google Scholar

Lockyer, L., Bennett, S., Agostinho, S., & Harper, B (2009). Handbook of research on learning design and learning objects: Issues applications and technologies. Hershey.

Link DOI | Link Google Scholar

Mor, Y., Craft, B., & Hernández-Leo, D. (2013). The art and science of learning design. Research in Learning Technology, 21(22513), pp. 1-8.

Link DOI | Link Google Scholar

Neumann, S., Klebl, M., Griffiths, D., Hernández-Leo, D., De-la-Fuente-Valentín, L., Hummel, H., Brouns, F., Derntl, M., & Oberhuemer, P (2010). Report of the results of an IMS learning design expert workshop. International Journal of Emerging Technologies in Learning, 5(1), 58-72.

Link DOI | Link Google Scholar

Orlikowski, W.J., & Baroudi, J.J. (1991). Studying information technology in organizations: Research approaches and assumptions. Information Systems Research, 2(1), 1-28.

Link DOI | Link Google Scholar

Persico, D., Pozzi, F., Anastopoulou, S., Conole, G., Craft, B., Dimitriadis, Y., Hernández-Leo, D., Kali, Y., Mor, Y., Pérez-Sanagustín, M., & Walmsley, H. (2013). Learning design Rashomon I – Supporting the design of one lesson through different approaches. Research in Learning Technology, 21.

Link DOI | Link Google Scholar

Pozzi, F., Asensio-Perez, J.I., Ceregini, A., Dagnino, F.M., Dimitriadis, Y., & Earp, J. (2020). Supporting and representing Learning Design with digital tools: In between guidance and flexibility. Technology, Pedagogy and Education, 29(1), 109-128.

Link DOI | Link Google Scholar

Roztocki, N. (2001). Using internet-based surveys for academic research: Opportunities and problems. Proceedings of the 2001 American Society of Engineering Management (ASEM) National Conference. Huntsville, AL, October 11-13, 2001. (pp. 290-295).

Link Google Scholar

Rubia-Avi, B., & Guitert-Catasús, M. (2014). Revolution in education: Computer support for collaborative learning. [¿La revolución de la enseñanza? El aprendizaje colaborativo en entornos virtuales (CSCL)]. Comunicar, 42, 10-14.

Link DOI | Link Google Scholar

Stake, R.E. (2005). Multiple case study analysis. Guilford Press.

Link Google Scholar

Sugar, W., Crawley, F., & Fine, B. (2004). Examining teachers’ decisions to adopt new technology. Educational Technology and Society, 7(4), 201-213.

Link Google Scholar


Technical information

Received: 28-02-2020

Revised: 16-03-2020

Accepted: 27-04-2020

OnlineFirst: 15-06-2020

Publication date: 01-10-2020

Article revision time: 17 days | Average time revision issue 65: 36 days

Article acceptance time: 59 days | Average time of acceptance issue 65: 79 days

Preprint editing time: 171 days | Average editing time preprint issue 65: 191 days

Article editing time: 216 days | Average editing time issue 65: 236 days


Metrics of this article

Views: 36112

Abstract readings: 32111

PDF downloads: 4001

Full metrics of Comunicar 65

Views: 392977

Abstract readings: 335982

PDF downloads: 56995

Cited by

Cites in Web of Science

Palominos Bastias, Marcelo; Marcelo Garcia, Carlos;. Use of digital technologies to meet special educational needs in the teaching training of differential teachers PIXEL-BIT- REVISTA DE MEDIOS Y EDUCACION , 2021.

Manetti, A; Lara-Navarra, P and Sanchez-Navarro, J. Design process for the generation of future education scenarios Comunicar, 2022.

Cites in Scopus

Bastias, M.P., García, C.M. . Use of digital technologies to meet special educational needs in the teaching training of differential teachers | [Uso de tecnologías digitales para atender Necesidades Educativas Especiales en la Formación docente del educador Diferencial]), Pixel-Bit, Revista de Medios y Educacion, .

Manetti, A., Lara-Navarra, P., Sánchez-Navarro, J. . Design process for the generation of future education scenarios), Comunicar, .

Canales-Escalante, C., Huaman-Yrigoin, D., Gutierrez-Tirado, R., (...), Cuzcano-Rivas, A., Zevallos-Vera, E.. Management of scientific production in research centers through a virtual platform based on Scrum methodology), Proceedings of the LACCEI international Multi-conference for Engineering, Education and Technology 2022-December, .

López-Padrón, A., Roig-Vila, R.. Use Trends and Methodological Pertinence of Delphi within Educational Research in Ibero-America: A Systematic Review in Scopus ), Education and the Collective Construction of Knowledge, .

Link Google Scholar

Cites in Google Scholar

Bastias, M. R. P., & García, C. M. (2021). Uso de tecnologías digitales para atender necesidades educativas especiales en la formación docente del educador diferencial. Píxel-Bit. Revista de Medios y Educación, 61, 231-256.

Palominos Bastias, M. R., & Marcelo García, C. (2021). Uso de tecnologías digitales para atender Necesidades Educativas Especiales en la Formación docente del educador Diferencial. Pixel-Bit.

Epiquién Díaz, J. (2020). La doble subtitulación en vídeos subidos a YouTube: aspectos técnicos y lingüísticos.

Bernárdez Vilaboa, R., Ruiz Ruiz, J. M., Garzón Jiménez, N., Sillero Quintana, M., Bartolomé Bartolomé, G., Boiso Calero, A., ... & Pérez, F. S. La clase práctica interactiva como herramienta para optimizar la coordinación de los grupos en asignaturas prácticas del ámbito universitario.

Manetti, A., Lara-Navarra, P., & Sánchez-Navarro, J. (2022). El proceso de diseño para la generación de escenarios futuros educativos. Comunicar: Revista Científica de Comunicación y Educación, 30(73).

Flynn, M. J. (2022). An Evaluation and Analysis of Support for English Language Learners in Boosting Academic Achievement of Literacy Skills: A Case Study (Doctoral dissertation, Northcentral University).



Alternative metrics

How to cite

Dagnino, F., Dimitriadis, Y., Pozzi, F., Rubia-Avi, B., & Asensio-Pérez, J. (2020). The role of supporting technologies in a mixed methods research design. [El rol de las tecnologías de apoyo en un diseño de investigación de métodos mixtos]. Comunicar, 65, 53-63.



Oxbridge Publishing House

4 White House Way

B91 1SE Sollihul United Kingdom


Editorial office

Creative Commons

This website uses cookies to obtain statistical data on the navigation of its users. If you continue to browse we consider that you accept its use. +info X