Beyond Authenticity: Navigating Bias, Ethics, and Methodological Frontiers of Synthetic Data in Qualitative Healthcare Research
Keywords:
synthetic data, qualitative healthcare research, methodological innovation, bias and validity, AI-generated narrativesAbstract
The increasing integration of synthetic data into qualitative healthcare research offers new avenues for narrative analysis while raising questions about validity, bias, and authenticity. This study investigates how synthetic data, particularly AI-generated narratives, can be utilised in qualitative healthcare research to enhance methodological rigour and overcome data access limitations. Using a qualitative literature review approach, this research synthesises findings from diverse peer-reviewed articles, policy briefs, and empirical case studies. Data were collected through thematic extraction from existing literature and critically analysed using interpretative thematic synthesis. The results indicate that synthetic data can replicate core thematic structures commonly found in authentic patient interviews, including experiences of chronic illness, emotional distress, and healthcare navigation. However, challenges remain in addressing embedded algorithmic bias, particularly regarding cultural specificity, linguistic diversity, and representation of marginalised populations. Innovations such as reflexive prompt engineering, synthetic member-checking, and hybrid validation techniques have shown promise in mitigating these biases and improving narrative fidelity. The study concludes that when applied ethically and methodologically, synthetic data can serve as a valuable supplement to traditional qualitative methods in healthcare research. This integration can enhance thematic saturation, increase data accessibility, and offer new perspectives in digital ethnography. Future research should focus on developing standardized evaluation criteria, participatory prompt design, and long-term assessment of synthetic data applications in diverse healthcare settings.
References
Adeniyi, A. O., Arowoogun, J. O., Okolo, C. A., Chidi, R., & Babawarun, O. (2024). Ethical considerations in healthcare IT: A review of data privacy and patient consent issues. World Journal of Advanced Research and Reviews, 21(2), 1660–1668. https://doi.org/10.30574/wjarr.2024.21.2.0341
Aguilar, N., Landau, A., Mathiyazhagan, S., Auyeung, A., Dillard, S., & Patton, D. (2023). Applying Reflexivity to Artificial Intelligence for Researching Marginalized Communities and Real-World Problems. https://doi.org/10.1145/3593013.3594081
Alaa, A., Van Breugel, B., Saveliev, E. S., & Van Der Schaar, M. (2022). How faithful is your synthetic data? sample-level metrics for evaluating and auditing generative models. International Conference on Machine Learning, 290–306.
Amani, S., White, L., Balart, T., Watson, K., & Shryock, K. (2025). Applying Generative AI for Thematic Analysis: A Model for Researchers Exploring Qualitative Methods.
Amirova, A., Fteropoulli, T., Ahmed, N., Cowie, M. R., & Leibo, J. Z. (2024). Framework-based qualitative analysis of free responses of Large Language Models: Algorithmic fidelity. PLOS ONE, 19(3), e0300024.
Ashwin, J., Chhabra, A., & Rao, V. (2023). Using large language models for qualitative analysis can introduce serious bias. ArXiv Preprint ArXiv:2309.17147.
Bhanot, K., Baldini, I., Wei, D., Zeng, J., & Bennett, K. P. (2022). Downstream Fairness Caveats with Synthetic Healthcare Data.
Birt, L., Scott, S., Cavers, D., Campbell, C., & Walter, F. (2016). Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qualitative Health Research, 26(13), 1802–1811. https://doi.org/10.1177/1049732316654870
Burleigh, C., & Wilson, A. M. (2024). Generative AI: Is Authentic Qualitative Research Data Collection Possible? Journal of Educational Technology Systems, 53(2), 89–115.
Cascio, M. A., Lee, E., Vaudrin, N., & Freedman, D. A. (2019). A team-based approach to open coding: Considerations for creating intercoder consensus. Field Methods, 31(2), 116–130. https://doi.org/10.1177/1525822X19838237
Castellanos, A., Jiang, H., Gomes, P., Vander Meer, D., & Castillo, A. (2025). Large Language Models for Thematic Summarization in Qualitative Health Care Research: Comparative Analysis of Model and Human Performance. JMIR AI, 4, e64447. https://doi.org/10.2196/64447
Chandra, N. K., Sarkar, A., de Groot, J. F., Yuan, Y., & Müller, P. (2023). Bayesian nonparametric common atoms regression for generating synthetic controls in clinical trials. Journal of the American Statistical Association, 118(544), 2301–2314. https://doi.org/10.1080/01621459.2022.2136847
Charmaz, K. (2017). The power of constructivist grounded theory for critical inquiry. Qualitative Inquiry, 23(1), 34–45. https://doi.org/10.1177/1077800416657105
Chen, M., Papangelis, A., Tao, C., Kim, S., Rosenbaum, A., Liu, Y., & Hakkani-Tur, D. (2023). PLACES: Prompting language models for social conversation synthesis. ArXiv Preprint ArXiv:2302.03269. https://doi.org/10.48550/arXiv.2302.03269
Clarfeld, L. A., Gramling, R., Rizzo, D. M., & Eppstein, M. J. (2021). A general model of conversational dynamics and an example application in serious illness communication. Plos One, 16(7), e0253124. https://doi.org/10.1371/journal.pone.0253124
Coombs, N. C., Campbell, D. G., & Caringi, J. (2022). A qualitative study of rural healthcare providers’ views of social, cultural, and programmatic barriers to healthcare access. BMC Health Services Research, 22(1), 438. https://doi.org/10.1186/s12913-022-07829-2
Costa, J. (2024). Mixed Methods in Educational Large-Scale Studies: Integrating Qualitative Perspectives into Secondary Data Analysis. Education Sciences, 14(12), 1347. https://doi.org/10.3390/educsci14121347
De Paoli, S., & Mathis, W. S. (2025). Codebook Reduction and Saturation: Novel observations on Inductive Thematic Saturation for Large Language Models and initial coding in Thematic Analysis. ArXiv Preprint ArXiv:2503.04859.
De Seta, G., Pohjonen, M., & Knuutila, A. (2024). Synthetic ethnography: Field devices for the qualitative study of generative models. Big Data & Society, 11(4), 20539517241303130.
Deb, B., & Rodman, A. (2024). Racial differences in pain assessment and false beliefs about race in AI models. JAMA Network Open, 7(10), e2437977--e2437977.
Delve, L., & Limpaecher, A. (2023). Member check and respondent validation in qualitative research.
Fabuyi, J. A. (2024). Leveraging Synthetic Data as a Tool to Combat Bias in Artificial Intelligence (AI) Model Training. Journal of Engineering Research and Reports, 26(12), 24–46. https://doi.org/10.9734/jerr/2024/v26i121337
Gair, S., & Van Luyn, A. (Eds.). (2016). Sharing qualitative research: showing lived experience and community narratives. Taylor & Francis.
Giuffrè, M., & Shung, D. L. (2023). Harnessing the power of synthetic data in healthcare: innovation, application, and privacy. NPJ Digital Medicine, 6(1), 186. https://doi.org/10.1038/s41746-023-00927-3
Gonzales, A., Guruswamy, G., & Smith, S. R. (2023). Synthetic data in health care: A narrative review. PLOS Digital Health, 2(1), e0000082. https://doi.org/10.1371/journal.pdig.0000082
Hayes, A. S. (2025). “Conversing” with qualitative data: Enhancing qualitative research through large language models (LLMs). International Journal of Qualitative Methods, 24, 16094069251322346.
He, X., Nassar, I., Kiros, J., Haffari, G., & Norouzi, M. (2022). Generate, annotate, and learn: NLP with synthetic text. Transactions of the Association for Computational Linguistics, 10, 826–842. https://doi.org/10.1162/tacl_a_00492
Heggen, K. M., & Berg, H. (2021). Epistemic injustice in the age of evidence-based practice: The case of fibromyalgia. Humanities and Social Sciences Communications, 8(1), 1–6. https://doi.org/10.1057/s41599-021-00918-3
Hogenboom, J., Lobo Gomes, A., Dekker, A., Van Der Graaf, W., Husson, O., & Wee, L. (2024). Actionability of Synthetic Data in a Heterogeneous and Rare Health Care Demographic: Adolescents and Young Adults With Cancer. JCO Clinical Cancer Informatics, 8, e2400056. https://doi.org/10.1200/CCI.23.00056
Isangula, K. G. (2025). Navigating Barriers: Challenges and Strategies for Adopting Artificial Intelligence in Qualitative Research in Low-Income African Contexts. Tanzania Journal of Health Research, 25(3), 2048–2059. https://doi.org/10.4314/thrb.v26i3.14
Jacobs, F., D’Amico, S., Benvenuti, C., Gaudio, M., Saltalamacchia, G., Miggiano, C., & Zambelli, A. (2023). Opportunities and challenges of synthetic data generation in oncology. JCO Clinical Cancer Informatics, 7, e2300045. https://doi.org/10.1200/CCI.23.00045
Jin, Y., Chandra, M., Verma, G., Hu, Y., De Choudhury, M., & Kumar, S. (2024). Better to ask in english: Cross-lingual evaluation of large language models for healthcare queries. Proceedings of the ACM Web Conference 2024, 2627–2638.
Kapania, S., Agnew, W., Eslami, M., Heidari, H., & Fox, S. (2024). “Simulacrum of Stories”: Examining Large Language Models as Qualitative Research Participants. ArXiv Preprint ArXiv:2409.19430.
Katz, A., Fleming, G. C., & Main, J. (2024). Thematic Analysis with Open-Source Generative AI and Machine Learning: A New Method for Inductive Qualitative Codebook Development.
Khalife, J., Ekman, B., Ammar, W., El-Jardali, F., Al Halabi, A., Barakat, E., & Emmelin, M. (2023). Exploring patient perspectives: A qualitative inquiry into healthcare perceptions, experiences and satisfaction in Lebanon. PLoS One, 18(8), e0280665. https://doi.org/10.1371/journal.pone.0280665
Kim, S., Fields, N., & Roye, J. (2024). Empowering Dementia Communication via Virtual Reality AI-Driven Simulations. Proceedings of the AAAI Symposium Series, 4(1), 163–167.
Kumar, A. (2024). The Role of Synthetic Data in Advancing AI Models: Opportunities, Challenges, and Ethical Considerations. Journal of Artificial Intelligence General Science (JAIGS), 5(1), 443–459.
Lee, Y., Chang, C. H., & Yang, C. C. (2025). Enhancing Patient-Physician Communication: Simulating African American Vernacular English in Medical Diagnostics with Large Language Models. Journal of Healthcare Informatics Research, 1–35.
Lewis, M. E., Hartwell, E. E., & Myhra, L. L. (2018). Decolonizing mental health services for indigenous clients: A training program for mental health professionals. American Journal of Community Psychology, 62(3–4), 330–339. https://doi.org/10.1002/ajcp.12281
Lin, I. W., Njoo, L., Field, A., Sharma, A., Reinecke, K., Althoff, T., & Tsvetkov, Y. (2022). Gendered mental health stigma in masked language models. ArXiv Preprint ArXiv:2210.15144.
Liu, F., Cheng, Z., Chen, H., Wei, Y., Nie, L., & Kankanhalli, M. (2022). Privacy-preserving synthetic data generation for recommendation systems. Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 1379–1389. https://doi.org/10.1145/3477495.3532044
Markham, A., & Tiidenberg, K. (2019). Metaphors of Internet: Ways of being in the age of ubiquity. In Nordic Journal of Art and Research. https://doi.org/10.23865/noasp.74.ch3
Mendes, J. M., Barbar, A., & Refaie, M. (2025). Synthetic data generation: a privacy-preserving approach to accelerate rare disease research. Frontiers in Digital Health, 7, 1563991. https://doi.org/10.3389/fdgth.2025.1563991
Mori, S., Ignat, O., Lee, A., & Mihalcea, R. (2024). Towards algorithmic fidelity: mental health representation across demographics in synthetic vs. human-generated data. https://doi.org/10.48550/arXiv.2403.16909
Mozersky, J., McIntosh, T., Walsh, H. A., Parsons, M. V, Goodman, M., & DuBois, J. M. (2021). Barriers and facilitators to qualitative data sharing in the United States: A survey of qualitative researchers. PLoS One, 16(12), e0261719. https://doi.org/10.1371/journal.pone.0261719
Murphy, K., Di Ruggiero, E., Upshur, R., Willison, D. J., Malhotra, N., Cai, J. C., ..., & Gibson, J. (2021). Artificial intelligence for good health: a scoping review of the ethics literature. BMC Medical Ethics, 22, 1–17. https://doi.org/10.1186/s12910-021-00577-8
Natarajan, S. A., & Madden, M. G. (2023). Hybrid synthetic data generation pipeline that outperforms real data. Journal of Electronic Imaging, 32(2), 23011. https://doi.org/10.1117/1.JEI.32.2.023011
Okon, E., Rachakonda, V., Hong, H. J., Callison-Burch, C., & Lipoff, J. B. (2020). Natural language processing of Reddit data to evaluate dermatology patient experiences and therapeutics. Journal of the American Academy of Dermatology, 83(3), 803–808. https://doi.org/10.1016/j.jaad.2020.03.089
Omar, M., Soffer, S., Agbareia, R., Bragazzi, N. L., Apakama, D. U., Horowitz, C. R., & Klang, E. (2024). Socio-demographic biases in medical decision-making by large language models: a large-scale multi-model analysis. MedRxiv, 2024(10).
Ostherr, K. (2022). Artificial intelligence and medical humanities. Journal of Medical Humanities, 43(2), 211–232. https://doi.org/10.1007/s10912-020-09636-4
Paik, K. E., Hicklen, R., Kaggwa, F., Puyat, C. V, Nakayama, L. F., Ong, B. A., & Villanueva, C. (2023). Digital Determinants of Health: Health data poverty amplifies existing health disparities—A scoping review. PLOS Digital Health, 2(10), e0000313. https://doi.org/10.1371/journal.pdig.0000313
Pezoulas, V. C., Zaridis, D. I., Mylona, E., Androutsos, C., Apostolidis, K., Tachos, N. S., & Fotiadis, D. I. (2024). Synthetic data generation methods in healthcare: A review on open-source tools and methods. Computational and Structural Biotechnology Journal. https://doi.org/10.1016/j.csbj.2024.07.005
Pinto, A., Santos, C., Aguiar, R., Oliveira, S., Cunha, D., & Aguiar, A. R. S. (2025). The Use of Artificial Intelligence in Palliative Care Communication: A Narrative Review. Cureus, 17(3). https://doi.org/10.7759/cureus.349058
Plaza-del-Arco, F. M., Curry, A. C., Curry, A., Abercrombie, G., & Hovy, D. (2024). Angry men, sad women: Large language models reflect gendered stereotypes in emotion attribution. ArXiv Preprint ArXiv:2403.03121.
Plemons, A. M., & Spiros, M. C. (2025). Toward Ethical Digital Practices: Guidelines for Consent, Accountability, and Transparency in Anthropology. American Journal of Biological Anthropology, 186(4), e70044.
Qian, Z., Callender, T., Cebere, B., Janes, S. M., Navani, N., & van der Schaar, M. (2024). Synthetic data for privacy-preserving clinical risk prediction. Scientific Reports, 14(1), 25676. https://doi.org/10.1038/s41598-024-72894-y
Qiao, S., Fang, X., Garrett, C., Zhang, R., Li, X., & Kang, Y. (2024). Generative AI for Qualitative Analysis in a Maternal Health Study: Coding In-depth Interviews using Large Language Models (LLMs). MedRxiv.
Raab, G. M., McCall, S., & Cavin, L. (2025). Four checks for low-fidelity synthetic data: recommendations for disclosure control and quality evaluation. ArXiv Preprint ArXiv:2503.14211.
Ramachandranpillai, R., Sikder, M. F., Bergström, D., & Heintz, F. (2024). Bt-gan: Generating fair synthetic healthdata via bias-transforming generative adversarial networks. Journal of Artificial Intelligence Research, 79, 1313–1341. https://doi.org/10.1613/jair.1.14147
Richard, B., Sivo, S. A., Ford, R. C., Murphy, J., Boote, D. N., Witta, E. L., & Orlowski, M. (2021). A guide to conducting online focus groups via Reddit. International Journal of Qualitative Methods, 20, 16094069211012216.
Schroeder, H., Aubin Le Qu’er’e, M., Randazzo, C., Mimno, D., & Schoenebeck, S. (2024). Large language models in qualitative research: Can we do the data justice?
Shahul Hameed, M. A., Qureshi, A. M., & Kaushik, A. (2024). Bias mitigation via synthetic data generation: A review. Electronics, 13(19), 3909. https://doi.org/10.3390/electronics13193909
Sinclaire, M., Lavallee, B., Cyr, M., & Schultz, A. (2023). Indigenous peoples and type 2 diabetes: a discussion of colonial wounds and epistemic racism. Canadian Journal of Diabetes, 47(5), 451–454. https://doi.org/10.1016/j.jcjd.2023.01.005
Søltoft, J. I., Kocksch, L., & Munk, A. K. (2024). Synthetic Interlocutors. Experiments with Generative AI to Prolong Ethnographic Encounters. ArXiv Preprint ArXiv:2410.11395. https://doi.org/10.48550/arXiv.2410.11395
Sun, L., Wei, M., Sun, Y., Suh, Y. J., Shen, L., & Yang, S. (2024). Smiling women pitching down: auditing representational and presentational gender biases in image-generative AI. Journal of Computer-Mediated Communication, 29(1), zmad045. https://doi.org/10.1093/jcmc/zmad045
Tan, G. L., Ty, A. P., Ng, S., Co, D. A., Cruz, J. C. B., & Cheng, C. (2022). Using Synthetic Data for Conversational Response Generation in Low-resource Settings. ArXiv Preprint ArXiv:2204.02653.
Teutloff, J. K. (2025). Founders’ Perceptions About Using AI-Generated Synthetic Data for Customer Validation in Early-Stage Technology Startups. Marymount University.
Timpone, R., & Yang, Y. (2024). Artificial data, real insights: Evaluating opportunities and risks of expanding the data ecosystem with synthetic data. ArXiv Preprint ArXiv:2408.15260.
Tiwald, P., Ebert, A., & Soukup, D. T. (2021). Representative & fair synthetic data.
Übellacker, T. (2024). AcademiaOS: Automating Grounded Theory Development in Qualitative Research with Large Language Models. ArXiv Preprint ArXiv:2403.08844. https://doi.org/10.48550/arXiv.2403.08844
Vaiste, J. (2023). Ethical implications of AI-generated synthetic health data. Unpublished Manuscript.
Vallevik, V. B., Babic, A., Marshall, S. E., Elvatun, S., Brøgger, H. M., Alagaratnam, S., & others. (2024). Can I trust my fake data–a comprehensive quality assessment framework for synthetic tabular data in healthcare. International Journal of Medical Informatics, 185, 105413. https://doi.org/10.1016/j.ijmedinf.2024.105413
Wagner, J. K., Cabrera, L. Y., Gerke, S., & Susser, D. (2024). Synthetic data and ELSI-focused computational checklists—A survey of biomedical professionals’ views. PLOS Digital Health, 3(11), e0000666. https://doi.org/10.1371/journal.pdig.0000666
Wang, Q., Erqsous, M., Barner, K. E., & Maurello, M. L. (2025). LATA: A Pilot Study on LLM-Assisted Thematic Analysis of Online Social Network Data Generation Experiences.
Wirth, F. N., Meurers, T., Johns, M., & Prasser, F. (2021). Privacy-preserving data sharing infrastructures for medical research: systematization and comparison. BMC Medical Informatics and Decision Making, 21, 1–13. https://doi.org/10.1186/s12911-021-01602-x
Wongvibulsin, S., Martin, S. S., Saria, S., Zeger, S. L., & Murphy, S. A. (2020). An individualized, data-driven digital approach for precision behavior change. American Journal of Lifestyle Medicine, 14(3), 289–293. https://doi.org/10.1177/1559827619843489
Wyllie, S., Shumailov, I., & Papernot, N. (2024). Fairness feedback loops: training on synthetic data amplifies bias. Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, 2113–2147. https://doi.org/10.1145/3611643.3656831
Xafis, V., Schaefer, G. O., Labude, M. K., Brassington, I., Ballantyne, A., Lim, H. Y., & Tai, E. S. (2019). An ethics framework for big data in health and research. Asian Bioethics Review, 11(3), 227–254. https://doi.org/10.1007/s41649-019-00099-x
Xu, W., Saxon, M., Sra, M., & Wang, W. Y. (2022). Self-supervised knowledge assimilation for expert-layman text style transfer. Proceedings of the AAAI Conference on Artificial Intelligence, 36(10), 11566–11574.
Zhang, H., Wu, C., Xie, J., Cai, J., & Carroll, J. M. (2025). Harnessing the Power of AI in Qualitative Research: Exploring, Using and Redesigning ChatGPT. Computers in Human Behavior: Artificial Humans, 100144. https://doi.org/10.1016/j.chbah.2025.100144
Published
How to Cite
Issue
Section
Copyright (c) 2025 Loso Judijanto
This work is licensed under a Creative Commons Attribution 4.0 International License.
