Integrating Users’ Perceptions to Identify Features Indicating the Quality of Cancer-Related Podcasts Provided by Non-Profit Cancer Organisations

Basma Badreddine; Yvette  Blount; Alireza Amrollahi

doi:10.3127/ajis.v27i0.4435

Authors

Basma Badreddine Macquarie Business School, Sydney, Australia
Yvette Blount Deakin University, Melbourne, Australia
Alireza Amrollahi Macquarie Business School, Sydney, Australia

DOI:

https://doi.org/10.3127/ajis.v27i0.4435

Keywords:

Cancer Podcasts, Information Systems’ Quality, Content, Credibility, Design, Reception Theory

Abstract

While cancer podcasts are valuable for support and information, there is a significant gap in understanding their quality features from users’ perspectives. Understanding quality features from users’ perspectives is important to ensure that cancer-affected people receive the support they need. This study addresses this gap by combining multiple theoretical perspectives: a. the IQ assessment framework, source credibility theory, two-factor theory of website design to assess the quality of podcasts, and b. reception theory to highlight listeners’ perception of quality. These perspectives, together, enrich the concept of information systems quality and provide a comprehensive understanding of podcasts’ quality. Through semi-structured interviews with 17 cancer-affected individuals, the research found that credibility, content, and design were essential quality features, with the visual appearance serving as a motivational factor. The integration of Reception Theory highlights users’ active role in shaping quality perceptions, offering new insights into the effective design of cancer-related podcasts. This novel approach bridges a critical research gap, illuminating the complex interplay of technical and human factors in assessing podcast quality from the perspective of users.

References

Almutiry, O., Wills, G., Alwabel, A., Crowder, R., & WaIters, R. (2013). Toward a framework for data quality in cloud-based health information system. International Conference on Information Society (i-Society 2013). IEEE.

https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6636362

Arif, N., & Ghezzi, P. (2018). Quality of online information on breast cancer treatment options. The Breast, 37, 6-12. https://doi.org/10.1016/j.breast.2017.10.004

Back, D. A., von Malotky, J., Sostmann, K., Hube, R., Peters, H., & Hoff, E. (2017). Superior gain in knowledge by podcasts versus text-based learning in teaching orthopedics: a randomized controlled trial. Journal of Surgical Education, 74(1), 154-160. https://doi.org/10.1016/j.jsurg.2016.07.008

Badreddine, B., Blount, Y., & Amrollahi, A. (2023). Quality Indicators of Online Cancer Communities from the Perspective of Cancer-Affected People. Proceedings of the 56th Hawaii International Conference on System Sciences. Maui, HI, USA, January 3-6, 2023. https://hdl.handle.net/10125/103042

Bates, B. R., Romina, S. M., & Ahmed, R. (2007). The effect of improved readability scores on consumers’ perceptions of the quality of health information on the internet. Journal of Cancer Education, 22(1), 15. https://doi.org/10.1007/BF03174369

Berk, J., Trivedi, S. P., Watto, M., Williams, P., & Centor, R. (2020). Medical Education Podcasts: Where We Are and Questions Unanswered. Journal of General Internal Medicine, 1-3. https://doi.org/10.1007/s11606-019-05606-2

Bernstam, E. V., Walji, M. F., Sagaram, S., Sagaram, D., Johnson, C. W., & Meric‐Bernstam, F. (2008). Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer. Cancer: Interdisciplinary International Journal of the American Cancer Society, 112(6), 1206-1213. https://doi.org/10.1002/cncr.23308

Boling, K. S. (2022). “It’s that ‘There but for the Grace of God Go I’Piece of It”: Domestic Violence Survivors in True Crime Podcast Audiences. Mass Communication and Society, 26(6), 1-23. https://www.tandfonline.com/doi/full/10.1080/15205436.2022.2061359

Bolle, S., Romijn, G., Smets, E. M., Loos, E. F., Kunneman, M., & van Weert, J. C. (2016). Older cancer patients’ user experiences with web-based health information tools: a think-aloud study. Journal of Medical Internet Research, 18(7), e208. https://doi.org/10.2196/jmir.5618

Boon-itt, S. (2019). Quality of health websites and their influence on perceived usefulness, trust and intention to use: an analysis from Thailand. Journal of Innovation and Entrepreneurship, 8(1), 4. https://doi.org/10.1186/s13731-018-0100-9

Brower, S. M. (2004). Academic health sciences library Website navigation: an analysis of forty-one Websites and their navigation tools. Journal of the Medical Library Association, 92(4), 412. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC521512/

Bruce, J. G., Tucholka, J. L., Steffens, N. M., & Neuman, H. B. (2015). Quality of online information to support patient decision‐making in breast cancer surgery. Journal of Surgical Oncology, 112(6), 575-580. https://doi.org/10.1002/jso.24046

Butina, M. (2015). A narrative approach to qualitative inquiry. Clinical Laboratory Science, 28(3), 190-196. https://doi.org/10.29074/ascls.28.3.190

Chang, K., Berthelet, E., Grubbs, E., Hamilton, S., Karvat, A., Tran, E., . . . Ingledew, P.-A. (2019). Websites, Websites Everywhere: How Thyroid Cancer Patients Use the Internet. Journal of Cancer Education, 35, 1-7. https://doi.org/10.1007/s13187-019-01576-5

Chen, C.-M. (2020). Public health messages about COVID-19 prevention in multilingual Taiwan. Multilingua, 39(5), 597-606.

Choi, W. (2015). A New Framework of Web Credibility Assessment and an Exploratory Study of Older Adults' Information Behavior on the Web. Doctoral Thesis, Florida State University, FL, USA. https://diginole.lib.fsu.edu/islandora/object/fsu%3A253213

De Groot, L., Harris, I., Regehr, G., Tekian, A., & Ingledew, P.-A. (2017). Quality of online resources for pancreatic cancer patients. Journal of Cancer Education, 34(2), 223-228. https://doi.org/10.1007/s13187-017-1290-8

Doubleday, A. R., Novin, S., Long, K. L., Schneider, D. F., Sippel, R. S., & Pitt, S. C. (2020). Online information for treatment for low-risk thyroid cancer: assessment of timeliness, content, quality, and readability. Journal of Cancer Education, 36, 1-8. https://doi.org/10.1007/s13187-020-01713-5

Dubowicz, A., & Schulz, P. J. (2015). Medical information on the internet: a tool for measuring consumer perception of quality aspects. Interactive Journal of Medical Research, 4(1), e8. https://doi.org/10.2196/ijmr.3144

Dutta-Bergman, M. J. (2004). The impact of completeness and web use motivation on the credibility of e-health information. Journal of Communication, 54(2), 253-269. https://doi.org/10.1111/j.1460-2466.2004.tb02627.x

Fadahunsi, K. P., Akinlua, J. T., O’Connor, S., Wark, P. A., Gallagher, J., Carroll, C., . . . O’Donoghue, J. (2019). Protocol for a systematic review and qualitative synthesis of information quality frameworks in eHealth. BMJ open, 9(3), e024722. https://doi.org/10.1136/bmjopen-2018-024722

Faller, H., Brähler, E., Härter, M., Keller, M., Schulz, H., Wegscheider, K., . . . Richard, M. (2017). Unmet needs for information and psychosocial support in relation to quality of life and emotional distress: A comparison between gynecological and breast cancer patients. Patient education and counseling, 100(10), 1934-1942.

https://doi.org/10.1016/j.pec.2017.05.031

Francis, J. J., Johnston, M., Robertson, C., Glidewell, L., Entwistle, V., Eccles, M. P., & Grimshaw, J. M. (2010). What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychology and Health, 25(10), 1229-1245. https://doi.org/10.1080/08870440903194015

Gandamihardja, T. A., Liyanage, S., Coutee, T., Peled, A. W., & Masannat, Y. A. (2023). The Role of Social Media and Breast Cancer: How does it impact patients? Breast Care, 18(3), 203-208. https://doi.org/10.1159/000530433

Gopal, D. P. (2019). Why I prescribe podcasts to my patients. British Journal of General Practice, 69(689), 621-621. https://doi.org/10.3399/bjgp19X707009

Grock, A., Joshi, N., Swaminathan, A., Rezaie, S., Gaafary, C., & Lin, M. (2016). Blog and podcast watch: neurologic emergencies. Western Journal of Emergency Medicine, 17(6), 726. https://doi.org/10.5811/westjem.2016.9.31010

Hajli, M. N., Sims, J., Featherman, M., & Love, P. E. (2015). Credibility of information in online communities. Journal of Strategic Marketing, 23(3), 238-253.

https://doi.org/10.1080/0965254X.2014.920904

Hall, S. (2007). Encoding and decoding in the television discourse. In A. Gray, J. Campbell, M. Erickson, S. Hanson, & H. Wood (Eds.) CCCS stencilled occasionalpapers (1st ed., vol. 2, pp. 386-398). Milton Park, UK: Routledge. http://epapers.bham.ac.uk/2962/

Hamzehei, R., Ansari, M., Rahmatizadeh, S., & Valizadeh-Haghi, S. (2018). Websites as a tool for public health education: determining the trustworthiness of health websites on Ebola disease. Online Journal of Public Health Informatics, 10(3).

https://doi.org/10.5210%2Fojphi.v10i3.9544

Hargreaves, S., Bath, P. A., Duffin, S., & Ellis, J. (2018). Sharing and Empathy in Digital Spaces: Qualitative Study of Online Health Forums for Breast Cancer and Motor Neuron Disease (Amyotrophic Lateral Sclerosis). Journal of Medical Internet Research, 20(6). https://doi.org/10.2196/jmir.9709

Heymach, J., Krilov, L., Alberg, A., Baxter, N., Chang, S. M., Corcoran, R. B., . . . Dreicer, R. (2018). Clinical cancer advances 2018: annual report on progress against cancer from the American Society of Clinical Oncology. Journal of Clinical Oncology, 36(10), 1020-1044. https://doi.org/10.1200/JCO.2017.77.0446

Holub, R. C. (2013). Reception Theory. Milton Park, UK: Routledge.

Hooda, A., Gupta, P., Jeyaraj, A., & Dwivedi, Y. (2023). Clarifying the role of e-government trust in e-government success models: a meta-analytic structural equation modeling approach. Australasian Journal of Information Systems, 27, 1-22.

https://doi.org/10.3127/ajis.v27i0.4079

Hovland, C. I., & Weiss, W. (1951). The influence of source credibility on communication effectiveness. Public Opinion Quarterly, 15(4), 635-650. https://doi.org/10.1086/266350

Huber, J., Maatz, P., Muck, T., Keck, B., Friederich, H.-C., Herzog, W., & Ihrig, A. (2017). The effect of an online support group on patients׳ treatment decisions for localized prostate cancer: an online survey. Urologic Oncology: Seminars and Original Investigations, 35(2), 37. e19-37. e28. https://doi.org/10.1016/j.urolonc.2016.09.010

Islam, J. U., & Rahman, Z. (2017). The impact of online brand community characteristics on customer engagement: An application of Stimulus-Organism-Response paradigm. Telematics and Informatics, 34(4), 96-109. https://doi.org/10.1016/j.tele.2017.01.004

Jung, E. H., Walsh-Childers, K., & Kim, H.-S. (2016). Factors influencing the perceived credibility of diet-nutrition information web sites. Computers in Human Behavior, 58, 37-47. https://doi.org/10.1016/j.chb.2015.11.044

Kanthawala, S., Vermeesch, A., Given, B., & Huh, J. (2016). Answers to health questions: Internet search results versus online health community responses. Journal of Medical Internet Research, 18(4), e95. https://doi.org/10.2196/jmir.5369

Khan, I., Loh, J., Saleh, A., Quazi, A., & Talukder, M. (2021). Effect of barrier related factors on perceived usefulness and ease of use of social media applications in the Australian healthcare sector. Australasian Journal of Information Systems, 25. https://doi.org/10.3127/ajis.v25i0.2625

Kim, H.-S., & Mrotek, A. (2016). A functional and structural diagnosis of online health communities sustainability: A focus on resource richness and site design features. Computers in Human Behavior, 63, 362-372. https://doi.org/10.1016/j.chb.2016.05.004

Kitamura, C. (2021). The Life and Times of the Berlin Secession Podcast. Master thesis, Lindenwood University, St. Chares, MO, USA.

https://digitalcommons.lindenwood.edu/theses/7/

Koo, C., Wati, Y., Park, K., & Lim, M. K. (2011). Website quality, expectation, confirmation, and end user satisfaction: the knowledge-intensive website of the Korean National Cancer Information Center. Journal of Medical Internet Research, 13(4), e81. https://doi.org/10.2196/jmir.1574

Laranjeiro, N., Soydemir, S. N., & Bernardino, J. (2015). A survey on data quality: classifying poor data. 2015 IEEE 21st Pacific Rim International Symposium on Dependable Computing (PRDC. Zhangjiajie, China, November 18-20, 2015.

https://ieeexplore.ieee.org/document/7371861

Leung, L. (2008). Internet embeddedness: links with online health information seeking, expectancy value/quality of health information websites, and Internet usage patterns. Cyberpsychology & Behavior, 11(5), 565-569. https://doi.org/10.1089/cpb.2007.0189

Li, Y., Wang, X., Lin, X., & Hajli, M. (2018). Seeking and sharing health information on social media: A net valence model and cross-cultural comparison. Technological Forecasting and Social Change, 126, 28-40. https://doi.org/10.1016/j.techfore.2016.07.021

Liaw, S.-T., Rahimi, A., Ray, P., Taggart, J., Dennis, S., de Lusignan, S., . . . Talaei-Khoei, A. (2013). Towards an ontology for data quality in integrated chronic disease management: a realist review of the literature. International Journal of Medical Informatics, 82(1), 10-24. https://doi.org/10.1016/j.ijmedinf.2012.10.001

Lin, M., Thoma, B., Trueger, N. S., Ankel, F., Sherbino, J., & Chan, T. (2015). Quality indicators for blogs and podcasts used in medical education: modified Delphi consensus recommendations by an international cohort of health professions educators. Postgraduate Medical Journal, 91(1080), 546-550. https://doi.org/10.1136/postgradmedj-2014-133230

Lleras de Frutos, M., Casellas‐Grau, A., Sumalla, E. C., de Gracia, M., Borràs, J. M., & Ochoa Arnedo, C. (2020). A systematic and comprehensive review of internet use in cancer patients: Psychological factors. Psycho‐Oncology, 29(1), 6-16. https://doi.org/10.1002/pon.5194

Lowry, P. B., Wilson, D. W., & Haig, W. L. (2014). A picture is worth a thousand words: Source credibility theory applied to logo and website design for heightened credibility and consumer trust. International Journal of Human-Computer Interaction, 30(1), 63-93. https://doi.org/10.1080/10447318.2013.839899

Lynch, N. P., Lang, B., Angelov, S., McGarrigle, S. A., Boyle, T. J., Al-Azawi, D., & Connolly, E. M. (2017). Breast reconstruction post mastectomy-Let's Google it. Accessibility, readability and quality of online information. The Breast, 32, 126-129.

https://doi.org/10.1016/j.breast.2017.01.019

Ma, T. J., & Atkin, D. (2017). User generated content and credibility evaluation of online health information: a meta analytic study. Telematics and Informatics, 34(5), 472-486. https://doi.org/10.1016/j.tele.2016.09.009

Ma, Y. (2002). A design analysis model for developing World Wide Web sites. Journal of the American Society for Information Science and Technology, 53(7), 531-535.

https://doi.org/10.1002/asi.10074

McLeod, J., Yu, I., & Ingledew, P.-A. (2017). Peering into the deep: characterizing the internet search patterns of patients with gynecologic cancers. Journal of Cancer Education, 32(1), 85-90. https://doi.org/10.1007/s13187-016-1002-9

Miles, M. B., Huberman, A. M., & Saldana, J. (2014). Qualitative data analysis: A methods sourcebook. (3rd ed.). Thousand Oaks, CA, USA: Sage.

Mills, E., & Millward, H. (2019). Emotional Well-being for People with Cancer: A narrative review of charity sector resources and peer-reviewed articles for effects of complementary interventions.

https://eprints.lancs.ac.uk/id/eprint/139375/1/The_Landuu_Company_Emotional_Well_Being_Project_Report.pdf

Min, A. A., Morley, E. J., Rezaie, S. R., Fox, S. M., & Grock, A. (2018). Academic life in emergency medicine blog and podcast watch: respiratory emergencies. Cureus, 10(6), e2812. https://doi.org/10.7759/cureus.2812

Monton, O., Lambert, S., Belzile, E., & Mohr-Elzeki, D. (2019). An evaluation of the suitability, readability, quality, and usefulness of online resources for family caregivers of patients with cancer. Patient Education And Counseling, 102(10), 1892-1897.

https://doi.org/10.1016/j.pec.2019.05.010

Moshagen, M., & Thielsch, M. (2013). A short version of the visual aesthetics of websites inventory. Behaviour & Information Technology, 32(12), 1305-1311.

https://doi.org/10.1080/0144929X.2012.694910

Mun, Y. Y., Yoon, J. J., Davis, J. M., & Lee, T. (2013). Untangling the antecedents of initial trust in Web-based health information: The roles of argument quality, source expertise, and user perceptions of information quality and risk. Decision Support Systems, 55(1), 284-295. https://doi.org/10.1016/j.dss.2013.01.029

Nwosu, A. C., Monnery, D., Reid, V. L., & Chapman, L. (2017). Use of podcast technology to facilitate education, communication and dissemination in palliative care: the development of the AmiPal podcast. BMJ Supportive & Palliative Care, 7(2), 212-217. https://doi.org/10.1136/bmjspcare-2016-001140

Paterson, Q. S., Thoma, B., Milne, W. K., Lin, M., & Chan, T. M. (2015). A systematic review and qualitative analysis to determine quality indicators for health professions education blogs and podcasts. Journal of Graduate Medical Education, 7(4), 549-554.

https://doi.org/10.4300/JGME-D-14-00728.1

Pope, C., & Mays, N. (2019). Qualitative Research in Health Care. Hoboken, NJ, USA: John Wiley & Sons. https://doi.org/10.1002/9781119410867

Ractham, P., Techatassanasoontorn, A., & Kaewkitipong, L. (2022). Old but not out: Social media use and older adults' life satisfaction. Australasian Journal of Information Systems, 26. https://doi.org/10.3127/ajis.v26i0.3269

Rennick-Egglestone, S., Ramsay, A., McGranahan, R., Llewellyn-Beardsley, J., Hui, A., Pollock, K., . . . Roe, J. (2019). The impact of mental health recovery narratives on recipients experiencing mental health problems: qualitative analysis and change model. PLoS ONE, 14(12), e0226201. https://doi.org/10.1371/journal.pone.0226201

Riddell, J., Robins, L., Brown, A., Sherbino, J., Lin, M., & Ilgen, J. S. (2020). Independent and interwoven: A qualitative exploration of residents’ experiences with educational podcasts. Academic Medicine, 95(1), 89-96.

https://doi.org/10.1097/ACM.0000000000002984

Robertson-Lang, L., Major, S., & Hemming, H. (2011). An exploration of search patterns and credibility issues among older adults seeking online health information. Canadian Journal on Aging/La Revue Canadienne du Vieillissement, 30(4), 631-645.

https://doi.org/10.1017/S071498081100050X

Salaün, Y., & Flores, K. (2001). Information quality:: meeting the needs of the consumer. International Journal of Information Management, 21(1), 21-37.

Scott, C., Campbell, P., Nemirovsky, A., Loeb, S., & Malik, R. (2023). Prostate cancer and podcasts: an analysis and assessment of the quality of information about prostate cancer available on podcasts. Prostate Cancer and Prostatic Diseases, 1-2.

https://doi.org/10.1038/s41391-023-00694-y

Stvilia, B., Gasser, L., Twidale, M. B., & Smith, L. C. (2007). A framework for information quality assessment. Journal of the American Society for Information Science and Technology, 58(12), 1720-1733. https://doi.org/10.1002/asi.20652

Stvilia, B., Mon, L., & Yi, Y. J. (2009). A model for online consumer health information quality. Journal of the American Society for Information Science and Technology, 60(9), 1781-1791.

Thoma, B., Chan, T. M., Paterson, Q. S., Milne, W. K., Sanders, J. L., & Lin, M. (2015). Emergency medicine and critical care blogs and podcasts: establishing an international consensus on quality. Annals of Emergency Medicine, 66(4), 396-402. e394. https://doi.org/10.1016/j.annemergmed.2015.03.002

Wang, R. Y., & Strong, D. M. (1996). Beyond accuracy: What data quality means to data consumers. Journal of Management Information Systems, 12(4), 5-33.

https://doi.org/10.1080/07421222.1996.11518099

Whitten, P., Smith, S., Munday, S., & LaPlante, C. (2008). Communication assessment of the most frequented breast cancer websites: Evaluation of design and theoretical criteria. Journal of Computer-Mediated Communication, 13(4), 880-911.

https://doi.org/10.1111/j.1083-6101.2008.00423.x

Willis, I. (2021). Reception theory, reception history, reception studies. In Oxford Research Encyclopedia of Literature. Oxford, UK: Oxford University Press.

https://doi.org/10.1093/acrefore/9780190201098.013.1004

Win, K. T., Hassan, N. M., Oinas-Kukkonen, H., & Probst, Y. (2016). Online patient education for chronic disease management: consumer perspectives. Journal of MedicalSystems, 40(4), 88. https://doi.org/10.1007/s10916-016-0438-0

Yi, M., Kim, J., Noh, D.-Y., Lee, J.-L., Yoo, K.-Y., Hwang, K.-T., & Chung, H.-D. (2008). Evaluation of the satisfaction and usefulness of a web-based educational program for breast cancer patients. The Open Medical Informatics Journal, 2, 129.

https://doi.org/10.2174/1874431100802010129

Zaver, F., Hansen, M., Leibner, E., Little, A., & Lin, M. (2016). Blog and podcast watch: Pediatric emergency medicine. Western Journal of Emergency Medicine, 17(5), 513. https://doi.org/10.5811/westjem.2016.6.30193

Zhang, P., Small, R. V., Von Dran, G. M., & Barcellos, S. (2000). A two factor theory for website design. In Proceedings of the 33rd Annual Hawaii International Conference on System Sciences (pp. 10-pp). IEEE.

Zhang, P., & Von Dran, G. M. (2000). Satisfiers and dissatisfiers: A two‐factor model for website design and evaluation. Journal of the American Society for Information Science, 51(14), 1253-1268.

https://doi.org/10.1002/1097-4571(2000)9999:9999<::AID-ASI1039>3.0.CO;2-O

Zhang, Y., Sun, Y., & Xie, B. (2015). Quality of health information for consumers on the web: a systematic review of indicators, criteria, tools, and evaluation results. Journal of the Association for Information Science and Technology, 66(10), 2071-2084.

https://doi.org/10.1002/asi.23311

Zhang, Z. (2010). Feeling the sense of community in social networking usage. IEEE Transactions on Engineering Management, 57(2), 225-239. https://doi.org/10.1109/TEM.2009.2023455

Zhao, Y. C., Zhao, M., & Song, S. (2022). Online health information seeking behaviors among older adults: systematic scoping review. Journal of Medical Internet Research, 24(2), e34790. https://doi.org/10.2196/34790

Zheng, Y., Zhao, K., & Stylianou, A. (2013). The impacts of information quality and system quality on users' continuance intention in information-exchange virtual communities: An empirical investigation. Decision Support Systems, 56, 513-524.

https://doi.org/10.1016/j.dss.2012.11.008