Table 3

Quality appraisal evaluation scores for reviewed studies

AuthorType of studyResearch ethically carried out*Theoretical and practical importance of the research*Clarity and basis of research question or hypotheses†Appropriate- ness of sample selection†Extent to which methods were appropriate and rigorous‡Clarity and coherence of the research‡Appropriateness of data analysis and inferences made§Consideration given to establishing validity and reliability¶Overall
Anderson et al (2009)10 QUANTITATIVEHigh/mediumHighMediumMediumN/AN/AMediumN/AMedium
Asghari et al (2009)12 QUANTITATIVEMediumMediumMediumMediumN/AN/AMediumN/AMedium
Engel et al (2006)35 QUALITATIVEHigh/mediumHighHigh/mediumHigh/mediumMediumHighMediumHighHigh/medium
Ferrús et al (2016)41 QUALITATIVEMediumHighHigh/mediumMediumMediumMediumMediumHigh/mediumMedium
Ghalandarpoorattar et al (2012)14 QUANTITATIVELowHighMedium/lowMedium N/AN/ALown/aLow/medium
Harrison et al (2013)40 QUANTITATIVEHighHighHighHigh/medium N/AN/AHigh N/AHigh/medium
Harrison et al (2014)15 QUANTITATIVEHighHighHighHighN/AN/AHighN/AHigh
Joesten et al (2015)36 QUANTITATIVEHigh/mediumHighHighLow/mediumN/AN/AMediumN/AMedium
Loren et al (2008)13 QUANTITATIVEHighHighHighHighN/AN/AMediumN/AHigh/medium
Martinez and Lehmann (2013)11 QUANTITATIVEHigh/mediumHighHighMedium/highN/AN/AMedium/HighN/AHigh/medium
Martinez et al (2014)37 QUANTITATIVEHigh/mediumHighHigh/mediumHighN/AN/AHighN/AHigh/medium
May et al (2012)38 QUALITATIVEHighHighHighHighHigh/mediumHighHigh/mediumMediumHigh/medium
Mira et al (2015)42 QUANTITATIVEMediumHighHighHigh/mediumN/AN/AMediumN/AHigh/medium
Plews-Ogan et al (2016)39 MIXED METHODSHighHighHighHighHighHighHighHighHigh
Rinaldi et al (2016)49 QUALITATIVELow/mediumMedium/highMediumLowLow/medium LowMedium/HighLowLow/medium
Scott et al (2009)17 QUALITATIVEHighHighHigh/mediumMedium/highHighHighHighHigh/mediumHigh/medium
Ullstrom et al (2014)43 QUALITATIVEHigh/mediumHighHighHigh/mediumHighHighHighHighHigh/medium
Van Gerven et al a (2016)44 QUANTITATIVEHighHighHighHigh/mediumHighHighHighHighHigh/medium
Van Gerven et al b (2016)45 QUANTITATIVEHighHighHighHigh/mediumHighHighHighHighHigh/medium
  • *All studies (Cohen and Crabtree, 2008).33

  • †All studies (Briner and Denyer, 2012).32

  • ‡Qualitative studies (Briner and Denyer, 2012).32

  • §All studies (Briner and Denyer, 2012).32

  • ¶Quantitative studies (Spencer et al, 2003).34