Surveys

Survey Methodology

Michigan Physician Survey Methods

Since 2012, CHRT has surveyed Michigan physicians approximately every two years to learn more about their experiences practicing in the state.  The following sections provide a more detailed description of the methodology employed for each wave of the Michigan Physician Survey. Given the sampling methods used in the physician surveys, some respondents may have been included in multiple survey years; because of the de-identified nature of responses, it is not possible to identify physicians who responded to more than one survey.

  • Physician Survey 2021: The survey was conducted online between April and May 2021 using the survey platform Qualtrics. The sample for the survey consisted of 26,644 licensed Michigan physicians identified through the “Medicine” and “Osteopathic” Licensing and Regulatory Affairs (LARA) datasets. The datasets were downloaded in February 2021. To be included in the sample, physicians had to be practicing in Michigan and have a valid email address. Unlike in previous waves of the Physicians Survey, both primary care and specialty care physicians were invited to participate in the survey. The final sample included 2,188 licensed physicians. The survey had a response rate of 8% and has a margin of error of ±2.0 percent. To adjust for non-response, the final sample was weighted by the region in which the physician practices, as well as years in practice.
  • Physician Survey 2018: The survey was conducted between August and December 2018 and included a sample of 1,800 primary care physicians in Michigan. The sample was composed of a random statewide sample of 1,500 physicians and a rural oversample of 300 physicians. Rural was defined as Micropolitan and Noncore counties according to the 2013 NCHS Urban-Rural Classification Scheme for Counties. Potential respondents received up to three mailings, with $10 included in the first mailing to encourage response. The mailing included information on how to complete the survey online in Qualtrics, rather than by hard copy, if respondents preferred this option. Both surveys returned by mail and online were merged to create a final data file. The final sample included physicians from two primary care specialties: family medicine and internal medicine. The survey had a response rate of 42 percent and has a margin of error of ±4.0 percent. There were 588 physicians in the final analytic sample. To account for the oversample, results for the 2018 survey are weighted on urban/rural classification and specialty.
  • Physician Survey 2016: The survey was conducted between July 2016 and October 2016 and included a sample of 1,500 primary care physicians practicing in Michigan. The physician sample was randomly generated from the American Medical Association (AMA) Physician Masterfile, a comprehensive list that includes both AMA members and non-members. Potential respondents received up to three mailings, with $10 included in the first mailing to encourage response. The mailing included information on how to complete the survey online via Qualtrics, rather than by hard copy, if respondents preferred this option. Both surveys returned by mail and online were merged to create a final data file. The final sample included physicians from two primary care specialties: family medicine and internal medicine. The survey had a response rate of 47 percent and has a margin of error of ±2.5 percent. There were 603 physicians in the final analytic sample.
  • Physician Survey 2014: The survey was conducted between December 2013 and April 2014 and included a sample of 1,000 primary care physicians practicing in Michigan. The physician sample was randomly generated from the American Medical Association (AMA) Physician Masterfile, a comprehensive list that includes both AMA members and non-members. Potential respondents received up to three mailings, with $5 included in the first mailing to encourage response. The final sample included physicians from two primary care specialties: family medicine and internal medicine. The survey had a response rate of 36 percent and has a margin of error of ±5.5 percent. There were 317 physicians in the final analytic sample. Physicians who reported that they were unsure whether they participated in an innovative compensation model or that they were not participating at the time of the survey but planned to do so in the future were considered as non-participants for the purpose of this analysis.
  • Physician Survey 2012: The survey was conducted between October 2012 and December 2012 and included a sample of 1,500 primary care physicians practicing in Michigan. The physician sample was randomly generated from the American Medical Association (AMA) Physician Masterfile, a comprehensive list that includes both AMA members and non-members. Potential respondents received up to two mailings, with $5 included in the first mailing to encourage response. The final sample included 500 physicians each from three primary care specialties: pediatrics, family medicine and internal medicine. The survey had an overall response rate of 54 percent and has a margin of error of ±3 percent. There were 714 physicians in the final analytic sample. Final results were weighted to adjust for non-response in each of the three primary care specialty groups.

Cover Michigan Survey Methods

The survey data presented in CHRT’s Cover Michigan Survey briefs were produced from a series of survey questions added to the Michigan State University Institute for Public Policy and Social Research (IPPSR) quarterly State of the State Survey (SOSS). Conducted two to four times per year, SOSS is a public opinion telephone and online survey (read about the methodology) that includes a stratified random sample of Michigan adults aged 18 years and older. All surveys excluding Cover Michigan 2010 include cell phones.

  • Cover Michigan Survey 2021 (Wave 2): The survey was fielded between December 17th, 2021 to December 31st, 2021 and included a sample of 1,351 Michigan adults who were then matched down to a sample of 1,000 to produce the final dataset. The response rate was 53.3%.
  • Cover Michigan Survey 2021 (Wave 1):  The survey was fielded between March 19, 2021 to April 1, 2021 and included a sample of 1,222 Michigan adults who were then matched down to a sample of 1,000 to produce the final dataset. The margin of error for the entire sample was ±4.01 percent with design effects.
  • Cover Michigan Survey 2020 (Wave 2): The survey was fielded between May 8th, 2020 to May 25th, 2020 and included a sample of 1,086 Michigan adults who were then matched down to a sample of 1,000 to produce the final dataset. The margin of error for the entire sample was ± 4.05 percent with design effects.
  • Cover Michigan Survey 2020 (Wave 1): The survey was fielded between February 7th, 2020 to February 26th, 2020 and included a sample of 1,000 Michigan adults. The margin of error for the entire sample was ±4.12 percent with design effects.

SOSS has been run as an RDD telephone survey from 1994 – 2020. Since 2020, it began running as a YouGov web panel survey. 

  • Cover Michigan Survey 2018: The survey was fielded between February and May 2018 and included a sample of 948 Michigan adults, with a 16.7 percent response rate. The margin of error for the entire sample was ±4.0 percent with design effects.
  • Cover Michigan Survey 2015: The survey was fielded between October and December 2015 and included a sample of 972 Michigan adults, with a 17.0 percent response rate. The margin of error for the entire sample was ±3.9 percent with design effects.
  • Cover Michigan Survey 2014: This survey was fielded between September and November 2014 and included a sample of 1,002 Michigan adults with a 20.2 percent response rate. The margin of error for the entire sample was ±3.9 percent with design effects.
  • Cover Michigan Survey 2012: This survey was fielded between August and October 2012 and included a sample of 1,018 Michigan adults, with a 31.6 percent response rate. The margin of error for the entire sample was ±6.5 percent with design effects.
  • Cover Michigan Survey 2010: This survey was fielded between October and December 2010 and included a sample of 1,000 Michigan adults, with a 35.6 percent response rate. The margin of error for the entire sample was +/-3.1 percent with design effects.

For analytical purposes, survey data were weighted to adjust for the unequal probabilities of selection for each stratum of the survey sample (for example, region of the state, listed vs. unlisted telephones). Additionally, data were weighted to adjust for non-response based on age, gender, and race (read about demographic and socio-economic characteristics of Cover Michigan samples), according to population distributions from the American Community Survey data for survey years 2009-2013, 2012-2016, and 2018. Respondents who reported both Medicare and Medicaid coverage were considered Medicaid recipients for the purpose of this analysis. Results were analyzed using the most recent versions of SAS and SPSS software commercially available at the time of the publication of the brief. Statistical significance of bivariate relationships was tested using z tests, odds ratio tests, or chi-square tests. Unless otherwise noted, all results reported were statistically significant at the p < 0.05 level.