Public Affairs 7574: Mixed Method Approaches for Policy-Related Research

Upon successful completion of this course, students will:

Appreciate the historical and contextual factors that motivate the use of mixed methods among contemporary researchers by…

• Describing the advantages and challenges of a taking a mixed methods approach, and
• Discussing the worldviews and theoretical lenses through which mixed methods work can be designed;
• Considering the influence of researcher positionality on study design and execution (A1: Assignment 1);

Understand how conceptual frameworks, academic theory, and study design typologies are used to inform and organize mixed methods research by…

• Comparing the structure and utility of various mixed methods design typologies,
• Constructing a framework of key concepts, constructs, or phenomena to be studied in a mixed methods proposal, and
• Selecting and justifying a study design for a mixed methods proposal (A2: Assignment 2);

Grasp the unique methodological procedures associated with the rigorous collection and use of quantitative and qualitative data by…

• Designing and refining a survey for the primary collection of quantitative, aka ‘quan’, data (A3: Assignment 3);
• Designing and refining an in-depth interview or focus group guide for the primary collection of qualitative, aka ‘qual’ data (A4: Assignment 4);
• Planning for the analysis of qual and quant data (A3 & A4);

Know how to integrate quantitative and qualitative methods into mixed methods research proposals for the study of policy-relevant questions by…

• Appraising the quality of mixed methods research studies, and
• Developing a comprehensive mixed methods research proposal for the study of a policy-relevant topic (A5: Assignment 5).

Carmen Postings: 60 points

Leading Discussion: 20 points

Assignment 1: Researcher Positionality: 20 points

Assignment 2: Study Design & Framework/Theory: 50 points

Assignment 3: Quantitative Methodological Memo: 50 points

Assignment 4: Qualitative Methodological Memo: 50 points

Assignment 5: Mixed Methods Research Proposal: 100 points

For each major assignment (Assignments 1-5), a written assignment prompt is available via the ‘Assignments’ tab in CarmenCanvas. The prompt includes a more detailed assignment description, rubric, due date and time, and mechanism for submission (spoiler: always CarmenCanvas). There will be an opportunity in class to ask clarifying questions. I am happy to accept assignments early in cases where the due date conflicts with other obligations. Late assignments are subject to an automatic deduction per the policy on page 8: 5 points per day late.

Carmen Postings (Post) – Every week, I will be start a discussion thread and prompt on Carmen for you to use in posting a brief reflection on the week’s reading(s) ahead of class. Your post need not exceed a paragraph. While there is no rubric for this activity, exceptionally brief posts and those submitted after the deadline will receive zero points. Posts must be made by Sunday at midnight so that discussion leader(s) have time to collate comments and questions for discussion. You will be exempt from posting during the week you lead discussion (see below). The goal of this activity is to promote individual reflection on the readings, including questions or concerns that emerged for you while reading (i.e., what doesn’t make sense to you?); consideration of how the content may apply to your study and scholarship in the longer-term; facilitate constructive class discussion; and allow a structured opportunity for you to provide feedback on the utility of assigned readings.

Leading Discussion – During our first class period, we will discuss and set a discussion leader schedule. Depending on course enrollment, 1-3 individuals will help to lead discussion each week. Discussion leaders will be charged with identifying one or more resources or examples to complement the required readings (5 pts), drawing connections between the resource, reading(s), and any relevant prior course content (5 pts), compiling and generating questions for class discussion (5 pts), and demonstrating effort to facilitate a meaningful class discussion (5 pts). No rubric will be provided. PowerPoint may be used, but is not required. Leaders are welcome to consult with me on your plans during office hours or a different, pre-arranged time. My goal here is to provide you with a structured and low stakes opportunity to engage more deeply with a subset of course content and to practice group discussion facilitation skills, which are an asset for qualitative data collection and the conduct of both 1:1 interviews and focus groups.

Assignment 1 (A1) – This assignment will involve writing a brief positionality statement outlining your identities in relation to your proposed subject of study. You will have complete autonomy over which aspects of your identity to divulge; this is meant to be a reflective activity and to serve as a foundation for your subsequent study design activities (e.g., to help you identify and be more cognizant of ‘blind spots’ you may have related to planned data collection activities).

Assignment 2 (A2) – This assignment is the first step toward the development of a complete mixed methods research proposal and is akin to a LOI (Letter of Interest) for a grant. It will involve preparing a brief overviewof your proposal, including the following components: 1) project title, background, and rationale; 2) Research objective and study aims (including at least one qualitative, one quantitative aim, and a ‘mixed methods’ aim); 3) a theoretical or conceptual framework that summarizes, visually, the key constructs that you are proposing to study and their relationship to one another; 4) study design, explained in the context of your stated aims; and 5) a brief discussion of the worldview(s) most in line with your proposed work.

Assignment 3 (A3) – For this assignment, you will draft a survey questionnaire to use for the collection of data to answer your “quantitative” research question. While there are other means of collecting quantitative data, surveys will be the quantitative tool of focus for this course. The survey should be accompanied by a methodological memo (~1 page) that details your process for selecting questions (e.g. did you draw upon validated scales? If so, which one(s)?); provides a general plan for how you intend to use (i.e., analyze) the data; summarizes peer feedback (from an earlier in-class session); and details edits you made accordingly.

Assignment 4 (A4) – For this assignment, you will draft either an in-depth interview guide or a focus group guide to use for the collection of data to answer your “qualitative” research question. Your submission will include the guide and a methodological memo (~1-2 pages) explaining your process for question development (e.g. how do the questions relate to your conceptual framework or theory?); outlines your proposed protocols for recruitment and interview or focus group conduct; and summarizes your initial plan for analysis of the resulting data.

Assignment 5 (A5) – Finally, you will bring your work from assignments two through four together, along with additional content, to prepare a complete mixed methods research proposal. The final proposal should include background on the rationale or motivation for your study; all research questions (and hypotheses, as appropriate); your conceptual framework or theory with explanation; research design with explanation/justification; description of data collection tools (with them attached as appendices); sampling strategy with explanation/justification; proposed qualitative and quantitative analytical methods, including plan for integration of qualitative and quantitative data; projected implications (e.g. for any policies related to your work); project timetable; and, researcher positionality statement. All students will present their proposal near semester end to facilitate pre-submission refinements.

Assignments 1-4 work together to help you build toward a final mixed methods research proposal for assignment 5. Thus, you may use content from prior assignments in subsequent ones. You may (and will) consult with classmates, but all submissions must be individually prepared. If applicable, consider your thesis or dissertation research expectations and use assignments 1-5 as an opportunity to prepare content for your A exam, proposal defense, or other degree milestone.