Discussion questions for Whitley
Principles of Research Methods in Behavioral Science, 2002
Chapter 1 Behavioral Science:
Theory, Research and Applications (p.1)
- Give an example of how the goals of science would apply
to a research interest of your own.
- How would a theory relevant to your proposal help to
organize and extend knowledge and guide research or action in your area of
interest?
- Describe the relationships among theory research and
application. Which aspect appeals most to you?
Chapter 4 Formulating a Research Question (p. 89)
- Construct a research hypothesis and statistical hypothesis
appropriate for testing a hypothesis derived from a psychological theory
relevant to your topic of interest.
- Identify at least one policy variable and estimator variable
relevant to your applied research interest and explain how the estimator
variable may help to explain why the policy variable may be not be effective
(see figure 4.4).
- Identify possible sources of population and setting biases in your
area of research interest.
- Find examples of what you believe may be a biased theory which could
lead to focusing research in the wrong direction and research that has been
used validate a biased theory (other than the example of given by Whitley on
p. 118).
Chapter 2 Research
Strategies An overview (p. 29)
- What are the characteristics of experiments that allow for
inferences of causality?
- What are the characteristics of correlational studies that
don't allow for inferences of causality?
- Give examples of a possible reciprocal relationship between
two variables; one applicable to counseling and one, to I/O psych
- For both I/O and counseling situations, give an example of
when a case study may be better to use than a correlational or experiemental
design
Chapter 3 Ethical Treatment of Research Participants
- Is it
important, from an ethical standpoint, to debrief even when deception was not
employed?
- Is
surreptitious observation of elevator riders an unethical use of surveillance?
- Is it
ethical to conduct research on elderly demented patients if consent is given
by their power of attorney?
- Give an
example of conducting research when the cost is higher for doing it than not
doing it, and another in which the cost is higher for NOT doing it.
Chapter 5 Developing a Measurement Strategy
(p. 121)
- Give an example of how, in your
project, a problem might arise from using a manifest variable as a measure
of a construct.
- What form of reliability is most
important for a construct in your study?
- Give an example of a construct that
should be expected to be high in reliability and one expected to be low.
- Identify two constructs, one for which
you would want to demonstrate criterion related validity and one more
appropriate for content validity
- Using a construct from your project,
identify a construct for which it would show convergent validity and one for
which it should show convergent validity.
- Which coefficients are expected to be
higher, validity or reliability? Why?
- What are the relative strengths and
weaknesses of self-report and behavioral measures?
- What are some advantages and
disadvantages in using self-developed measures vs. standardized ones?
Chapter 6 The Internal Validity of Research
- What is the difference between natural
confounds and treatment confounds? Give an example of each one that could
play a role in your project plan.
- Which of the five time-related threats
to internal validity is most important to consider in your project?
(history, maturation, testing, instrumentation, statistical regression).
- How will you protect against selection
threat in your study? (non-random assignment, preexisting groups, mortality)
- Are there any reactivity threats in
your experimental design? If so, how will you handle them?
- What demand characteristic(s) may
threaten the internal validity of your experiment?
- Will you need a manipulation check to
insure the IV was administered adquately?
Chapter 7 The Experimental Research
Strategy (p. 181)
- When do you use a priori v. post hoc
analysis?
- What impact does the "washout period" have
on internal validity?
- Would you go for a factorial design (i.e.
test interaction) after finding no IV effect?
- How does a repeated measures design help to
avoid a between subjects effect?
- What's the difference between within
Ss and between Ss design? What's the advantages of each?
- How do I explain interaction in words?
Chapter 12 Data Collection (p. 389)
- how can I use cluster sampling for my research project?
- How can I be certain that my data
collection strategy is the best one?
- Can survey questionnaires be used as
the sole DV in an experiment?
Chapter 13 Interpreting Research Results
(p. 451)
1. What are the practical
implications for the small effect sizes found in
Tajfel et al., ’71 “minimal group effect” and Hatfield &
Sprecther, ’86 “physical attractiveness?
2. How do we view the cause of racial prejudice now?
•What
zeitgeist are we in now?
3. State your
hypothesis(es) without falling prey to the “fallacy of
the mean”
•4. Why are
researchers unlikely to test the null directly?
5.
What could explain why you may not find
support for your hypotheses?
Chapter 14 The External Validity of
Research (p. 451)
- Which type of generalizability ("to" and "across")
applies to basic and applied? Why?
- What are some boundary conditions of your study?
- How are the structural components of your study
related to external validity?
- What variables in your project could interact with
your IV?
- Which is more important to your study, internal
or external validity?
Chapter 11 Survey Research (p. 343)
- Which type of research can be tested with a survey? Corr
or Experimental?
- What are the relative advantages and disadvantages of
open and closed-ended questions?
- What are things to consider in determining what level of
measurement to use for a question?
-
Formulate a hypothesis you could test with a survey.
Chapter 8 The Correlational (Passive)
Research Strategy
- Describe the circumstances in which a correlational
research strategy would be preferable to an experimental one.
- Describe a
multifaceted construct that could play a role in one of your lab
projects
- What are the effects of low reliability, restriction
of range, and outliers on the size of a correlation?
- What is the difference between multiple correlation
and multiple regression?
- Give an example of
how you could use logistic regression in one of your lab projects.
-
Give an example of
a mediating variable that could play a role in one of your projects.
Chapter 15
Evaluation Research1. Describe a
goal that is measurable (clear, specific concrete) that
could be a proposed outcome for an intervention based on
findings from one of your projects.
2. Describe the process of needs assessment.
3. Identify a proximal and distal goal for a
graduate program designed to prepare applied students
for the workplace.
4. How would you evaluate the cost effectiveness of a
master's degree program in applied psychology?
5. Design a simple study to assess the effectiveness of
a program to reduce mental illness in a homeless
population.
6. Design a simple study to assess the effectiveness of
an organizational intervention intended to increase work
productivity.