What is validity and why is it important in research?

Standard

Validity is described as the degree to which a research study measures what it intends to measure.  There are two main types of validity, internal and external.  Internal validity refers to the validity of the measurement and test itself, whereas external validity refers to the ability to generalise the findings to the target population.  Both are very important in analysing the appropriateness, meaningfulness and usefulness of a research study.  However, here I will focus on the validity of the measurement technique (i.e. internal validity).

The 4 main types of validity

There are 4 main types of validity used when assessing internal validity.  Each type views validity from a different perspective and evaluates different relationships between measurements.

Face validity-This refers to whether a technique looks as if it should measure the variable it intends to measure.  For example, a method where a participant is required to click a button as soon as a stimulus appears and this time is measured appears to have face validity for measuring reaction time.  An example of analysing research for face validity by Hardesty and Bearden (2004) can be found here.

Concurrent validity-This compares the results from a new measurement technique to those of a more established technique that claims to measure the same variable to see if they are related.  Often two measurements will behave in the same way, but are not necessarily measuring the same variable, therefore this kind of validity must be examined thoroughly.  An example and some weakness associated with this type of validity can be found here (Shuttleworth, 2009).

Predictive validity-This is when the results obtained from measuring a construct can be accurately used to predict behaviour.  There are obvious limitations to this as behaviour cannot be fully predicted to great depths, but this validity helps predict basic trends to a certain degree.  A meta-analysis by van IJzendoorn (1995) examines the predictive validity of the Adult Attachment Interview.

Construct validity-This is whether the measurements of a variable in a study behave in exactly the same way as the variable itself.  This involves examining past research regarding different aspects of the same variable.  The use of construct validity in psychology is examined by Cronbach and Meehl (1955) here.

*Definitions taken from Research Methods for the Behavioural Sciences by Gravetter and Forzano (2009)*

A research study will often have one or more types of these validities but maybe not them all so caution should be taken. For example, using measurements of weight to measure the variable height has concurrent validity as weight generally increases as height increases, however it lacks construct validity as weight fluctuates based on food deprivation whereas height does not.

What are the threats to Internal Validity?

Factors that can effect internal validity can come in many forms, and it is important that these are controlled for as much as possible during research to reduce their impact on validity.  The term history refers to effects that are not related to the treatment that may result in a change of performance over time.  This could refer to events in the participant’s life that have led to a change in their mood etc.  Instrumental bias refers to a change in the measuring instrument over time which may change the results.  This is often evident in behavioural observations where the practice and experience of the experimenter influences their ability to notice certain things and changes their standards.  A main threat to internal validity is testing effects.  Often participants can become tired or bored during an experiment, and previous tests may influence their performance.  This is often counterbalanced in experimental studies so that participants receive the tasks in a different order to reduce their impact on validity.

So why is validity important?

If the results of a study are not deemed to be valid then they are meaningless to our study.  If it does not measure what we want it to measure then the results cannot be used to answer the research question, which is the main aim of the study.  These results cannot then be used to generalise any findings and become a waste of time and effort.  It is important to remember that just because a study is valid in one instance it does not mean that it is valid for measuring something else.

Validity’s relationship to Reliability

It is important to ensure that validity and reliability do not get confused.  Reliability is the consistency of results when the experiment is replicated under the same conditions, which is very different to validity.  These two evaluations of research studies are independent factors, therefore a study can be reliable without being valid, and vice versa, as demonstrated here (this resource also provides more information on types of validity and threats).  However, a good study will be both reliable and valid.

So to conclude, validity is very important in a research study to ensure that our results can be used effectively, and variables that may threaten validity should be controlled as much as possible.

About these ads

14 responses »

  1. Pingback: Blog and Comments for weeks 8/9 =] « psucd8

  2. Validity is possibly the most important aspect of research and if anything is to be achieved it should be relibiltiy and validity or findings are in sense worthless. although threats to internal validity are numerous, have you thought about subject attrition? This is when subject may choose not to remain in there group and as a result differences between a control group and a treatment group may be a result of who remained in each group opposed to the variables. Subject attrition shows that validity isnt just a concern when arranging a research design but as the experiment progress there are still threats to internal validity that can be overcome during data analysis. Attrition is manly an issue in longitudinal research (reference below) in which validity is incredibly difficult to control. The overall message of this comment is that validity issues are an ongoing process with a single research process and can be effected at any point and needs many measures to control.

    http://goliath.ecnext.com/coms2/gi_0199-4707401/How-attrition-impacts-the-internal.html

  3. Pingback: Homework for my TA, Week 9 « screamingdominos

  4. I agree with the above comment! There are many threats to both reliability and validity. If you add in more information on when each of these situations could be used it would bulk and add to the argument. There needs to be more examples to back up your points also and they seem very bare. As well, try to add a bit more information on reliability into the argument. The information on the two will help make a very valid point through out your blog instead of just trying to justify validity. Overall good blog.

  5. Very informative blog, however how can we prevent these threats to validity? An interesting way to control this threat in an experiment are blind procedues where certain pieces of information are not disclosed during the experiment to the participant and/or researcher, preventing a bias of behaviour. A single blind being the participant being unaware of which condition or group they are in and a double blind being when neither participant or researcher being aware of this fact. Both lessen the expectancy effects of the experimental setting or group.

  6. Very good blog, it’s possible go into such great detail when discussing validity. It’s vital that researchers are aware of the threats which could disrupt the validity of their experiments, who wants to waste all that time and effort? Even things as simple as experimenter bias can become major issues. The Gorilla/Basket ball video is a really good example of us missing out on details, if we can be blind to a gorilla dancing across the screen, who knows what else we are able to miss?
    Here’s the video http://www.youtube.com/watch?v=vJG698U2Mvo

  7. Pingback: Nadolig Llawen Simon! | psucab

  8. Really detailed informative blog, well done! You could have maybe included how you would try and stop their being threats to the validity, for example a double (experimenter and participant) or single (just participant) blind experiment, where they do not know what condition they are in in the experiment.

  9. Pingback: Homework for my TA simon :) (week 11) « psud63

  10. I am doing a dissertation and I will be using an existing instruments/questionnaires which are already validated. Permission from the authors were already requested and granted. I would like to know if there are authorities that tells that “an existing instrument/questionnaire need NOT to be vaidated anymore”. Thanks hope somebody could help me.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s