|
|
Criteria for
the Evaluation of Psychological Testing
Prepared by:
Vernon R. Padgett, Ph.D. Research Psychologist
Evaluation of the psychologist who performs the screening
- Is licensed. In accordance with the most current APA
Standards for Providers of Psychological Services,
practitioners should meet the minimal qualifications for a
Professional Psychologist (Gettys, 1987, I-1). If the state
requires a license for providers of psychological services, they
should be licensed as psychologists in their state and be in good
standing (Gettys, 1987, I-1).
- Is thoroughly trained in assessment procedures. Can offer
evidence of adequate training or experience in the area of
psychological test interpretation and psychological assessment
techniques (Gettys, 1987, I-2).
- Knows research literature related to psychological screening
for police.
- Has working knowledge of the Uniform Guidelines on Employee
Selection Procedures, the Americans with Disabilities Act and
associated fair employment issues.
- Has working knowledge of the regulations issued by the EEOC regarding psychological and mental disabilities under the Americans with Disabilities Act of 1990.
- Has working knowledge of pertinent APA Guidelines covering
psychological testing, including the Division 18 Guidelines
(Recommended Guidelines for Pre-employment Screening for Law
Enforcement Officers) (Gettys, 1987).
- Has first-hand knowledge of the peace officer's job as it is
performed in that agency (e.g., the psychologist has participated
as a 'ride-along').
- Understands the job-related criteria the agency is interested
in measuring, and how these criteria relate to psychological
assessment procedures.
- Is willing to testify in court to the validity of the
psychological screening process. This requires that the screener
has:
- a working knowledge of the law surrounding screening;
- an understanding of the tests as they relate to
employment selection;
- data supporting the validity of the screening process as
conducted by the agency.
- Relates effectively to individuals throughout the agency,
including field training officers and top-level administrators.
- Conducts frequent debriefing sessions with administrators and
psychologists (Inwald, 1984).
- Conducts in-house education programs with all staff members so
they will understand the limits of psychological screening (Inwald,
1984).
- Is responsible for the conduct of supervised persons who
provide services, and sees that their services conform to APA
Standards.
Evaluation of screening professional's reports
- A clear hiring recommendation is made.
- Narrative information is confined to job-related factors and is
free of psychological jargon and clinical diagnostic labels.
- Reports are distributed only on a need-to-know basis. Each
agency should have a policy for distribution consistent with local
regulations and state statutes concerning confidential reports.
- If verbal reports are made, the psychologist should maintain
documentation of findings supporting the recommendation (Gettys,
1987, III-4).
- The final report includes any reservations the psychologist has
about the validity or reliability of the test results (Gettys,
1987, III-4).
- Clear disclaimers are made so that reports evaluating current
emotional stability or suitability will not be deemed valid after
a specified time (Gettys, 1987, III-5c).
Evaluation of screening professional's maintenance of the selection
process
- The psychologist maintains test scores and records on the
characteristics of applicants.
- In the maintenance of scores above, particular attention is
paid to records on protected classes as specified in the Uniform
Guidelines (1978); these records are reviewed periodically to
assess possible adverse impact and to assure that selection
criteria have remained constant.
- The psychologist has validated the psychological screening
battery in-house. Has asked others in the agency to evaluate the
research design (Inwald, 1984).
- The psychologist contacts other state and local agencies as
well as professional organizations with the aim of creating a
network for communication of information (Inwald, 1984).
- The psychologist is flexible in the design of research and in
the selection of instruments; conducts pilot studies to establish
local norms and to determine the use of tests for screening
(Inwald, 1984).
- The psychologist monitors the performance of incumbents,
relating their performance to pre-employment screening data. The
screener compares predictions made before the incumbent was hired
to later performance to assess prediction accuracy.
- Psychologist uses results of the previous steps to make needed
revisions in the selection process.
- Psychologist maintains the security of all testing materials
(Gettys, 1987, III-6).
- Psychologist discusses screening results only with those
involved in screening (Gettys, 1987, III-6).
- Psychologist retains pre-employment psychological records for
the time specified in State Statutes, or in the absence of such
statutes, follows a written plan regarding the removal of old
records (Gettys, 1987, III-6a; 6b).
Evaluation of the screening
procedure
- The screening is one component of the overall selection
process.
- The screening procedure is based on a thorough analysis of the
officer's job, documenting its psychological demands.
- Selection criteria were developed from the job analysis. They
specify exactly what the psychological screening procedure is
designed to measure in terms of job-related psychological
dimensions.
- Relevant life history information is included as part of the
evaluation.
- The applicant's right to have a full explanation of the nature
and purpose of the assessment technique is respected by the
screener. This is in accord with APA Ethical Principles. The
alternative is to obtain a waiver of that right, in advance.
- The procedure includes as many tests and evaluations as
possible so that different measures can verify each other (Inwald,
1984).
- The procedure involves the use of tests with research
validation evidence that supports use in screening police.
- The testing procedure avoids using cut-offs scores unless they
have been cross-validated in the agency in which they will be used
(Inwald, 1984).
- The procedure documents selection practices with written
reports on testing and research as it develops (Inwald, 1984).
- The procedure includes the administration of an interview along
with the written screening. (Must provide structured interviews to
those who have negative written test results: Any decisions to
either accept or reject candidates based solely on written test
results may be successfully challenged-- Inwald, 1984). Guideline:
Is the interview structured? Does a set of written interview
questions exist? Gettys (1987, III--3a) suggests that the format
for the interview include questions about prior arrests, drug use,
employment history, etc.
- If the face to-face interview is not given because of time and
volume considerations, background information is obtained to verify
written test results and to gather additional relevant information
on the applicant (Gettys, 1987, III(3)).
- The testing procedure uses well-defined behavioral measures in
both psychological testing and in performance evaluations (Inwald,
1984).
Evaluation of the written rationale for selection
- There exists a written rationale behind the instruments and
procedures. This documents the job-relatedness of the process.
- A thorough description and rationale for each component in the
screening process;
- A thorough description of the characteristics that will result
in disqualification;
- A clear indication as to how the various tests and procedures
combine to provide a comprehensive assessment.
- An assurance that all candidates will be treated alike.
- Reasonable appeal procedures for those who fail the screening
process. The screener will have written procedure advising the
applicant of the steps of the appeal process.
- A periodic review of the records has been performed. It may be
part of the written rationale. This review has noted in particular
information concerning protected classes. The review assesses
possible adverse impact by establishing whether:
- the selection criteria have remained constant;
- the performance of hired individuals correlates with
selection criteria.
Evaluation of agency characteristics
- The agency provides for the professional development of the
screening professionals, such as:
- attending specialized conferences
- consulting with experts in law enforcement screening
- participating in relevant agency training activities
REFERENCES
- Gettys, Vesta S. (October, 1987). Recommended guidelines for
pre-employment screening for law enforcement agencies.
Available from APA Division 18 Police Psychology Section.
- Hargrave, George E. & Berner, John G. (December 1984).
California Commission on Peace Officer Standards and
Training, Psychological Screening Manual (POST).
- Hargrave, George E. & Kohls, John W. (January 1984).
Psychological screening of peace officers: A clinical-
industrial psychological process. Police Chief, 25-28.
- Inwald, Robin E. (1984). Psychological screening. Police
Chief, 26.
- Scogin, F. & Beutler, L. E. (1986). Psychological screening of
law enforcement candidates. In P. A. Keller & L. G. Ritt
(Eds.), Innovations in Clinical Practice: A Source Book,Vol
5. Professional Resource Exchange, Inc., Sarasota, FL.
© 1999 MED-TOX HEALTH SERVICES
|