Psychology
2011. Vol.2, No.9, 978-986
Copyright © 2011 SciRes. DOI:10.4236/psych.2011.29147
Professional Development Experiences: Are Psychology
Interns Getting Enough?
Annette S. Kluck1, Tracy O’Connor Pennuto2, Kathrin Hartmann3
1Special Education, Rehabilitation, and Counseling, Auburn University,
Auburn, USA;
2Federal Medical Center, FCC Butner U.S. Department of Justice Butner,
Butner, USA;
3Psychiatry & Behavioral Sciences; Eastern Virginia Medical School,
Norfolk, USA.
Email: ask0002@auburn.edu, tpennuto@bop.gov, hartmak@evms.edu
Received June 10th, 2011; revised July 21st, 2011; accepted August 28th, 2011.
Understanding the professional development needs of psychology interns is essential to maximize the utility of
predoctoral internship training; yet, little research has explored the professional development training experi-
ences interns receive. In Study 1, 275 psychology interns from APPIC-listed programs completed a 20-question
web-based anonymous survey, assessing experiences of and satisfaction with professional development training
obtained on internship. Using a mixed method research design, a series of descriptive and correlational analyses
were conducted. Results indicated almost 90% of interns reported receiving professional development training
on internship, and 60% of interns were satisfied with their professional development training experiences. More
comprehensive coverage of relevant professional development topics was associated with greater overall satis-
faction and any coverage of a particular topic tended to be associated with greater satisfaction. Multiple linear
regression results suggested that perceptions of preparedness for various post-internship positions were associ-
ated with satisfaction with professional development internship training experiences. In Study 2, 194 internship
training directors completed a modified version of the same survey. Training directors reported more hours of
coverage than did interns and tended to perceive interns as more satisfied with professional development training
experiences on internship than did interns themselves. Implications for those involved in the training of interns
are provided.
Keywords: Professional Development, Psychology, Internship, Training, Satisfaction
Introduction
“Professional development” is training and guidance in the
transition to the profession and practice of psychology. Jarvis
(1989) described internship as the time when trainees are so-
cialized in real world practice, making professional development
appropriate for inclusion in predoctoral internship training for
psychologists. Kaslow and Rice (1985) described this time as the
“professional adolescence,” referring to the developmental
period where trainees struggle to establish their professional
identity while transitioning from students to independent psy-
chologists. According to the American Psychology Postdoctoral
and Internship Centers (APPIC, 2006, 1) internships are “de-
signed to provide the intern with a planned, programmed se-
quence of training experiences.” Thus, psychology internships
are obligated to ensure that trainees receive guidance in profes-
sional development to make the transition into professional
practice (e.g., Drabman, 1985; Sternlicht, 1966).
We define professional development as a set of experiences
provided to interns that focus upon assisting them with their
transition to future professional positions and preparing them for
real world experience. For example, topics such as licensure and
finding postdoctoral fellowships or jobs in desired fields repre-
sent the next step for many psychology interns with interests in
applied practice. A focus on topics such as the development of a
private practice, ethics, advocacy, board certification, admini-
stration issues, and research may also relate to long-term func-
tions within the careers of professional psychologists. Thus,
learning experiences that focus on the advancement of interns
into future professional positions are appropriate for profes-
sional development training experiences. Familiarizing interns
with the real world experiences that psychologists face when
working with clients in service oriented settings and collabo-
rating with others to improve/ensure client welfare are also
appropriate.
We believe that professional development is one of many
important components of the internship training experience.
That is, professional development training complements training
psychology interns receive for clinical skill development (e.g.,
assessment, therapy, case conceptualization, content knowledge),
making professional development distinct yet integral to the
primary focus of enhancing skills in the provision of psycho-
logical services. As the final formal step in professional psy-
chology (clinical, counseling, school) predoctoral training, in-
ternships have the responsibility to ensure that trainees receive
education or guidance in professional development. Yet, re-
search exploring professional development experiences obtained
while on internship is sparse.
Available research regarding professional development and
psychology internships supports the notion that professional
development is a critical component of this capstone predoctoral
training experience. Sternlicht (1966) identified professional
development as eighth among the ten learning areas for clinical
psychology internships, suggesting that professional develop-
ment should be considered a learning objective for the pre-
doctoral internship. Years later, Drabman (1985) identified pro-
A. S. KLUCK ET AL. 979
fessional development of psychologists-in-training as one of the
four main areas most in need of improvement in the graduate
training of scientist-practitioner-oriented clinical psychologists.
In more recent years, researchers have sought to understand
the role professional development plays in creating a successful
psychology internship training program. Research with trainees
indicates that interns consider professional development ex-
periences (i.e., the process of professional development over the
year, the reciprocal influence of personal and professional devel-
opment during internship) to be among the most influential on
their development during the predoctoral internship year (Scott,
2004). In addition, interns consider both personal (psychother-
apy, personal relationships, and mentors) and professional ex-
periences (research design and methodology, practicum, ethics,
and coursework) to be important aspects of internship for their
professional development.
Some researchers have focused upon the inclusion of specific
content deemed to be an important part of the knowledge base
for professional psychologists. For example, researchers have
suggested that brief psycho-pharmacology curriculum (Dunivin
& Southwell, 2000), business concepts (Spruill & Pruitt, 2000),
and research (LeJuez, Read, Gollan, & Zvolensky, 2001) be
included in internship training since such knowledge would
assist interns in future practice, aiding in differential diagnoses,
selection of appropriate assessment and intervention methods,
and working within the constraints of managed care. The re-
maining studies found in this literature search involved profes-
sional development on internship that was highly specific to a
particular patient population, setting, or practice area such as
working in counseling centers (Ross & Altmaier, 1990), family
psychology (Kaslow, Celano, & Stanton, 2003), and providing
services to individuals with severe mental illness (Hoge, Stayner,
& Davidson, 2000).
Although these studies address important issues for future
psychologists, little is known about what assistance psychology
interns currently receive in the process of transitioning into their
postdoctorate roles. Understanding the professional develop-
ment needs of psychology interns is essential to maximize the
utility of predoctoral internship training. The present set of
studies examined psychology interns’ experiences of profession-
al development training obtained while on internship.
Study 1
Method
Participants
Participants included 275 professional psychology predoc-
toral interns (58 men and 217 women) at the 630 sites listed in
the APPIC online internship directory for the 2005-2006 training
year. Though the gender split was far from equal, APPIC (2005)
reported a similar ratio in their survey of the same cohort. Most
participants were in their 30s (n = 121, 44.0%) or younger (n =
124, 45.1%). Consistent with the APPIC sample, nearly all
participants were pursuing Ph.D. (n = 167, 60.9%) or Psy.D.
degrees (n = 106, 38.7%). Our sample contained 230 (83.9%)
individuals from clinical psychology programs (compared to
77% of respondents in the APPIC sample) and 34 (12.4%) re-
spondents from counseling psychology doctoral programs.
Nearly all of the participants (n = 264, 96.0%) were from
doctoral programs accredited by the American Psychological
Association (AP) and/or Canadian Psychological Association
(CPA) and most study participants were completing APA- or
CPA-accredited (n = 234; 85.1%) internships. The remaining
respondents were at unaccredited internship sites (n = 40, 14.5%;
many of these individuals listed “APPIC member” as their ac-
creditation organization; however, APPIC is not an accrediting
agency; APPIC, 2002). Canada and all regions of the United
States (US) were represented by respondents with the majority at
internships in the Northeast (26.2%; n = 72), Midwest (22.5%; n
= 62), and Southeast (20.4%; n = 56) regions of the US. Despite
a wide range in the number of interns per site (from 2 or fewer to
more than 15), 80% (n = 155) of respondents were from sites
with 3 - 10 interns at the time of their training. Nearly all re-
spondents were at internship sites (or major rotations) in com-
munity medical settings (n = 103, 37.3%), counseling centers (n
= 60, 21.7%), or VAs (n = 59, 21.4%), with few completing
internships in outpatient mental health centers (n = 18, 6.5%),
correctional facilities (n = 11, 4.0%), or schools (n = 8, 2.9%).
Most respondents intended to complete a postdoctoral fel-
lowship (n = 130; 47.3%) or some type of clinical/non-private
practice job (n = 77; 28.0%) immediately following internship.
Few participants planned to immediately enter academic (n = 12;
4.4%), research (n = 4; 1.5%), or private practice (n = 11; 4.0%)
positions. Over two thirds of respondents (n = 198; 72.0%)
desired a clinical career (e.g., private practice, non-private prac-
tice) as their long-term position post-internship, with few plan-
ning careers in academia (n = 45; 16.4%) or research (n = 8;
2.9%).
Procedures
Training Directors (TDs) with published email addresses in
the APPIC online directory (a total of 613 TDs) for the intern-
ship year were contacted via email and asked to forward an
invitation to participate in the study to their current intern class
in early June 2006, which fell near the termination (final 4
months) of the training year for most APPIC member internship
sites. Two weeks later, TDs received a reminder email to for-
ward to their current interns. TDs and interns were informed that
the study explored professional development experiences during
internship. The email invitation directed interested interns to a
survey hosted on www.surveymonkey.com. The survey intro-
duction contained required information for informed consent,
stating that respondents’ answers would serve as their consent.
Interns who chose to participate completed an anonymous on-
line questionnaire, assessing experiences and satisfaction with
professional development obtained on internship.
Measures
Although a measure with established psychometric properties
would enhance the soundness of the present study, no such
measure exists. In exploratory research in related domains such
as student trainee perspectives of practica (Gross, 2005), neu-
ropsychology postdoctoral training experiences (Donders, 2002),
postdoctoral training in health psychology (Belar & Siegel,
1983), correctional psychology internship training (Ax & Mor-
gan, 2002), and child and adolescent psychiatry residency
training (Stubbe, 2002), researchers have developed question-
naires specifically for the study using face valid items designed
to assess the experiences expected to relate to the particular type
of training under investigation. Although guidelines regarding
internship professional development training would provide a
starting point for item development, no such guidelines exist.
Due to the lack of available measures and limited existing lit-
erature, questions focused upon quickly capturing information
about training opportunities available to interns at their sites
were developed specifically for this study. The survey contained
A. S. KLUCK ET AL.
980
20 questions generated by the authors based upon their knowl-
edge and experience of training opportunities, and included
face-valid questions related to professional transition (e.g.,
licensure, board certification). In addition, input from individu-
als who had previously completed an APA-accredited internship
at different training sites than the authors was solicited.
Because one of the primary goals of the study was to explore
professional development opportunities offered by internship
sites, we felt it necessary to collect background information
about internship sites so that we could adequately describe the
training sites represented within our sample’s responses given
potential regional and setting differences. To avoid the potential
identification of participants, who could potentially suffer
negative consequences if they provided non-favorable informa-
tion (which some participants explicitly stated as a concern in
heir responses), we limited the information solicited about in-
terns. In some cases, personal demographics (e.g., specific age,
ethnicity) combined with internship site demographics may be
specific enough to make the identification of an intern possible.
Thus, collected personal demographics were limited to age
group, gender, degree, and program specialization. The demo-
graphics collected for internship sites were limited to accredita-
tion, ranges of internship class size, region, and primary training
setting. In addition, participants reported availability and esti-
mated hours of training in different types of professional de-
velopment experiences. They also indicated their level of satis-
faction with professional development training using a 5-point
scale (from 1 = extremely dissatisfied, to 5 = extremely satisfied)
and listed suggestions to improve such training.
The survey items were not intended to be summative, but
rather to capture data about the different components and foci of
professional development experiences of psychology interns.
While internal reliability analyses are not appropriate for the
entire measure, we conducted such analyses for item sets for
which participants provided multiple responses to assess a par-
ticular construct. We obtained acceptable coefficient alphas for
presence of coverage of 11 different topics (α = .73), hours
devoted to those topics (α = .83), hours of guidance on those
topics interns obtained outside of formal professional develop-
ment training experiences (α = .87), and ratings of how well their
professional development experiences on internship prepared
them for 5 different post-internship positions/tasks (α = 82).
Design and Analyses
This study was descriptive and correlational in design. Analyses
were predominantly descriptive in nature, and a series of corre-
lations and analyses of variance (ANOVAs) were used to
evaluate the relationship between several aspects of internship
professional development training and level of satisfaction with
such training.
Results
Descriptives
Most interns (89.1%) reported receiving some type of pro-
fessional development training. Table 1 reveals that a majority of
interns reported that their internship professional development
training covered topics of private practice issues, ethics, post-
doctoral fellowships, licensure, support and adjustment, and
administrative issues. In contrast, 50% or more of respondents
reported that their formal professional development training
included 0 hours on academic job topics, board certification,
research, and current events and advocacy.
Most interns were satisfied with their internship professional
development training experiences (60%), though a substantial
portion (21.8%) reported some level of dissatisfaction. Over
60% of respondents felt that their internship had prepared them
“well” or “very well” for postdoctoral fellowships and clinical/
non-private practice work and half (49.7%) felt their internship’s
professional development training had prepared them “well” or
“very well” for licensure. In contrast, respondents’ views about
how well their sites’ professional development experiences
prepared them for private practice jobs were mixed (over 30%
reported that the experiences had “not at all” or “poorly” pre-
pared them and 36.4% described the preparation as “fair”).
Respondents tended to view their internship professional de-
velopment experiences as least adequate in preparing them for
academic jobs (53.5% felt “not at all” or “poorly” prepared).
Using 5 ANOVAs, differences in perceptions of preparedness
related to primary training site were examined. No group dif-
ferences were found for perceptions of preparedness for clinical
non-private practice, F(6, 268) = 1.57, p = .157, postdoctoral
fellowships, F(6, 268) = 1.92, p = .078, academia, F(6, 268) =
2.08, p = .056, or licensure, F(6, 268) = .49, p = .814. However,
counseling center interns believed their professional develop-
ment training better prepared them for private practice than did
those in medical settings and schools, F(6, 267) = 2.24, p = .04.
Table 2 contains bivariate correlations between internship
professional development training satisfaction and hours of
professional development training devoted to different topic
areas. Broadly, less time spent on topics was associated with
greater dissatisfaction. To determine if these relevant topics
were covered in some other format (outside the professional
development seminar) during internship (e.g., supervision, as-
signed mentors), respondents indicated the number of hours
spent with other individuals associated with the internship (not
including other interns) addressing each of the professional
development topics (see Table 3).
Satisfaction as a Function of Professional Development
Experiences
A series of t-tests and ANOVAs were conducted to test if level
of satisfaction with professional development differed as a
function of internship characteristics and professional devel-
opment availability. Sixteen t-tests were planned so a Bonferroni
correction was applied, resulting in an adjusted alpha level
of .0031. The Bonferroni correction for three planned ANOVAs
resulted in a new alpha level of .0166. Table 4 contains group
means for the 16 t-tests conducted on availability of different
components of professional development. Coverage of any topic
(except ethics) in professional development seminars was asso-
ciated with higher levels of satisfaction with professional de-
velopment on internship. Satisfaction did not differ depending
upon internship accreditation, F(3, 270) = 2.00, ns, or type of
primary training setting, F(6, 268) = 2.38, p = .029. Satisfaction
level did differ depending upon number of interns at the site, F(4,
270) = 4.75, p = .001. Post hoc analyses using the Tukey method
revealed that respondents from sites with 6 - 10 interns (M =
4.00, SD = .98) had significantly (using a cutoff of p < .05 for
post hoc analyses) higher levels of satisfaction than did those
from sites with 1 - 2 interns (M = 3.28, SD = 1.16) and 3 - 5
interns (M = 3.43, SD = 1.19), whereas respondents from sites
with 11 - 15 interns (M = 3.80, SD = 1.21) and 16 or more in-
terns (M = 4.75, SD = .50) did not differ from any other group.
Perceived Preparedness Predicting Satisfaction
We expected that perceptions of preparedness may predict
overall satisfaction with professional development training.
Thus, we conducted a multiple linear regression with respon-
dents’ ratings of preparedness for academia, private practice,
A. S. KLUCK ET AL. 981
Table 1.
Hours of professional development devoted to different topics of interest.
Topics 0 hours 1 hour N (%)2 hours 3 - 5 hours 6 - 10 hours 11+ hours
Academic jobs 148 (53.8%) 46 (16.7%) 44 (16.0%) 22 (8.0%) 10 (3.6%) 5 (1.8%)
Private practice 115 (41.8%) 56 (20.4%) 66 (24.0%) 28 (10.2%) 8 (2.9%) 2 (.7%)
Clinical/Non-private practice 136 (49.5%) 68 (24.7%) 38 (13.8%) 17 (6.2%) 7 (2.5%) 9 (3.3%)
Postdoctoral fellowships 102 (37.1%) 45 (16.4%) 59 (21.5%) 42 (15.3%) 14 (5.1%) 13 (4.7%)
Licensure 67 (24.4%) 65 (23.6%) 81 (29.5%) 38 (13.8%) 14 (5.1%) 10 (3.6%)
Board Certification 195 (70.9%) 43 (15.6%) 22 (8.0%) 9 (3.3%) 4 (1.5%) 2 (.7%)
Research 153 (55.6%) 35 (12.7%) 17 (6.2%) 20 (7.3%) 14 (5.1%) 36 (13.1%)
Ethics 40 (14.5%) 39 (14.2%) 58 (21.1%) 74 (26.9%) 40 (14.5%) 24 (8.7%)
Current events/advocacy 137 (49.8%) 30 (10.9%) 29 (10.5%) 36 (13.1%) 23 (8.4%) 19 (6.9%)
Support and adjustment 71 (25.8%) 35 (12.7%) 20 (7.3%) 35 (12.7%) 31 (11.3%) 83 (30.2%)
Administrative issues for internship 49 (17.8%) 54 (19.6%) 45 (16.4%) 56 (20.4%) 31 (11.3%) 40 (14.5%)
Table 2.
Bivariate correlations (r) between self-reported level of satisfaction
with professional development training on internship and hours of
professional development devoted to different topics.
Hours of Professional Development Devoted To: Satisfaction
Academic Job Issues .323**
Private Practice Jobs .345**
Non-Private Practice Jobs .456**
Postdoctoral Fellowships .394**
Licensure .451**
Board Certification .319**
Research .317**
Ethics .356**
Current Events and Advocacy .314**
Support and Adjustment .464**
Administrative Issues .297**
Note: All correlations are between level of satisfaction and specific focus of
professional development training using an ordinal scale rather than a ratio scale,
where individuals indicated which of the following best described number of hours
of professional development training focused on the topic: 0, 1, 2, 3 - 5, 6 - 10, and
11 or more. **p < .001
non-private practice, licensure, and postdoctoral training pre-
dicting satisfaction with professional development training
experiences. Perceptions of preparedness across domains ac-
counted for 60% of the variance in satisfaction, F(5, 268) =
79.33, p < .001. Perceived level of preparedness for academia (β
= .10, sr = .09, p = .026), clinical/non-private practice (β = .31, sr
= .22, p < .001), postdoctoral fellowship (β = .21, sr = .16, p
< .001), and licensure (β = .28, sr = .21, p < .001) emerged as
unique predictors that remained significant after controlling for
the effects of perceptions in the other domains. The semipartial
coefficients suggest that perceived effectiveness of professional
development training in preparation for practice related activi-
ties (postdoctoral fellowships, clinical/non-private, and licen-
sure) commonly faced by individuals shortly after internship
were most related to satisfaction.
Qualitative Analyses
Sixty-five interns responded to an open-ended request to “list
any suggestions… for the provision of more effective profes-
sional development experiences on internship.” The responses
were filtered into a single table and reviewed by the researchers.
Data reduction and content analysis were performed by hand,
which involved immersion of the investigator in the data with
several readings to identify concepts. Next, each response was
coded based on content. Coding was initially done with re-
spondents’ words or short phrases. As patterns were identified,
phrases were collapsed into subcategories, then broader catego-
ries, common themes were derived, and coded frequencies of
responses for each theme were summed.
Of the responses, nine did not suggest changes to internship
professional development experiences (e.g., “N/A”, “adequately
prepared”). Eight key themes emerged for the remaining re-
sponses with the predominant (n = 51) message reflecting a
desire for more professional development on transitioning to the
next career phase (see Table 5 for sample responses).
The first theme was a desire for more preparation for the li-
censure process (8), such as “We have no clue how to proceed as
far as licensure.” The second theme reflected a need for more
guidance in acquiring postdoctoral positions (16), both for con-
tinued training (“… regular meetings about acquiring postdocs”)
and employment (“Schedule seminars related to job finding”).
The third theme requested more information about post-in-
ternship clinical work (5), including “how to start a private
practice.”
The inclusion of more intern support emerged as the fourth
theme (6), with requests including a “more supportive envi-
ronment regarding adjusting to clinical work,” or support group
(3), “just for interns, where these matters could be discussed.”
The fifth theme was the request for more talks from practicing
psychologists regarding job experiences or options (5), “from
psychologists in various professions… to learn how they got
started, etc.” The desire for a mentoring program comprised the
sixth theme (3), “More… 1:1 mentorship.”
The seventh theme emerged from several comments reflecting
the desire to begin these processes much earlier in the internship
training year (4), “By the time we were encouraged to look into
positions, many of the deadlines had passed!” Finally, the eighth
theme suggested regulation, oversight, or input by APA, CPA, or
APPIC (4), “I think that in order to be APPIC or APA/CPA
accredited that each site MUST have certain hours put aside for
professional development.” In addition, there were individual
requests for more information regarding selected topics (e.g.,
board certification, securing grants).
A. S. KLUCK ET AL.
982
Table 3.
Hours of guidance o u t s i d e of p r o f e s s ional development devot ed to different topics of in t e r e st d u r i n g in t e rnship training.
Topics 0 hours 1 hour N (%)2 hours 3 - 5 hours 6 - 10 hours 11+ hours
Academic jobs 144 (52.4%) 51 (18.5%) 36 (13.1%) 29 (10.5%) 10 (3.6%) 5 (1.8%)
Private practice 173 (62.9%) 42 (15.3%) 29 (10.5%) 21 (7.6%) 8 (2.9%) 2 (.7%)
Clinical/Non-private practice 151 (54.9%) 48 (17.5%) 34 (12.4%) 24 (8.7%) 11 (4.0%) 7 (2.5%)
Postdoctoral fellowships 95 (34.5%) 54 (19.6%) 42 (15.3%) 43 (15.6%) 25 (9.1%) 16 (5.8%)
Licensure 104 (37.8%) 56 (20.4%) 70 (25.5%) 28 (10.2%) 11 (4.0%) 6 (2.2%)
Board Certification 196 (71.3%) 42 (15.3%) 20 (7.3%) 9 (3.3%) 4 (1.5%) 4 (1.5%)
Research 149 (54.2%) 31 (11.3%) 25 (9.1%) 21 (7.6%) 17 (6.2%) 32 (11.6%)
Ethics 103 (37.5%) 48 (17.5%) 61 (22.2%) 35 (12.7%) 16 (5.8%) 12 (4.4%)
Current events/advocacy 137 (49.8%) 35 (12.7%) 54 (19.6%) 30 (10.9%) 8 (2.9%) 11 (4.0%)
Support and adjustment 75 (27.3%) 36 (13.1%) 48 (17.5%) 43 (15.6%) 23 (8.4%) 50 (18.2%)
Administrative issues for internship 95 (34.58%) 64 (23.3%) 54 (19.6%) 32 (11.6%) 14 (6.1%) 16 (5.8%)
Note: Respondents were asked to exclude hours of guidance received from other interns or from individuals affiliated with their graduate program.
Table 4.
Mean (and standard deviations) satisfaction with professional devel-
opment experiences on internship as a function of availability of vari-
ous experiences (N = 274).
Does your internship: Yes No t val u e
Have PD Component? 3.70 (1.12) 2.63 (1.16)4.88**
Use Guest Speakers? 3.80 (1.13) 3.20 (1.14)2.45**
Have Regularly Scheduled Seminars? 3.90 (1.08) 2.99 (1.11)6.59**
Have a Support Group? 3.92 (1.13) 3.41 (1.16)3.45*
Have Q & A with Faculty? 4.07 (.95) 3.34 (1.20)5.01**
Have Intern Presentations? 4.00 (1.08) 3.35 (1.16)4.51**
Cover Academic Issues? 3.95 (1.07) 3.32 (1.18)4.49**
Cover Private Practice Issues? 3.91 (1.07) 3.23 (1.18)4.97**
Cover Non-Private Practice Issues? 4.02 (1.08) 3.30 (1.15)5.15**
Cover Postdoctoral Fellowships? 3.92 (1.01) 3.10 (1.22)6.08**
Cover Licensure? 3.87 (1.03) 3.01 (1.24)6.09**
Cover Board Certification? 4.14 (.94) 3.46 (1.18)3.80**
Cover Research? 4.06 (.96) 3.33 (1.19)5.13**
Cover Ethics? 3.69 (1.17) 3.24 (1.12)2.84^
Cover Current Events/Advocacy?
Advocacy? 4.10 (1.03) 3.33 (1.16)5.39**
Cover Support/Adjustment to
Internship? 3.94 (1.08) 2.98 (1.07)7.09**
^p < .01; *p < .0031 (the cut off for significance using a Bonferroni correction);
**p <.001.
Discussion
Most respondents reported receiving some professional de-
velopment-related training on internship, though the focus and
extent of that training varied widely and a subset (about one fifth)
of respondents were dissatisfied. Inclusion of relevant topics
(e.g., fellowships, licensure, academia, board certification) and
more time devoted to those topics were associated with greater
satisfaction with professional development, as was perceived
effectiveness of the internship professional development training
for preparing respondents for post-degree activities. Thus, pro-
viding professional development experiences focused on en-
hancing perceptions of preparedness for the post-internship
activities of interest to any particular cohort may help to increase
satisfaction with this area of internship training. Similarly, in-
ternship sites may be best equipped to accommodate trainees’
preferences by explicitly inquiring about post-internship plans
and formulating professional development training specific to
their interns’ career goals.
The eight common themes derived from the qualitative open-
ended feedback provided by respondents clearly highlighted
interns’ desire for more guidance in the transition to the next
phase. As was implied with quantitative findings regarding
satisfaction, respondents tended to suggest more coverage of
topics that received fewer hours of coverage during internship.
In particular, interns requested more preparation for obtaining
postdoctoral positions and licensure, which are often the next
“hurdles” for interns.
The lack of differences in satisfaction as a function of ethics
training (when using the modified alpha level to control for
multiple analyses) may reflect how interns view professional
development. It may be that at the internship stage of training,
soon-to-be professional psychologists do not connect ethics with
preparation for post-degree activities as readily as they do ac-
tivities such as licensure. Obviously, the value of inclusion of
ethics in professional development extends beyond interns’
perceptions of how ethics relates to their preparation for the next
phase of their careers (e.g., training in ethics has immediate
application while on internship, ethics is a topic included on the
examination for licensure in psychology).
Study 1 contains some important limitations including the use
of a descriptive design and reliance upon intern self-report. As
Belar and Siegel (1983) suggested regarding their own research
in a similar domain, it is not possible to ensure the accuracy of
participants’ ratings regarding hours of coverage of a particular
topic. Similarly, as is common in this type of research (e.g.,
Belar & Siegel, 1983; Mullins, Hartman, Chaney, Balderson, &
Hoff, 2003; Stubbe, 2002), self-selection bias was inherently
present.
Study 2
Past research on professional development for psychology
A. S. KLUCK ET AL. 983
Table 5.
Selected intern suggestions for the provision of more effective profes-
sional development experiences on internship.
1
“Wow! I didn’t realize that these areas should have been covered
in our internship. It would have been really helpful to have gotten
past the ‘how do I handle this case?’ to more of the real in’s and
out’
s of practicing. Because my internship ran like a job, it never
felt appropriate to take time out to ask some of these questions.”
2
“I wish my program had started to talk about applications for
postdoctoral positions sooner. By the time we were encouraged to
look into positions, many of the deadlines had already passed!”
3
“Starting at the beginning of the training year preparing for postdocs
applications and information about state licensure requirements
with continued review and preview regularly throughout the year.”
4 “Better didactics regarding administrative responsibilities: billing,
negotiating pay/job, inter-department workings (red tape/politics).”
5 “Internships should be clued in to helping interns develop what
happens next, especially since we graduate without a license...”
6
“I believe it would be helpful for internship sites to receive advice
on the topics interns need information about from APPIC and …
accreditation sites.”
7 “Guest speakers sharing their experience.”
8 “A support group for interns led by someone OUTSIDE of the
internship agency.”
9 “This is generally not a component of clinical/research supervision
but should be.”
11 “Requiring APA accredited internship programs to have seminars …
devoted to this area.”
11 “Some discussion regarding board certification.”
12 “Set up a mentoring program to connect interns with experienced
clinicians with similar interests/goals.”
13 “Walking the intern through the process of licensure from start to
finish.”
14 “I do think it would be helpful to receive information about how to
start a private practice.”
15
“I feel the last quarter of internship should be geared towards
students functioning in a more autonomous role to prepare for
post-internship positions. My internship site has provided consistent
professional development topics, but no real emphasis on transitioning
to the next phase has occurred.”
16 “More opportunity to attend seminars and trainings would be
beneficial.”
interns generally results in the conclusion that professional
development is an important component during the predoctoral
internship training sequence (e.g., Lochner, 1997; Scott, 2004;
Sternlict, 1966). Despite the importance of this training, little
research has explored the specific experiences psychology in-
terns receive in professional development during internship. In
Study 1, we attempted to address this deficit in the research by
surveying individuals completing their internship training. We
found that most psychology interns receive some professional
development training, but some respondents were at least
somewhat dissatisfied. Although the findings of the first study
expand our existing knowledge of professional development
opportunities trainees receive during their predoctoral internship,
the self-reported experiences of psychology interns provides an
incomplete picture of this training. In particular, potential re-
spondents may have been more or less likely to participate de-
pending upon their level of satisfaction with their professional
development training experiences. As such, additional data from
individuals other than interns themselves would provide a
clearer picture of the offerings of professional development
training for psychology interns.
The present study expands the findings of Study 1 by ex-
ploring TDs’ perceptions of the quality and types of professional
development training experiences available to their interns. We
compared TDs’ responses to the experiences reported by psy-
chology interns in Study 1 to determine if TDs’ perceptions of
training offered by programs differed from perceptions of
trainees, thus enhancing our understanding of the extent to which
results of the first study might be representative of the general
experiences available for psychology interns. We expected that,
like the interns in Study 1, TDs would report that professional
development predominantly covered domains of postdoctoral
fellowships, private practice, ethics, and support, addressing
current issues (e.g., ethics) and issues likely faced in the short-
term future by interns (e.g., postdoctoral fellowships). It was
also expected that in comparison to psychology interns, TDs
would report more time spent on professional development and
evaluate the professional development opportunities as more
satisfactory than did the psychology interns in Study 1 because
we assumed most TDs seek to offer quality training experiences.
Method
Participants
A total of 194 internship TDs responded to an email invitation
to participate in an on-line survey hosted through www.sur-
veymonkey.com. Similar to our Study 1 sample, respondents in
this study predominantly represented training sites in the Mid-
west (n = 51, 25.6%), Northeast (n = 41, 20.6%) and Southeast
(n = 27, 18.6%), with the fewest from Canada (n = 10, 5.0%).
The majority of TDs were from sites accredited by the APA
and/or CPA (n = 153, 76.9%). Another 37 (18.6%) of the TDs
that participated represented non-accredited training sites with
the remaining either pursuing accreditation or having some other
accreditation status. The difference in percentage of TDs who
represented accredited training sites compared to the psychology
interns from Study 1 was about 9% with a lower percentage of
the TDs representing APA- or CPA-accredited sites compared to
the psychology interns. As was true for the respondents in Study
1, the participants most frequently represented internships based
(or primarily based in the case of consortiums) in medical
school/hospital settings (n = 67, 33.7%), counseling centers (n =
36, 18.1%), community mental health centers (n = 29, 14.6%),
and Veteran’s Affairs settings (n = 23, 11.6%). Consistent with
Study 1, most TDs were from sites that trained between 3 to 10
interns per year. In order to obtain relevant information about the
internship sites, maintain anonymity, and keep the time required
for participation to a minimum to increase response rates, no
information regarding the background of the TDs was collected.
Measures
As was true in Study 1, there is a lack of valid measures to
assess professional development experiences offered at different
training sites. Thus, the survey used in Study 1 was modified for
use in this study to create a 10-item survey. The survey was
again face valid in nature and items were reflective of different
types of professional development experiences offered at vari-
ous sites familiar to the authors. Items regarding personal
demographic details were removed, but items on the demo-
graphics of the internship site were retained. The survey also
required respondents to provide information about opportunities
related to professional development offered at their site and their
A. S. KLUCK ET AL.
984
beliefs about the satisfaction of their trainees regarding the
available opportunities by modifying the wording of survey
questions from Study 1 to be appropriate for TDs. When pro-
viding responses regarding the number of hours devoted to
various topics during professional development training, TDs
were instructed to estimate the total number of hours of profes-
sional development his or her site devoted to the various topics.
No assessment of informal professional development that may
occur in supervision or mentoring was attempted. As was true in
Study 1, the final survey question was open-ended, asking TDs
to offer suggestions for the improvement of professional de-
velopment training experiences on psychology internships. In all
cases, the retained questions in the survey closely matched those
used in Study 1 to allow for comparisons of the perceptions of
TDs and interns. In addition, TDs were instructed to provide
information regarding the training experiences offered at their
site during the 2005-2006 training year in order to obtain data
from TDs that corresponded to the cohort of participants used in
Study 1.
As was true with Study 1, the survey was not meant to be
summative in nature so a reliability analysis for the entire survey
would be inappropriate. However, it was possible to conduct a
reliability analysis for estimation of hours of professional de-
velopment devoted to the 11 different topic areas. The obtained
Cronbach’s alpha was .76, suggesting sufficient internal con-
sistency.
Procedures
In October 2006, an email was sent to all of the TDs whose
email addresses were listed in the APPIC directory at the time of
the study or whose email addresses could be found on the in-
ternship site’s website. We chose to contact TDs at the end of
October to ensure that most internship sites would have recently
graduated the cohort used in Study 1. The email served as the
invitation to participate in the study and described the purpose of
the study. Those TDs who were willing to participate were
instructed to click on a link connected to our on-line survey
where we provided information required for informed consent
including that continued participation in the study would serve
as providing informed consent. Individuals who agreed to par-
ticipate responded to the on-line survey that was developed for
the present study.
Results
Nearly all (n = 190, 95.5%) TDs who participated reported
offering formal, regularly scheduled didactics that all interns
attend and most (n = 186, 93.5%) included professional devel-
opment in these didactic training experiences during the 2005-
2006 training year. Over one fifth of the TDs reported that no
time was spent covering topics related to academic jobs (n = 46,
23.1%), private practice (n = 50, 25.1%), clinical/non-private
practice jobs (n = 52, 26,1%), research (n = 72, 36.2%), and
current events/advocacy (n = 40, 20.1%). Over half (n = 119;
59.8%) of the respondents indicated that they did not cover
board certification. In contrast, ethics was nearly universally
covered to some extent (n = 193, 97%). Postdoctoral fellowships
(n = 161, 80.9%), licensure (n = 180, 90.5%), interns’ adjust-
ment/support (n = 186, 93.5%), and administrative issues (n =
184, 92.5%) were also covered in almost all cases.
We used a series of single sample t-tests to explore differences
between TDs and psychology interns regarding the time they
reported was spent covering various topics. To control for the
increased familywise error rate associated with running multiple
analyses, we used a Bonferroni correction which set the new
alpha level to .004. Compared to psychology interns, TDs re-
ported that significantly more (p < .001) time was devoted to all
areas of professional development including research (t(186) =
17.469), private practice (t(189) = 15.032), clinical/non-private
practice jobs (t(186) = 17.150), postdoctoral fellowships (t(187)
= 14.282), licensure (t(191) = 16.297), board certification (t(183)
= 16.179), research (t(186) = 10.314), ethics (t(193) = 24.802),
current events/advocacy (t(183) = 14.092), interns’ adjustment/
support (t(190) = 19.950), and administrative issues (t(189) =
18.192). Also consistent with our hypotheses, an independent
samples t-test revealed that TDs (M = 4. 4.20, SD = .72) esti-
mated that psychology interns were more satisfied than were the
Study 1 psychology interns (M = 3.58, SD = 1.17), t(467) = 6.49,
p < .001. Specifically, 93.3% of TDs reported that their interns
were somewhat or very satisfied with their professional devel-
opment training experiences provided on internship.
We invited TDs to respond to an open-ended question by of-
fering suggestions for improving professional development ex-
periences during internship (Table 6). The same coding proce-
dure employed with the data from the psychology interns in
Study 1 was used to qualitatively analyze the TDs’ responses.
The same individual also completed the coding, providing in-
creased likelihood of consistency of coding qualitative re-
sponses across the two studies. Thirty-eight of the participants
provided suggestions and an additional 2 respondents further
elaborated on their answers to the survey. Generally, suggestions
varied and TDs offered several ideas regarding how professional
development experiences might be organized to provide maxi-
mally beneficial training. The most common themes reflected in
the responses were 1) meeting the specific needs of a particular
cohort depending on interests/goals, 2) using post-doctoral
fellows or new professionals as speakers, 3) covering job search/
post-doctoral fellowship acquisition early and extensively, 4)
use of mentoring/modeling, 5) regularly scheduled seminars, 6)
voluntary support groups available or covering self-care, 7)
instruction specifically on CVs and interviews, and 7) requests
for guidance from APPIC (see Table 6).
Discussion
As expected, TDs reported more time spent covering relevant
topics during professional development training and TDs re-
ported most consistently covering ethics, postdoctoral fellow-
ships, and intern support to some extent. As predicted, the TDs
overestimated the degree of satisfaction psychology interns have
with their professional development training when comparing
estimates to self-reported levels of satisfaction among interns.
Though the cause of the discrepancy between psychology interns
experiences of professional development training and TDs’
perceptions of experiences offered is unclear, our findings sug-
gest TDs may want to communicate with psychology interns
more frequently about their expectations and needs for profes-
sional development. TDs and internship faculty may also want to
remember the inherent hierarchy between trainees and faculty
which in turn may discourage interns from more readily report-
ing satisfaction in person to their training faculty or encourage
them to avoid the expression of dissatisfaction face to face. This
may be especially true for interns in smaller internship sites who
fear that their written responses on frequently used anonymous
evaluation forms could identify them.
As was true for Study 1, Study 2 is limited by the study
methodology. Specifically, self-selection bias may continue to
operate for TDs and it is possible that TDs are also not accurate
in reporting hours devoted to various topics. It is possible that
A. S. KLUCK ET AL. 985
Table 6.
Selected training director suggestions for the provision of more effective
professional development experiences during predoctoral psychology
internships.
1 “Reliance on outside speakers/consultants who are experts in the
area presented.”
2 “Seminar evaluations by interns to assess efficacy and value of
topic/presentation/speaker.”
3 “Coordinate professional development training with other internship
sites.”
4 “Newly licensed speakers from the community have been a hit.”
5 “Mentoring program”
6 “We do mock interviews with our interns…”
7 “Try to assess each intern’s interests … and gear seminar time to
meet intern needs.”
8 “Stay up to date on trends in the field.”
9 “Shadowing professional psychologists to see what their job entails.”
11
“The establishment of a specific ‘Professional Issues’ Seminar is an
efficient way to ensure that the above mentioned topics are covered
during the internship year.”
11 “Resume development and preparation.”
12 “If the site is near the state’s licensing board, and the board’s meetings
are open to the public, I recommend attendance at those meetings.”
13 “Exploring cultural competencies.”
14 “Encourage APPIC to publish a manual on these issues.”
the differences between TDs and interns reflected a tendency for
TDs with a strong interest in providing professional develop-
ment to interns to be more likely to take the time to participate in
a study on the topic. In other words, those TDs who participated
may be at sites that provide more coverage of professional de-
velopment issues and, in fact, foster more satisfied interns.
General Discussion
Future Directions
As professional development should be a priority at every
level of a psychology student’s academic career, future research
should systematically examine the experiences of and satisfac-
tion with professional development training obtained during the
undergraduate and graduate years, as well as during Postdoctoral
Fellowship. In addition, future studies should continue to ex-
plore differences between interns’ and TDs’ perceptions of
professional development training. For example, it may be that
TDs are less aware of the interns’ changing interests for each
incoming intern cohort. TDs may differ from interns in their
beliefs about the importance of specific training aspects, or may
believe that their interns are satisfied with the professional de-
velopment experiences that are presently offered based to the
feedback they are receiving (and that feedback may or may not
be accurate). Finally, research that explores the long-term out-
come of enhanced professional development experiences is
needed. Such research might explore rates of job acquisition,
satisfaction with selected job, difficulties transferring to the role
of independent professional, time to licensure, and involvement
in advocacy.
Strengths and Implications
We also sought to explore the extent to which different rele-
vant topics are components of professional development training
experiences for psychology interns. That is, results detailed the
professional development experiences currently offered by
many internship sites, by defining what is taught and how this
information is conveyed, adding to our current knowledge of
how the teaching of or guidance in professional development is
approached on internship.
The present study makes an important contribution to training
considerations of psychology interns. It is among the first re-
search endeavors to systematically examine perceptions of
professional development training for psychology trainees dur-
ing internship. This study demonstrated that while many interns
feel they received satisfactory training in areas related to their
transition into the profession of psychology, a significant subset
does not. The present study also presented descriptive informa-
tion regarding topics covered and time devoted to such topics
during professional development provided on internship. In
addition, the anonymous nature of the study allowed individuals
to provide confidential feedback that TDs may use to improve
the professional development experiences currently offered.
Some excellent suggestions are contained in Table 6 as a sam-
pling of the feedback received from respondents, many of which
could easily be incorporated by TDs into future professional
development internship training experiences at their sites.
Moreover, the study results may help faculty at internship sites
that offer extensive coverage of professional development topics
have confidence that the experience is valued by their interns.
Finally, as some of the participants suggested, interns may
benefit from requirements imposed or oversight by the APA/
CPA or APPIC that regulate the minimum acceptable coverage
within the area of professional development. Such regulation
may help ensure that professional psychology interns receive
adequate information and support as they transition to the next
stage of their career.
The results of this study will allow TDs to enhance the pro-
fessional development experiences offered at their sites. TDs
may wish to adjust the number of hours offered in a particular
area based upon the frequency with which such training is of-
fered elsewhere. For example, since over 50% of respondents
reported that their site provided coverage of topics related to the
licensure process as part of their professional development
training, TDs at sites not currently covering licensure during
professional development seminars may wish to do so. Similarly,
a TD might increase time spent providing support to interns after
identifying that satisfaction with professional development
during internship training was most strongly correlated with time
devoted to support and adjustment. In addition, as we found that
more time spent on professional development was correlated
with overall increased satisfaction, TDs may want to enhance the
professional development aspect of their interns’ training by
increasing time spent on topics of interest to their current intern
class. Although topics of interest can easily be obtained in an
initial training needs assessments of the incoming interns, set
training schedules, the need for teaching faculty qualified to
address topics, and other needs identified in the needs assess-
ment may make accommodation of all the incoming interns’
interests for professional development difficult.
Results from this study may also assist individuals seeking an
internship placement, by helping them to better evaluate how
well a site prepares interns for the transition into the professional
role. After reviewing the present study, applicants can identify
which professional development experiences are most important
to them. Applicants can then compare how much time a par-
ticular site of interest spends addressing professional develop-
A. S. KLUCK ET AL.
986
ment experiences to that of other sites to which the applicant
applied. This information would allow applicants to submit more
informed rankings during the matching process.
In conclusion, this study makes a valuable contribution to the
literature on the training of psychology interns and provides
essential information for those involved in student training. It is
one of the first research endeavors to explore perceptions of
interns’ professional development training experiences and to
compare interns’ self-reported satisfaction with the TDs’ per-
ceptions of their interns’ satisfaction. This represents an impor-
tant first step in enhancing the process by which professional
psychology interns transition from student to independent pro-
fessional. Using the findings of the present study, professional
psychology internship applicants can become better informed
about seeking a placement that more adequately meets their
professional development needs, be aware of topics they might
request be considered for inclusion, and TDs can become more
intentional in designing and implementing the professional
development components of future internship training experi-
ences.
References
Association of Psychology Postdoctoral and Internship Centers (2002,
December). APPIC copyright and legal notices. URL (last checked
11 February 2007) http://www.appic.org/31_0_legal_notices.html
Association of Psychology Postdoctoral and Internship Centers (2005,
May). 2005 APPIC Match: Survey of internship applicants. URL
(last checked 11 May 2007)
http://www.appic.org/match/5_2_2_4_7_match_about_statistics_sur
veys_2005.htm
Association of Psychology Postdoctoral and Internship Centers (2006,
December). Membership criteria: Doctoral psychology internship
programs. URL (last checked 11 February 2007)
http://www.appic.org/about/2_3_1_about_policies_and_proce-
dures_internship.html
Association of Psychology Postdoctoral and Internship Centers (2007,
June). 2007 APPIC Match: Survey of internship applicants. Part 2:
Summary of match rates by applicant and program characteristics.
URL (last checked 20 June 2007)
http://lyris.appic.org:81/read/archive?id=29157
Ax, R. K., & Morgan, R. D. (2002). Internship training opportunities in
correctional psychology: A comparison of settings. Criminal Justice
and Behavior, 29, 332-347. doi:10.1177/0093854802029003005
Belar, C. D., & Siegel, L. J. (1983). A survey of postdoctoral training
programs in health psychology. Health Psychology, 2, 413-425.
doi:10.1037/0278-6133.2.4.413
Bernard, J. M., & Goodyear, R. K. (2004). Fundamentals of clinical
supervision (3rd ed.). Boston: Allyn & Bacon.
Donders, J. (2002). Survey of graduates of programs affiliated with the
Association of Postdoctoral Programs in Clinical Neuropsychology
(APPCN). Clinical Neuropsychologist, 16, 413-425.
doi:10.1076/clin.16.4.413.13906
Drabman, R. S. (1985). Graduate training of scientist-practitioner-
oriented clinical psychologists: Where we can improve. Professional
Psychology: Research and Practic e, 16, 623-633.
doi:10.1037/0735-7028.16.5.623
Dunivin, D. L., & Southwell, G. D. (2000). Psychopharmacology
training in psychology internships: A brief curriculum. Professional
Psychology: Research and Practice, 31, 610-614.
doi:10.1037/0735-7028.31.6.610
Gross, S. M. (2005). Student perspectives on clinical and counseling
psychology practica. Professional Psychology: Research and Prac-
tice, 36, 299-306. doi:10.1037/0735-7028.36.3.299
Heppner, P. P., Wampold, B. E., & Kivlinghan, D. M. (2008). Research
design in counseling (3rd ed.). Belmont, CA: Thompson/Brooks
Cole.
Hoge, M. A., Stayner, D., & Davidson, L. (2000). Psychology intern-
ships in the treatment of severe mental illness: Implications for
training in academic medical centers. Journal of Clinical Psychology
in Medical Settings, 7, 213-222. doi:10.1023/A:1009580413935
Jarvis, P. E. (1989). Standardization versus individualization in the
clinical internship. Professional Psychology: Research and Practice,
20, 185-186. doi:10.1037/0735-7028.20.3.185
Kaslow, N. J., Celano, M. P., & Stanton, M. (2005). Training in family
psychology: A competencies-based approach. Family Process, 44,
337-353. doi:10.1111/j.1545-5300.2005.00063.x
LeJuez, C. W., Read, J. P., Gollan, J. K., & Zvolensky, M. J. (2001).
Identifying, obtaining, and completing a predoctoral psychology in-
ternship: Research considerations. Professional Psychology: Re-
search and Practice, 32, 650-654. doi:10.1037/0735-7028.32.6.650
Lochner, B. T. (1997). The relationship between cognitive style, theo-
retical orientation, and preferences for supervisory style among pro-
fessional psychology interns. Dissertation Abstracts International,
58, 419B.
Mullins, L. L., Hartman, V. L., Chaney, J. M., Balderson, B. H. K., &
Hoff, A. L. (2003). Training experiences and theoretical orientations
of pediatric psychologists. Journal of Pediatric Psychology, 28,
115-122. doi:10.1093/jpepsy/28.2.115
Rodolfa, E. R., Kaslow, N. J., Stewart, A. E., Keilin, W. G., & Baker,
J.(2005). Internship training: Do models really matter? Professional
Psychology: Research and Practice, 36, 25-31.
doi:10.1037/0735-7028.36.1.25
Ross, R. R., & Altmaier, E. M. (1990). Job analysis of psychology
internships in counseling center settings. Journal of Counseling Psy-
chology, 37, 459-464. doi:10.1037/0022-0167.37.4.459
Scott, A. E. (2004). Counselor development through critical incidents:
A qualitative study of intern experiences during the predictoral in-
ternship. Dissertat ion Abstracts International, 65, 1681A.
Spruill, J., & Pruitt, S. D. (2000). Preparing psychologists for man-
agedcare settings: Enhancing internship training programs. Prof-
sional Psychology: R esearch and Practice, 31, 305-309.
Sternlicht, M. (1966). The clinical psychology internship. Mental Re-
tardation, 4, 39-42.
Stubbe, D. E. (2002). Preparation for practice: Child and adolescent
psychiatry graduates’ assessment of training experiences. Journal of
the American Academy of Child & Adolescent Psychiatry, 41, 131-
139. doi:10.1097/00004583-200202000-00006