COMMUNITY CASE STUDY
Evaluation of a Telephone-based Physical Activity Promotion Program for Disadvantaged Older Adults
Navigate This Article
Kristen Hammerback, MA; Glen Felias-Christensen, RN, MPH; Elizabeth A. Phelan, MD, MS
Suggested citation for this article: Hammerback K, Felias-Christensen G, Phelan EA. Evaluation of a telephone-based physical activity promotion program for disadvantaged older adults. Prev Chronic Dis 2012;9.110071. DOI: http://dx.doi.org/10.5888/pcd9.110071.
PEER REVIEWED
Abstract
Background
Lack of adequate physical activity among older adults has been widely
documented. Although interventions aimed at increasing physical activity that
are based on behavioral strategies and theories have been shown
to increase activity levels among older adults, little is known about responses
to these interventions in different population segments.
Community Context
The Physical Activity for a Lifetime of Success (PALS) program attempted to
translate a telephone-based, motivational support program for physical activity,
Active Choices, for use by a low-income, ethnically diverse population of older
adults living in southeast Seattle. This article describes the evaluation of
PALS at the end of the 5-year program.
Methods
Evaluation data included a data set of participant physical activity
assessments; internal study documents; and interviews with key PALS
stakeholders, participants, volunteers, and people eligible for PALS who
declined to enroll when invited.
Outcome
PALS demonstrated improved physical activity levels among the sedentary
older adults who participated in the program, but the PALS model did not appeal
widely to a diverse, low-income target population. Extensive recruitment efforts
resulted in a low number of participants, and attempts to recruit peer
volunteers were largely unsuccessful.
Interpretation
Considering the resources required to engage both participants and
volunteers, PALS does not appear to be a sustainable model for delivering
support for physical activity to community-dwelling minority and low-income
older adults.
Background
Despite evidence demonstrating the benefits of physical activity for older adults, including the prevention and control of chronic diseases (1,2) and reduction in risk of falls (3-5), most older adults do not achieve recommended levels of physical activity (6). Identifying ways to increase physical activity in this large and growing segment of the population is a public health priority.
Physical activity interventions based on behavioral strategies and theories increase levels of participation among older adults (7). However, little is known about how responses to these interventions differ depending on the population segment involved, because few have been disseminated in nonresearch settings.
The Physical Activity for a Lifetime of Success (PALS) program was based on Active Choices, an evidence-based program developed at Stanford University. PALS aimed to increase the physical activity levels of sedentary older adults through one-on-one telephone support delivered by adult volunteers who were trained in motivational interviewing. Participants received twice-monthly, 20- to 30-minute telephone calls for the initial 6 months, followed by monthly calls for up to 6 additional months. Volunteers did not receive any stipend or nonmonetary compensation. A description of the program and the first phase of its implementation can be found elsewhere (8).
The objective of this study was to understand the appropriateness of the PALS intervention for the target audience (an older, low-income, ethnically diverse population), whether it was successful in improving participants’ levels of physical activity, barriers and motivators for participation, and lessons learned for implementing similar programs.
Community Context
PALS was developed and implemented between March 2005 and September 2009 through a partnership between the University of Washington Health Promotion Research Center (HPRC) and Senior Services; funding was provided through a cooperative agreement with the Centers for Disease Control and Prevention (CDC).
Recruitment challenges
Recruiting was a challenge during all 3 phases of the 5-year study (8). In the initial phase, beginning March 2005, we used a randomized controlled trial design to test PALS and recruited participants via “green prescription,” a written recommendation from the physician for increased physical activity (9). During this phase we recruited people aged 65 years or older who had diabetes; who were living in an ethnically diverse, low-income neighborhood of Seattle, Washington; and who were receiving care at 1 of 2 community clinics. We recruited participants during their usual visits with their primary care provider. Participants were randomized to receive either an immediate or delayed intervention that consisted of a physical activity assessment, brief counseling by a primary care provider, and a referral to the PALS program. Recruiting participants using this strategy was unexpectedly difficult. Although the initial expectation was that half or more of the patients approached by their doctors would agree to participate, only 14 people (21%) enrolled, despite encouragement from primary care providers and follow-up calls from research staff.
During the second phase, beginning in 2006, we modified recruitment criteria to include younger adults (aged ≥50 y) and people who did not have diabetes, and we changed the research design to a pre-post comparison. Recruitment efforts targeted the 900-plus members of the Southeast Seattle Senior Center (SSSC), a neighborhood center that provides programs for community-dwelling older adults. SSSC, which serves a largely low-income, ethnically diverse population, was the operations hub for the PALS program. Letters and PALS brochures were mailed to 150 randomly selected people on the senior center’s mailing list, and telephone calls were made to each recipient within a week after the mailing. Other recruitment methods included asking a health educator from recruitment phase 1 community clinics to recommend program enrollment to eligible patients, publishing articles in neighborhood newspapers, distributing brochures at senior housing sites, and speaking at community events. Although enrollment was lower than expected (48 enrolled by January 1, 2008), results demonstrated the effectiveness of PALS in increasing physical activity levels among participants, many of whom expressed strong enthusiasm for the program. A final phase, aimed at reaching as many eligible adults as possible, began in spring 2008.
Phase 3 outreach efforts centered on recruiting via community organizations that served older adults throughout King County, Washington, including Asian Counseling and Referral Services (serving primarily Asian populations), SeaMar Community Health Centers (serving a largely Latino/Latina population), the US Veterans’ Administration MOVE program, the King County Employee Wellness Initiative, and Visiting Nurse Services of the Northwest. PALS project staff also presented information sessions about the program at locations visited by older adults or locations where they resided, such as local civic clubs, assisted living and retirement communities, and churches and synagogues. Audience sizes for these outreach efforts ranged from a few to 50 people.
Evaluation objectives
We designed the PALS evaluation to assess the extent to which PALS met 2 key objectives: to increase the physical activity level of the program’s participants and to successfully adapt an evidence-based model (Active Choices) for a diverse, low-income, older adult population. Secondary evaluation aims included determining what factors may have interfered with these objectives being fully met, and considering lessons that may inform future attempts to implement heath promotion programs among diverse, low-income, older adult populations.
An external evaluator designed the PALS evaluation in consultation with the research team. All data collection instruments and procedures were approved by the University of Washington institutional review board.
Methods
Data sources
Physical activity outcome measures database
Participants’ physical activity level was measured by using the Rapid Assessment of Physical Activity (RAPA) questionnaire (10) (available on request from corresponding author). The RAPA measures frequency and intensity of physical activity in the areas of aerobic endurance, strength, and flexibility. A RAPA score of 1 to 3 corresponds to minimal physical activity, a score of 4 or 5 is associated with some health benefit, and a score of 6 or 7 meets the CDC standard for physical activity. The RAPA instrument was designed for use in clinic settings and has been validated (10).
Program process documents
Formal and informal proposal-stage and preparatory reviews and assessments, progress reports, and implementation-related e-mails, reviews, and assessments were used as data sources. Examples include the health-planning demographic data used to assess the community’s need for a physical activity program, periodic progress reports prepared for the funder, and archived e-mails between the PALS coordinator and volunteers.
Interviews
We conducted structured, one-on-one interviews with 25 key PALS stakeholders, including past and present members of the research team, the current PALS coordinator, community partners, PALS volunteers (telephone “buddies”), and PALS participants (interview questions available on request from corresponding author). We also interviewed 10 program “nonjoiners,” defined as people recruited for PALS who chose not to enroll.
Data collection
To measure the effectiveness of PALS for increasing participants’ physical activity levels, RAPA assessments were completed on enrollment and at 3, 6, and 12 months postenrollment. The initial RAPA assessment was conducted in person; follow-up RAPA assessments were administered by telephone. Previous work assessing the validity and reliability of in-person and telephone-administered RAPA assessments supported these approaches (11). All RAPA scores were collected by the SSSC PALS coordinator.
To review the large collection of PALS-related documents, 2 PALS evaluation team members read through and summarized nonconfidential electronic and paper files belonging to PALS program coordinators and researchers. Evaluators conferred frequently to ensure consistency of interpretation.
To capture the views and experiences of PALS stakeholders, an interview guide was constructed and pretested. Stakeholders were asked to describe their experience with PALS, including challenges encountered and lessons learned. Each semistructured interview, completed by 1 of 2 evaluators, lasted between 45 and 60 minutes. Conversations were not audiotaped, but interviewers prepared a written summary immediately after the interview.
As part of a separate study on motivations and barriers to older adults’ participation in physical activity programs, we conducted semistructured interviews with 2 sets of subjects: participants in the PALS program (“joiners”) and people who expressly declined participation (“nonjoiners”). For this evaluation, we analyzed only those parts of the interviews related to the PALS experience. We asked interviewees what brought them to PALS, what aspects were most appealing, and what suggestions they had for improvement. Nonjoiners answered questions about barriers to joining and aspects of PALS they found problematic. All interviews were conducted in person, usually in the participant’s home. Interviews were audiotaped and professionally transcribed. We conducted 20 interviews (10 each with joiners and nonjoiners.)
We contacted PALS volunteers via regular mail or e-mail and asked them to complete a brief written questionnaire about their PALS experience. The questionnaire addressed motivations for volunteering to be a telephone buddy, experiences with making telephone calls and interacting with participants, and reasons for ending involvement. We had current contact information for 15 of the 39 PALS volunteers. Of these 15, 8 completed a survey.
Data analysis
To measure the association of PALS participation with increased levels of physical activity, we compared baseline and 6-month RAPA assessment scores. The 6-month interval was chosen because PALS was initially designed as a 6-month program with the option to continue up to 6 additional months. Therefore, many participants completed the program before being administered the 12-month RAPA assessment. Analysis followed a pre-post design, using a McNemar test for matched pairs to assess differences between RAPA scores at enrollment and follow-up. Data were analyzed using SPSS version 15 (SPSS, Inc, Chicago, Illinois).
Qualitative data were analyzed by using a grounded theory approach. Two evaluation team members read every interview summary, interview transcript, and internal document, and met frequently to discuss and verify agreement on themes, particularly those present in more than 1 source. To ensure accuracy and consensus, we compiled a list of key themes and sent it to the remaining members of the evaluation team for review.
Outcomes
Effect of PALS on physical activity levels
Although 131 people enrolled in PALS and received a baseline RAPA score, only 89 (68%) were also administered the RAPA assessment at 6 months. The remaining 42 participants either dropped out before 6 months (n = 20) or were unable to be reached to participate in a 6-month RAPA assessment (n = 22). Of these 89 participants, 12 (13%) had baseline scores of 6 or 7, which indicated that they met the CDC standard for physical activity. At 6-month follow-up, 22 people (25%) met the CDC physical activity standard, a significant increase (McNemar χ2 = 4.545, P = .05) (Table 1). The 3 types of physical activity measured showed similar increases.
Translating Active Choices into PALS
Review of program process documents indicated that, when initially considering Active Choices as a program model, HPRC researchers did not conduct formal target audience research to assess whether a telephone-based, volunteer, peer support model would be suitable or appealing to low-income, ethnically diverse, older adults living in southeast Seattle. Instead, researchers consulted members of the HPRC Community Advisory Board who represented PALS target communities. These members endorsed the choice but did not formally test it among potential participants.
Post-PALS interviews with members of the community indicated that many felt the PALS model did not meet their wants or needs. For example, some Latino older adults reported that members of their community would not feel comfortable talking regularly on the telephone to someone with whom they did not also have a face-to-face relationship. Some older adults who declined an invitation to join PALS voiced concern about talking openly with someone much younger or of a different race and doubted that someone so different could really understand the challenges they faced in trying to start a regular routine of physical activity. Finally, many did not like the idea of receiving telephone calls from strangers.
Interviews with 10 former PALS participants also indicated a lack of enthusiasm for a telephone-based model, and most of the nonjoiners indicated that communicating only via telephone was a major reason for declining to enroll.
Recruitment
PALS participants
During the first year of PALS, 2005, 14 of the 65 older adults invited to enroll did so (Figure). In years 2 and 3, invitations to 150 members of the SSSC yielded 4 new participants; continued referrals from the 2 clinics and word of mouth resulted in an additional 30 enrolled participants. In the summer of 2008, 2 members of the PALS research team gave 99 presentations and talks at locations visited by older adults or locations where they resided. As a result of this intense 3-month period of recruitment, 29 people enrolled in PALS, about 1 person for every 3 presentations. Furthermore, we produced and disseminated a short video with information about the program and testimonials from satisfied participants, and distributed articles and profiles highlighting PALS to local newspapers and newsletters throughout 2008 and 2009. These efforts ultimately added 54 participants by September 2009, bringing the total enrolled to 131.
Figure. Enrollment in Physical Activity for a Lifetime of Success (PALS) program, per year and cumulative, 2005-2009. Data from PALS participant database. [A tabular version of this figure is also available.]
Volunteers
Interviews with PALS stakeholders indicated that attracting and keeping reliable, enthusiastic volunteers was challenging and time-consuming. Originally, PALS sought volunteers who could act as peer mentors, ideally older adults with regular physical activity routines, preferably living in the same community and with similar backgrounds to those of participants, who would presumably enjoy the process of encouraging another elder to become more active. As a result of the dearth of potential volunteers meeting these criteria, we adopted broader criteria, which yielded a volunteer pool that was younger, less diverse, and more educated than the average PALS participant (Table 2).
The 8 volunteers we interviewed indicated that developing rapport with participants was an ongoing challenge, as was contacting participants (“My participants never returned my calls!”). Most of these volunteers felt discouraged at what they perceived to be the difficulty of making a strong connection with their assigned participants, and few described the experience as satisfying (“It was a lot of work without much return.”).
Implementation
Both interviews and process documents suggested that PALS implementation was hampered by high turnover among research team and program staff, because the turnover threatened the program’s institutional memory and stability. Furthermore, the PALS coordinator felt overwhelmed by the challenges of collecting and recording data from volunteers. Although volunteers were asked to commit to being a telephone buddy for a minimum of 1 year, many ended their involvement within a few months of completing the PALS telephone buddy training, requiring the coordinator to hold many more trainings and do more outreach than originally anticipated.
Interpretation
Although PALS was effective in increasing physical activity levels among participants, recruitment of participants and volunteers required too much time, effort, and funding for sustainability. Therefore, the program was discontinued at the end of its research cycle in September 2009.
Possible reasons for difficulty in recruiting participants
Two issues may underlie the challenges we encountered in recruiting participants. First, few people in our target communities may have been in the appropriate stage of behavior change, meaning that the available pool from which to recruit was limited. We did not assess stage of change as part of PALS recruitment; the research team decided that making this assessment would reduce the practical, real-world translational effort and make this project similar to a research study. Although a stage-of-change assessment may have helped us direct our recruitment efforts more strategically (12), making this type of assessment was not feasible in the context of our recruitment approach during phase 3. However, organizations planning to implement such programs may find that assessing readiness for change presents an opportunity to help both program operators and potential participants understand the person-program fit.
Second, the PALS model was not appealing to the study’s target population. Community partner stakeholder interviews identified barriers, including the lack of face-to-face interaction between participants and their volunteer telephone buddies and the frequent differences between these 2 groups in their cultural identities, ages, and socioeconomic levels. Incorporating more input from members of the target population early on in the choice of model may have indicated that these factors would be barriers (13). PALS may have been more successful if we had performed a preliminary needs assessment of our target audience with older adult members of our partner organizations to inform the selection of an appropriate program model. In doing so, we may have recognized that a telephone-based intervention was not appropriate for a sizeable proportion of our intended audience.
Possible reasons for difficulty in recruiting and retaining volunteers
PALS experienced challenges typical for nonprofits in recruiting and retaining volunteers (14), and volunteers tended to be younger, more educated, and less racially diverse than PALS participants. Previous studies indicate that volunteers in health promotion programs are often younger and more highly educated than participants (14,15). Because we did not conduct preliminary market research among possible volunteers, the PALS telephone buddy model may not have appealed to the study’s target volunteer population (those who resembled the target population for the PALS program).
The PALS evaluation was limited by the low response rate for our volunteer interviews (21%), which may have limited the range of perspectives reflected. However, the use of an objective external evaluator, triangulation of key findings through multiple data sources, the mix of qualitative and quantitative data elements, and the elicitation of a range of key perspectives were strengths of the PALS evaluation.
Conclusions
PALS achieved its objective of improving physical activity levels among the sedentary older adults who participated in the program, but the PALS model did not appeal widely to our diverse, low-income target population. Because of the amount of time required to recruit participants and volunteers, we do not consider PALS a sustainable model for delivering support for physical activity to community-dwelling, minority, and low-income older adults. Developing ways to reach this target audience, however, is worthy of continued study.
Acknowledgments
This research was supported by CDC cooperative agreement no. 1-U48-DP-000050.
Author Information
Corresponding Author: Kristen Hammerback, MA, Department of Health Services, School of Public Health, University of Washington, Seattle, WA 98105. Telephone: 206-616-4724. E-mail: khammerb@uw.edu.
Author Affiliations: Glen Felias-Christensen, Department of Health Services, School of Public Health, University of Washington, Seattle, Washington. Elizabeth A. Phelan, Department of Health Services, School of Public Health, and Department of Medicine, Division of Gerontology and Geriatric Medicine, University of Washington, Seattle, Washington.
References
- American College of Sports Medicine position stand. Exercise and physical activity for older adults. Med Sci Sports Exerc1998;30(6):992-1008.
- Chodzko-Zajko WJ, Proctor DN, Fiatarone Singh MA, Minson CT, Nigg CR, Salem GJ, Skinner JS. American College of Sports Medicine position stand. Exercise and physical activity for older adults. Med Sci Sports Exerc 2009;41(7):1510-30.
- Guideline for the prevention of falls in older persons. American Geriatrics Society, British Geriatrics Society, and American Academy of Orthopaedic Surgeons Panel on Falls Prevention. J Am Geriatr Soc 2001;49(5):664-72.
- Chang JT, Morton SC, Rubenstein LZ, Mojica WA, Maglione M, Suttorp MJ, et al. Interventions for the prevention of falls in older adults: systematic review and meta-analysis of randomised clinical trials. BMJ 2004;328(7441):680.
- Tinetti ME, Kumar C. The patient who falls: “It’s always a trade-off.” JAMA 2010;303(3):258-66.
- Schoenborn CA, Vickerie JL, Powell-Griner E. Health characteristics of adults 55 years of age and over: United States, 2000-2003. Adv Data 2006;(370):1-31.
- Task Force on Community Preventive Services. Recommendations to increase physical activity in communities. Am J Prev Med 2002;22(4 Suppl):67-72.
- Batik O, Phelan EA, Walwick JA, Wang G, LoGerfo JP. Translating a community-based motivational support program to increase physical activity among older adults with diabetes at community clinics: a pilot study of Physical Activity for a Lifetime of Success (PALS). Prev Chronic Dis 2008;5(1). .http://www.cdc.gov/pcd/issues/2008/jan/07_0142.htm. Accessed January 17, 2012.
- Elley CR, Kerse N, Arroll B, Robinson E. Effectiveness of counselling patients on physical activity in general practice: cluster randomised controlled trial. BMJ 2003;326(7393):793.
- Topolski TD, LoGerfo J, Patrick DL, Williams B, Walwick J, Patrick MB. The Rapid Assessment of Physical Activity (RAPA) among older adults. Prev Chronic Dis 2006;3(4). http://www.cdc.gov/pcd/issues/2006/oct/06_0001.htm. Accessed January 17, 2012.
- Mayer CJ, Steinman L, Williams B, Topolski TD, LoGerfo J. Developing a Telephone Assessment of Physical Activity (TAPA) questionnaire for older adults. Prev Chronic Dis 2008;5(1). http://www.cdc.gov/pcd/issues/2008/jan/06_0143.htm. Accessed January 17, 2012.
- Wilcox S, Laken M, Bopp M, Gethers O, Huang P, McClorin L, et al. Increasing physical activity among church members: community-based participatory research. Am J Prev Med 2007;32(2):131-8.
- Castro FG, Barrera M, Jr, Martinez CR Jr. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci 2004;5(1):41-5.
- Davis C, Leveille S, Favaro S, LoGerfo M. Benefits to volunteers in a community-based health promotion and chronic illness self-management program for the elderly. J Gerontol Nurs 1998;24(10):16-23.
- Fischer LR, Mueller DP, Cooper PW. Older volunteers: A discussion of the Minnesota Senior Study. Gerontologist 1991;31(2):183-94.
Tables
Table
1. Distribution of Rapid Assessment of Physical Activity (RAPA) Scores for
PALS Participants (N = 89) at Enrollment and at 6 Months Following
Enrollment, 2005-2009a
| RAPA Scoreb | At Enrollment, % | ≥6 Months Following Enrollment, % |
|---|---|---|
| 1-3 | 62 | 22 |
| 4 or 5 | 25 | 48 |
| 6 or 7 | 13 | 25 |
a Calculated using McNemar test for matched pairs,
P = .05 for RAPA scores dichotomized to sufficiently active (yes/no).
b RAPA scores of 1-3 correspond to minimal physical activity, 4 or 5
are suboptimal with some benefit, and 6 or 7 are optimal (based on Centers for
Disease Control and Prevention standards for physical activity).
Table
2. Descriptive Characteristics of Physical Activity for a Lifetime of
Success (PALS) Participants and Volunteers
| Characteristic | Participantsa (n = 55) | Volunteers (n = 39) |
|---|---|---|
| Mean age, y | 70 | 55 |
| % White | 51 | 76 |
| % College graduate | 29 | 81 |
a Only participants for whom demographic data were collected were included in this analysis. Demographic data were regularly collected beginning August 2008.
The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions.
