Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleMethodology

Creating Innovative Research Designs: The 10-Year Methodological Think Tank Case Study

David Katerndahl and Benjamin Crabtree
The Annals of Family Medicine September 2006, 4 (5) 443-449; DOI: https://doi.org/10.1370/afm.549
David Katerndahl
MD, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin Crabtree
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Additional Files
  • Figure 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Figure 1.

    The creative process.

    Reprinted with permission from Ridkey J, Sheldon GF. Managing in Academics. St. Louis, Mo: Quality Medical Publishing; 1993.

Tables

  • Figures
  • Additional Files
    • View popup
    Table 1.

    Think Tank Topics

    YearTopicMethodological ObstacleThink Tank Outcome
    1994, 1995Nature of caringHow to measure and foster caring in physiciansAfter a pilot study using focus groups to establish the domain of caring, the study would use a continuous quality improvement approach to enhance caring behaviors in the clinical encounter and assess the impact on patient outcomes
    1996Assessing complexity in practice patternsHow to measure complexity in clinical practiceThe use of 3 data sources to triangulate results and identify chaotic patterns via interstaff relations, congruence between activities and stated practice philosophy, and the impact of events on system stability
    1997Epidemiology of bioethicsDefinition of what practice interaction needs informed consent and how to incorporate patients’ viewsAn initial grounded theory study would be the basis for a subsequent quantitative survey
    1998Effectiveness of integrated complementary and alternative medicineHow to compare an integrated approach to traditional careUse a multilevel randomized case study design in which a matched cohort of patients with chronic back pain is assigned to either the traditional care of a spine clinic vs the care at the integrated care clinic after in- depth interviews about the meaning of pain
    1999Diabetes and continuity of careCurrent concepts and methods for defining and easuring continuity were inadequateMultiple factors identified that contribute to the process of continuity of care at the level of the family, the individual, and the community. Developed a research plan for a cohort study to determine the temporal relationships between continuity, readiness to change self-care behaviors, and events that occur in the life of the patient and the family
    2000Factors in smoking cessation in adolescentsMixed methods study with wealth of data but uncertain analysis planRelying heavily on visual time series plots of the data, analyses were developed that consisted of reflexively alternating between the qualitative and quantitative data. Visual plots would identify clusters of subjects that would then be subjected to further analyses, looking for common themes. The plan would call for identifying clusters based on one type of data (eg, quantitative) and then describing each cluster based on the alternative data (eg, qualitative)
    2001Development of a typology for health habit adviceUncertain approach for developing a typology of health habit adviceThe approach derived in the think tank was to use the data from the Exemplar Study13 to develop an initial typology that would be reviewed and altered by the Exemplar physicians in the study itself. A panel of national experts in prevention would then review this typology; their input would be used with a review of the research and theoretical literature to produce a revised typology. This revision would be reviewed again by the expert panel. The resultant typological framework would then be tested using existing databases. If this typology appears robust, it would be used in clinical trials as a final validation
    2002Interprofessional collaboration of primary care providers in managing patients with hyperlipidemiaCurrent measures of collaboration—self-reported style of relationships, counts of structural characteristics that promote collaboration, and measures of provider satisfaction with joint decision making—are poor surrogatesBefore developing an instrument to measure collaboration on a continuum that could be used to study the relationship between collaboration and outcomes, a pilot study was needed to identify typologies of collaboration. The research question for the pilot study would be, How do primary care clinicians and staff work together to provide patient care? This multimethod study would use a comparative case study design with 3 to 5 primary care practices. Data collection would include practice genograms, observation of practice behavior, in-depth interviews with clinicians and staff, and focus groups of staff across practices
    2003Integration of visual and audio data on the clinical encounter to assess impact in depression and smoking cessationIdentifying a method by which visual and auditory data from the clinical encounter could be integratedPilot work was necessary to identify specifics about the doctor-patient interaction that were associated with important outcomes. It was decided to focus on development of an R03 in the area of smoking cessation; it was deemed to be “cleaner” than addressing management of depression. Baseline assessment will establish current smoking behavior and stage of change. The clinical encounter will use digital recording technology and multiple cameras to captive interactions. Postencounter assessment will address patient characteristics, postencounter stage of change, and patient perceptions of the encounter. Follow-up assessment will assess stage of change. All current smokers will be recorded until 15 patients report a baseline-followup improvement in stage of change. From the remaining subjects, a matched control group of 15 subjects matched on patient characteristics will be selected. The interactions of these 30 subjects will then be analyzed using conversational analysis
    • View popup
    Table 2.

    Barriers to Creative Thinking and Participation

    Limits ThinkingLimits Participation
    Adapted from Bucholz & Roth.7
    HabitsNorms and rules
    AssumptionsCriticism
    EmotionsExpert opinion
    Focus on what cannot be doneLack of resources
    Rewards
    Avoiding mistakes
    Creativity denigrated
    Simultaneously combining idea generation and evaluation

Additional Files

  • Figures
  • Tables
  • The Article in Brief

    Background A Methodological Think Tank has been held annually since 1994. A group of 3 to 4 research methodologists with diverse expertise work as a team, discussing a research question selected in advance. They explore the content area with the study investigator and help identify a desirable methodology for the study.

    What This Study Found The Methodological Think Tank has been successful in developing innovative designs to answer important questions that are not easily addressed with conventional research designs. The 7 most recent think tanks produced research designs that received grant funding, including 1 K award (a National Institutes of Health career development award) and 4 R01 grants (research project grants based on the mission of the NIH). Participants attributed much of their success to participation in the Methodological Think Tank.

    Implications

    • The Think Tank process�a short-term collaboration involving researchers with diverse methodological expertise�can help bring about progress on complex research questions.
    • Researchers and academic departments could use this process locally to develop innovative research designs.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 4 (5)
The Annals of Family Medicine: 4 (5)
Vol. 4, Issue 5
1 Sep 2006
  • Table of Contents
  • Index by author
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Creating Innovative Research Designs: The 10-Year Methodological Think Tank Case Study
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
4 + 5 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Creating Innovative Research Designs: The 10-Year Methodological Think Tank Case Study
David Katerndahl, Benjamin Crabtree
The Annals of Family Medicine Sep 2006, 4 (5) 443-449; DOI: 10.1370/afm.549

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Creating Innovative Research Designs: The 10-Year Methodological Think Tank Case Study
David Katerndahl, Benjamin Crabtree
The Annals of Family Medicine Sep 2006, 4 (5) 443-449; DOI: 10.1370/afm.549
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • RESULTS
    • DISCUSSION
    • Footnotes
    • REFERENCES
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • In This Issue: Capacity for Caring and Generating New Knowledge
  • Google Scholar

More in this TOC Section

  • Joint Display of Integrated Data Collection for Mixed Methods Research: An Illustration From a Pediatric Oncology Quality Improvement Study
  • Patient-Guided Tours: A Patient-Centered Methodology to Understand Patient Experiences of Health Care
  • Putting Evidence Into Practice: An Update on the US Preventive Services Task Force Methods for Developing Recommendations for Preventive Services
Show more Methodology

Similar Articles

Subjects

  • Other topics:
    • Education
    • Research capacity building

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine