Tools and Models

The tools and models below introduce a broad range of thinking and perspectives on the conceptualization, design, conduct, analysis, dissemination and utilization of research. They are intended to prompt users to further explore these areas.

1. Introduction

	Converge Annotated Bibliography
	Converge e-Library
	Glossaries and Definitions
	Databases

2. Research Context

Conceptualization

	Research Question
	Theory Building

	Evidence-Base
	Literature Review and Synthesis

Paradigms

	General
	Futurism

3. Approaches

Graphic Models and Tools

	Concept Mapping
	Design Thinking
	Experience Modeling
	Logic Model
	Other Graphic Models and Tools

4. Ethical Issues

5. Research Design & Methods

	General
	Instruments and Measures

	General
	Control

Research Methods

	General
	Scientific Method
	Case Studies
	Design-Based Research
	Experimental Research
	Interviews
	Program Evaluation
	Sustainability

6. Analyzing Results

Statistics and Analysis

	Data
	Multiple Imputation
	Social Network Analysis
	Statistical vs. Substantive Significance
	Structural Equation Modeling

7. Report Writing

Guidelines for Writing and Publishing a Research Report

8. Disseminating Results

	Disseminating (and Utilizing) Results
	Knowledge Building and Dissemination
	The Gap between Research and Programs

Back to Top

 

1. Introduction

Converge Annotated Bibliography

 

Converge e-Library

 

Glossaries and Definitions

• APA Style: The Social Sciences
  Diana Hacker
  Provides examples of in-text citations, list of references and manuscript format
  
• Glossary of Mixed Methods Terms/Concepts
  Adopted from Tashakkori and Teddlie's
  More than 75 terms and concepts from Handbook of Mixed Methods in the Social and Behavioral Research
• Glossary of Research Terms
  Diana Hacker
  Alpha listing of terms, from abstract to wild card
  
• How to Design and Evaluate Research in Education Glossary
  McGraw Hill Online Learning Center
  Glossary of research terminology
• Listing by Type of Document
  Joshua Lederberg
  The National Library or Medicine's collection of Lederberg's lists of document types
• Mediator Variable
  University of Mannheim
  In depth explanation of a mediator variable
• U.S. Census Populations with Bridged Race Categories
  National Center for Health Statistics
  Definitions and explanation of comparability

Databases

• LigerCat: Literature and Genomics Resource Catalogue
  Uses MeSH terms to search PubMed

  Back to Top

2. Research Context

Conceptualization

Research Question

• The Research Question
  London Deanery
  Poses nine questions to ask when formulating a research question

Theory Building

• Theory Building
  Robert Dubin
  Introduction introduces guide to connect theoretical models and empirical research; chapter one analyzes the components of a theoretical model; chapter two contrasts goals of science, and distinguishes between doing research and asking questions; and chapter nine examines empirical indicators that give value to model component
• Bernard Lonergan (1904-1984)
  The Internet Encyclopedia of Philosophy
  Explores generalized empirical method (GEM) in ethics—Cognitional Theory, epistemology (objectivity), metaphysics, and methodology
• The Structure of Scientific Revolutions: Outline and Study Guide
  Thomas S. Kuhn (prepared by Frank Pajares)
  A history of science and the contributions of paradigms and the paradigm shift
• Reputation of Scholars and Scientific Specialization: An Encounter Between Sociology of Science and Political Science
  Mattei Dogan
  Uses Ortega Hypothesis and Lotka-Price Law to explore how science is shaped—by large numbers of scholars or an elite network

Evidence-Base

Back to Top

• Adult Literacy Policy, Scientifically Based Research, and Evidence-Based Practice
  Larry Mikulecky
  Responses towards adult literacy policy and based research data from national, organizational and international levels
• Data Provenance, Evidence-Based Policy Assessment, and e-Social Science
  Loma Philip, Alison Chorley, John Farrington, and Pete Edwards
  Application of Evidence Based Policy through e-Science to e-Social Science in research
• Evidence-Based Behavioral Medicine: What Is It and How Do We Achieve It?
  Multiple authors
  Description and explanation of the 22 CONSORT procedure and applying towards behavioral medicine
  research and evidence-based practice
• Evidence-Based Education (EBE)
  Grover J. (Russ) Whitehurst
  Keynote presentation on the importance of Evidence-Based Education supported by research and evidence
• Evidence-Based Policy: Proceed with Care
  Nick Black
  Models of policymaking and how to approach according to research’s influence
• Evidence-Based Programs: An Overview
  Siobhan M. Cooney, Mary Huser, Stephen Small, and Cailin O'Connor
  University of Wisconsin’s Evidence-Based Programs, including disadvantages and advantages
• Implementation Research: A Synthesis of the Literature
  Multiple authors
  Outline on implementation research by the National Implementation Research Network
• Making Education Evidence-Based: Premises, Principles, Pragmatics, and Politics
  Grover J. (Russ) Whitehurst
  Northwestern University’s lecture series focusing on the importance of Evidence-Based premises, principles, pragmatics and politics in education
• Making Sense of Research for Improving Education
  University of Texas at Austin
  Addresses language and classification, decision-making, and data collecting/measuring
• The Qualitative Foundations of Political Science Methodology
  George Thomas
  Review of four books of evidence-based, nonsubjective, rigorous, systematic and cumulative scientific process
• Systems to Rate the Strength of Scientific Evidence
  Multiple authors
  Report analyzes systematic approaches on evaluating the strength of scientific evidence by the Agency for Healthcare Research and Quality
• To Be or Not to Be...Evidence-Based?
  Larke Nahme Huang, Kathy S. Hepburn, Rachele C. Espiritu
  Evaluation newsletter on understanding evidence-based research and practice towards children and family
• Tools for Tracing Evidence in Social Science
  A. Chorley, E. Edwards, A. Preece, and J. Farrington
  Discussion on pressing pre-requisites for eSocial Science solutions; applies provenance techniques and describes the progress of the development
• What Is Evidence and What Is the Problem?
  Merry Bullock
  Evidence-based research and its existing problems
• Standards of Evidence, Strategic Planning Initiative
  The National Academies
  Division on improving quality of evidence in behavioral and social sciences and tying it to related fields like public policy and practice
• Systems to Rate the Strength of Scientific Evidence
  US Department of Health & Human Services
  Description of systems on rating scientific evidence based on quality, grade, development and performance

Literature Review and Synthesis

Back to Top

• Literature Reviews
  University of North Carolina at Chapel Hill
  Contains basic information on writing literature reviews, including strategies
• A Systems Approach to Conduct an Effective Literature Review in Support of Information Systems Research
  Yair Levy and Timothy J. Ellis
  Provides a framework with three stages: inputs, processing and outputs

Paradigms

General

• The Creation of Theory: A Recent Application of the Grounded Theory Method
  Naresh R. Pandit
  Theory-building using the grounded theory method, computerized databases and qualitative analysis software
• Index of Theories and Models of Learning for Educational Research and Practice
  Learning-Theories.com
  A knowledge base of learning theories
• Knowledge Management’s Hierarchy of Needs: Mapping Your Knowledge Program Against Maslow’s Famous “Hierarchy of Needs” Can Help You Predict—and avoid—disconnects
  Jon Powell and Jean Egmon
  Different approach on Maslow’s Hierarchy of Needs through the Knowledge Management method
• Models of aggregation, competition, collective thinking, decision and learning, networks and diffusion, Markov and Urn, and robustness
  Scott E. Page
  Includes models of aggression, competition, collective thinking and decision making, and networks and diffusion
• Simple Framing: An Introduction to Framing and Its Uses in Politics
  George Lackoff
  Framing explored as a tool for negotiating and communication

Futurism

• The Futurist
  World Future Society
  Magazine publication of trends and visions of the future
• History and Mathematics: Analyzing and Modeling Global Development
  L. Grinin, V. Munck and A. Korotayev
  Application of mathematical methods and models towards history and society on various scales
• Introduction to Future Studies
  Linda Groff and Paul Smoker
  Examination of Future Studies Field’s history, methodology, design and views

3. Approaches

Back to Top

Graphic Models and Tools

Concept Mapping

• Concept Mapping Resource Guide
  Web Center for Social Research Methods
  Includes introductory materials, case studies and other research, as well as information about Concept Systems software
• The Theory Underlying Concept Maps and How to Construct and Use Them
  Joseph D. Novak and Alberto J. Cañas
  Psychological and epistemological foundations, construction guide, software toolkit, education model, and knowledge archiving
• Types of Maps
  Jon Margerum-Leys
  Provides samples of concept maps with visual illustrations

Design Thinking

• Design Thinking Approach
  IDEO, Inc.
  Explains IDEO’s utilization of design thinking, including symbolic representation
• Social Impact
  IDEO, Inc.
  Provides information on how IDEO uses design thinking to create social impact

Experience Modeling

• Experience Models: How are They Made and What do They Offer?
  Margeret Morris and Arnie Lund
  Discussion of experience models and their value and opportunity among research, with case examples

Logic Model

Back to Top

• Logic Model
  University of Wisconsin - Extension
  Extension's logic model presented in detail
• Logic Model Development Guide: Using Logic Models to Bring Together Planning, Evaluation, and Action
  W. K. Kellogg Foundation
  Includes information on developing logic models for programs and theory-of-change

Other Graphic Models and Tools

• Tree of Knowledge System
  Gregg Henriques
  A scientific approach toward understanding people and the world

4. Ethical Issues

• Ethical and Legal Aspects of Human Subjects Research on the Internet
  Mark S. Frankel and Sanyin Siang
  Examines basic principles, benefits and risks, informed consent, private and confidentiality, and justice
• Ethical Issues in Qualitative Research on Internet Communities
  Gunther Eysenbach and James E. Till
  Examines Internet's potential usefulness to research and intrusiveness to subjects
• Ethics in Research
  Research Methods Knowledge Base
  Discusses the fundamentals of research ethics
• The Institutional Review Board - Discussion and News Forum
  IRB Forum
  Discussions on policy, ethical and regulatory concerns

5. Research Design & Methods

General

• Study Designs
  Centre for Evidence Based Medicine
  Offers a guides to different types of studies and the advantages/disadvantages thereof
• Summaries of Instruments
  Wilderdom: A Project in Natural Living & Transformation
  Provides information of the analysis of group and personal change in both psychosocial training and intervention programs
  

Instruments and Measures

General

• Alternative Approaches to Assessing Student Engagement Rates
  Elaine Chapman
  Discusses self-report measures, checklists and rating scales, direct observations, work sample analysis, and focused case studies
• Buros Institute of Mental Measures
  University of Nebraska - Lincoln
  Provides assistance and information to help entities with test selection/utilization and practice
  
• Finding Tests, Surveys, and Measurements
  University of North Carolina University
  A library guide for individuals to find reviews of tests and acquire copies of them
• Likert Scale
  Compiled by Del Siegle
  Likert Scale tables feature common choices to design an attitude instrument
• Measure Chest
  Academy of Management Research Methods Division
  Listing of types of measures, including diversity and gender issues

Control

• Concepts of Control
  Charles Blaha
  Explores the concept of control and how to use it
  

 

Research Methods

Back to Top

General

• By Design: Planning Research on Higher Education
  Richard J. Light, Judith D. Singer, and John B. Willett
  Focuses on research design that produces useful and effective findings
• Communication Research Methods
  Compiled by John C. Reinard
  Outline (with concepts) of an experimental research design in communication
• Methodological Advances and the Human Capital Initiative
  National Science Foundation
  Presents an array of statistics, surveys, methods and research
• National Centre for Research Methods
  Economic and Social Research Council
  ESRC’s NCSRM research groups train and study certain social science methods
• Research Methods Knowledge Base
  Web Center for Social Research Methods
  Web-based textbook focusing on the research process: sampling, measurement, design, data analysis, validity, reliability and ethics
• Research Tools and Methods
  Intute: Best of the Web
  Allows individuals to search the Internet for social research methods
• Research Methods Tutorial
  SocialResearchMethods.Net
  Covers foundations, sampling and external validity, measurement and construct validity, resaerch deign and internal validity, and data analysis and conclusion validity
• Types of Education Research
  Education Commission of the States
  Contains descriptive and experimental resaerch questions and designs, quantitative and qualitative data, and data collection strategies
  

Scientific Method

• Steps of the Scientific Method
  Experiment-Resources.com
  Speaks generally to the method in stages, as well provides definitions to questions such as What is research? and What is scientific method?
  

Case Studies

• The Case Study as a Research Method
  Susan K. Soy
  In six steps: research questions, determining data gathering, preparing to collect data, collection of data in field, evaluation and analyzing data, and preparing for report

Design-Based Research

Back to Top

• Design-Based Research: Putting a Stake in the Ground
  Sasha Barab and Kurt Squire
  Focuses on characterizing design-based research, advancing credible assertions, and defining the naturalistic context
• Design Research for Advancing the Integration of Digital Technologies into Teaching and Learning
  Tom Reeves
  Discusses pedagogy in solving local issues through a process: identify problems, develop prototype solutions, testing answers in situ, and obtain design standard

Experimental Research

• Conducting Repeated Measures Analyses: Experimental Design Considerations
  Amy Minke
  Considers univariate and multivariate approaches for repeated measures data analysis
• Controlling for Confounding Variables, Choosing a Design, Pre-Experimental Designs, Quasi-Experimental Designs, Experimental Designs, Activity on Experimental Designs, Single-Subject Design Ideas
  San Diego State University
  Guideline to aid in selecting a design for research including: pre-experimental, quasi-experimental, experimental, and single subject
• STEM EDUCATION RESEARCH DESIGNS: Conceptual and Practical Considerations for Planning Experimental Studies
  MSPnet
  Conference transcripts and PowerPoints on How Randomized Field Trails Help Democratize Knowledge in Education, STEM Education Research Designs, and A Claims-Based Approach to Evaluation
  

Interviews

• Conducting Qualitative In-Depth Interviews
  William Marsiglio
  Explore the purpose and basic technique associated with qualitative in-depth interviews
  

Program Evaluation

• Focus the Evaluation Design
  Centers for Disease Control and Prevention
  Program planner’s evaluation manual
• Managing for Impact in Rural Development: A Guide for Project M&E
  International Fund for Agricultural Development
  Guide created to support and improve the quality of M&E in IFAD-supported projects
• Evaluation Tools for Racial Equity
  The Center for Assessment and Policy Development (CAPD) and MP Associates
  Includes information on issues such as: racial equity, conducting evaluations, and terms and vocabulary
  

Sustainability

Back to Top

• Exploring Program Sustainability: Identifying Factors in Two Educational Initiatives in Victoria
  Graeme Harvey and Rosalind Hurworth
  Paper on two thriving school-based health initiatives with sustainability including: drug education and eating health
• Institutionalization and Sustainability of the National Science Foundation’s Advanced Technological Education Program
  Multiple authors
  Examines the Advanced Technological Education program
• Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
  Mary Ann Scheirer
  Includes definitions such as measuring sustainability, measured benefits, and maintained community capacity, as well as five sustainability factors
• Sustainability Took Kit
  Univerité de Montréal
  Tool kit for assessing sustainability methods and levels of public health plans and projects
• Sustaining and Institutionalizing Your Project
  Sinclair Community College
  Guide on sustainability and institutionalization for individual projects
  

6. Analyzing Results

Statistics and Analysis

Data

• Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
  Judith D. Singer and John B. Willett
  Applied Longitudinal Data Analysis book support and additional resources
• Methodological Issues in Mixed Methods Data: The Use of Qualitative and Quantitative Data in Health Services Research
  Susan Zickmund
  Provides the "A, B, Cs" of qualitative research, introductory guide to mixed methods, ideas on translating qualitative ideas into measurable outcomes
  
• Modern Statistical Techniques for the Analysis of Longitudinal Data in Biomedical Research
  Lloyd J. Edwards
  Discussion and analysis of longitudinal data executed by a study of two current statistical techniques used in Biomedical Research, where techniques include: general linear mixed model and generalized estimating equations
• Multilevel & Longitudinal Analysis, Annotated Bibliography
  Oregon Research Institute
  Annotated bibliography of Multilevel & Longitudinal Analysis modeling across social science disciplines
• Temporal GIS and Statistical Modeling of Personal Lifelines
  Marius Thériault, Christophe Claramunt, Anne-Marie Ségun and Paul Villeneuve
  Report on spatio-temporal database model across a time line integrating survival analysis, Cox regression and temporal GIS
• Selected Papers on Discrete-Time Survival Analysis
  Prepared by John B. Willett
  Papers on Discrete-Time Survival Analysis presented by authors J. D. Singer and J. B. Willett

Multiple Imputation

Back to Top

• Proper and Improper Multiple Imputation
  Søren Feodor Nielson
  Statistical paper argues how Bayesian multiple imputation does not lead to proper multiple imputation
• The Multiple Imputation FAQ Page
  Joseph L. Schafer
  Answers questions around multiple imputation

Social Network Analysis

• Social Network Analysis, A Brief Introduction
  OrgNet.Com
  Discusses the measures that provide insight into the groupings and roles in a network
  

Statistical vs. Substantive Significance

• The Concept of Statistical Significance in Testing Hypotheses
  Julian L. Simon
  Discusses interpretations of statistical significance as a concept, as well as "level of significance"
  
• Three Types of Significance
  Department of Sociology, University of California Los Angeles
  Explains statistical, substantive and causal significance (including asymmetry, time order, and counterfactual, intervention or "surgery")

Structural Equation Modeling

• Principles and Practice of Structural Equation Modeling
  Rex B. Kline
  Chapters 2-9 by NC State’s College of Humanities and Social Science
• Stats: Structural Change
  Australian Market and Social Research Society
  Advantages of Structural Equation Modeling (SEM) and its place in linear regression
• Structural Equation Model
  Chong-ho Yu
  The dissection of the Structural Equation Model (SEM) with a brief illustration of SEM’s AMOS software
• Structural Equation Modeling
  Dave Garson
  Statnotes on Structural Equation Modeling (SEM) including key concepts, terms and models
• Structural Equation Modeling
  Electronic Statistics Textbook
  Fundamental idea of Structural Equation Modeling including the path diagram

7. Report Writing

Back to Top

Guidelines for Writing and Publishing a Research Report

• Empirical Research Report Format
  WIRE (Writing in Rutgers Education)
  Step by step guide to report writing: title, authors, abstract, introduction, methods and materials, results, discussion and references
  
• Science Research Report Format
  Environmental Literacy Council
  Provides tips for before writing, an outline for reporting, and common problems
• Standards for Reporting on Empirical Social Science Research in AERA Publications
  American Educational Research Association
  Includes problem formulation; design and logic; sources of evidence; measurement and classification; analysis and interpretation; generalization; ethics in reporting; and title, abstract and heading
• Writing Guides
  Psychology Writing Center, University of Washington
  Detailed information on recommended writing guides, scientific writing and APA format, citations, avoiding plagiarism, graduate school application, general writing, and exams and assignments
• Writing the Empirical Journal Article
  Daryle J. Bem
  Includes planning, writing, rewriting/polishing, and publishing your article, in addition to tips on style and references

8. Disseminating Results

Disseminating (and Utilizing) Results

• Impact of Research on Policy and Practice
  John Young
  Article examines which aspects should be strengthened to increase research’s influence on policy
• Percolated or Espresso? The Ways in which Education Research Influences Policy Development in Australia
  Louise Watson
  Examines research’s influence on public policy development, the diverse research community’s disproportionate effect on public policy, and the policy development cycle
• Using ‘Linkage and Exchange’ to Move Research into Policy at a Canadian Foundation
  Jonathan Lomas
  Essay provides information on the Canadian Health Services Research Foundation, arguments for collaboration, building in linkage and exchange, and plans for evaluation
• Using Research-Based Evidence to Improve Policy, Programs and Practice in Canadian Health Systems
  Irving Gold
  PowerPoint provides background information on the Canadian Health Services Research Foundation, as well as Knowledge Transfer & Exchange (KT&E), including push, pull and exchange efforts
• Role of Evidence in Policy Processes
  Overseas Development Institute
  Provides resources on improving the understanding of the role of research in policy processes
• State Policy Guide: Using Research in Public Health Policymaking
  The Council of State Governments
  Report addresses the rationale for using research results in policymaking, key facts and terms in understanding public health research, and using research results in policymaking

Knowledge Building and Dissemination

• Dissemination and Implementation
  U.S. Department of Health and Human Services
  Translation of dissemination and implementation research in health
• Science of Dissemination and Implementation: Building Research Capacity to Bridge the Gap from Science to Service
  National Institutes of Health (NIH) Behavioral and Social Sciences Research (OBSSR)
  Post-conference materials on: Capturing, Evaluating, and Incorporating Practice-Based Evidence; Conceptual Models for Implementation Research; Process of Disseminating Interventions; and Models for Implementing and Sustaining Evidence-Based Programs
  
• Knowledge Management and Dissemination
  MSPnet
  Focuses on research methodology, diversity and equity, and knowledge management in mathematics and science related fields from K-12

The Gap between Research and Programs

• The Promise of Comparative Effectiveness Research
  Paul Sullivan and Don Goldmann
  To better address expensive health care, the gap between research and everyday practice is imperative, according to this article.
• Meaningful Disparities Reduction through Research and Translation Programs
  Marshall H. Chin and Don Goldmann
  Health disparities--an equity issue--can be assuaged by quality improvement, says this article.
  

Back to Top