 |
Tools and Models
The tools and models below introduce a broad range of thinking and perspectives on the conceptualization, design, conduct, analysis, dissemination and utilization of research. They are intended to prompt users to further explore these areas.
1. Introduction |
Converge Annotated Bibliography |
|
Glossaries and Definitions |
2. Research Context |
Conceptualization |
| Theory Building |
Evidence-Base |
|
Literature Review and Synthesis |
Paradigms |
| General | |
| Futurism |
3. Approaches |
Graphic Models and Tools |
| Concept Mapping | |
| Design Thinking | |
| Experience Modeling | |
| Logic Model |
4. Ethical Issues |
5. Research Design & Methods |
Instruments and Measures |
Research Methods |
| General | |
| Case Studies | |
| Design-Based Research | |
| Experimental Research | |
| Interviews | |
| Program Evaluation | |
| Sustainability |
6. Analyzing Results |
Statistics and Analysis |
| Longitudinal Data | |
| Multiple Imputation | |
| Statistical vs. Substantive Significance | |
| Structural Equation Modeling |
7. Report Writing |
Guidelines for Writing and Publishing a Research Report |
8. Disseminating Results |
Disseminating (and Utilizing) Results |
|
Knowledge Building and Dissemination |
1. Introduction
Converge Annotated Bibliography
Glossaries and Definitions
- APA Style: The Social Sciences
Diana Hacker
Provides examples of in-text citations, list of references and manuscript format
- Glossary of Mixed Methods Terms/Concepts
Adopted from Tashakkori and Teddlie's
More than 75 terms and concepts from Handbook of Mixed Methods in the Social and Behavioral Research - Glossary of Research Terms
Diana Hacker
Alpha listing of terms, from abstract to wild card
- How to Design and Evaluate Research in Education Glossary
McGraw Hill Online Learning Center
Glossary of research terminology - Listing by Type of Document
Joshua Lederberg
The National Library or Medicine's collection of Lederberg's lists of document types - Mediator Variable
University of Mannheim
In depth explanation of a mediator variable - U.S. Census Populations with Bridged Race Categories
National Center for Health Statistics
Definitions and explanation of comparability
2. Research Context
Conceptualization
Theory Building
- Introduction, Theory Building
Robert Dubin
Introduces guide to connect theoretical models and empirical research - Chapter 1: To Begin With, Theory Building
Robert Dubin
Analyzes the components of a theoretical model - Chapter 2: Theory, Theory Building
Robert Dubin
Contrasts goals of science, and distinguishes between doing research and asking questions - Chapter 9: Empirical Indicators, Theory Building
Robert Dubin
Examines empirical indicators that give value to model component - Bernard Lonergan (1904-1984)
The Internet Encyclopedia of Philosophy
Explores generalized empirical method (GEM) in ethics—Cognitional Theory, epistemology (objectivity), metaphysics, and methodology - The Structure of Scientific Revolutions: Outline and Study Guide
Thomas S. Kuhn (prepared by Frank Pajares)
A history of science and the contributions of paradigms and the paradigm shift - Reputation of Scholars and Scientific Specialization: An Encounter Between Sociology of Science and Political Science
Mattei Dogan
Uses Ortega Hypothesis and Lotka-Price Law to explore how science is shaped—by large numbers of scholars or an elite network
Evidence-Base |
- Adult Literacy Policy, Scientifically Based Research, and Evidence-Based Practice
Larry Mikulecky
Responses towards adult literacy policy and based research data from national, organizational and international levels - Data Provenance, Evidence-Based Policy Assessment, and e-Social Science
Loma Philip, Alison Chorley, John Farrington, and Pete Edwards
Application of Evidence Based Policy through e-Science to e-Social Science in research - Evidence-Based Behavioral Medicine: What Is It and How Do We Achieve It?
Multiple authors
Description and explanation of the 22 CONSORT procedure and applying towards behavioral medicine
research and evidence-based practice - Evidence-Based Education (EBE)
Grover J. (Russ) Whitehurst
Keynote presentation on the importance of Evidence-Based Education supported by research and evidence - Evidence-Based Policy Research: Extracted Comments
Centre for Educational Research and Innovation
Compilation of Evidence-Based Policy Research comments including causation, feasibility, economic evaluation and random allocation - Evidence-Based Policy: Proceed with Care
Nick Black
Models of policymaking and how to approach according to research’s influence - Evidence-Based Programs: An Overview
Siobhan M. Cooney, Mary Huser, Stephen Small, and Cailin O'Connor
University of Wisconsin’s Evidence-Based Programs, including disadvantages and advantages - Implementation Research: A Synthesis of the Literature
Multiple authors
Outline on implementation research by the National Implementation Research Network - Making Education Evidence-Based: Premises, Principles, Pragmatics, and Politics
Grover J. (Russ) Whitehurst
Northwestern University’s lecture series focusing on the importance of Evidence-Based premises, principles, pragmatics and politics in education - Making Sense of Research for Improving Education
University of Texas at Austin
Addresses language and classification, decision-making, and data collecting/measuring - The Qualitative Foundations of Political Science Methodology
George Thomas
Review of four books of evidence-based, nonsubjective, rigorous, systematic and cumulative scientific process - Social Science and Evidence-Based Everything: The Case of Education
Ann Oakley
Discussion of “the evidence movement” and systematic review of educational research - Systems to Rate the Strength of Scientific Evidence
Multiple authors
Report analyzes systematic approaches on evaluating the strength of scientific evidence by the Agency for Healthcare Research and Quality - To Be or Not to Be...Evidence-Based?
Larke Nahme Huang, Kathy S. Hepburn, Rachele C. Espiritu
Evaluation newsletter on understanding evidence-based research and practice towards children and family - Tools for Tracing Evidence in Social Science
A. Chorley, E. Edwards, A. Preece, and J. Farrington
Discussion on pressing pre-requisites for eSocial Science solutions; applies provenance techniques and describes the progress of the development - What Is Evidence and What Is the Problem?
Merry Bullock
Evidence-based research and its existing problems - Plan, Design and Conduct Quality Research
University of Medicine & Dentistry of New Jersey
List of a variety of guides and designs for qualitative research - Standards of Evidence, Strategic Planning Initiative
The National Academies
Division on improving quality of evidence in behavioral and social sciences and tying it to related fields like public policy and practice - Systems to Rate the Strength of Scientific Evidence
US Department of Health & Human Services
Description of systems on rating scientific evidence based on quality, grade, development and performance - The Secrets Behind Producing Meaningful Quantitative Research: What Every Foundation Official Really Needs to Know
Fred J. Galloway
Discussion of basics and causalities in research design with a presentation of common technique in quantitative and multiple-regression analysis; also offers data problems and solutions
Literature Review and Synthesis |
- Literature Reviews
University of North Carolina at Chapel Hill
Contains basic information on writing literature reviews, including strategies - A Systems Approach to Conduct an Effective Literature Review in Support of Information Systems Research
Yair Levy and Timothy J. Ellis
Provides a framework with three stages: inputs, processing and outputs
Paradigms
General
- The Creation of Theory: A Recent Application of the Grounded Theory Method
Naresh R. Pandit
Theory-building using the grounded theory method, computerized databases and qualitative analysis software - Index of Theories and Models of Learning for Educational Research and Practice
Learning-Theories.com
A knowledge base of learning theories - Knowledge Management’s Hierarchy of Needs: Mapping Your Knowledge Program Against Maslow’s Famous “Hierarchy of Needs” Can Help You Predict—and avoid—disconnects
Jon Powell and Jean Egmon
Different approach on Maslow’s Hierarchy of Needs through the Knowledge Management method - Models of aggregation, competition, collective thinking, decision and learning, networks and diffusion, Markov and Urn, and robustness
Scott E. Page
Includes models of aggression, competition, collective thinking and decision making, and networks and diffusion - Simple Framing: An Introduction to Framing and Its Uses in Politics
George Lackoff
Framing explored as a tool for negotiating and communication
Futurism
- The Futurist
World Future Society
Magazine publication of trends and visions of the future - History and Mathematics: Analyzing and Modeling Global Development
L. Grinin, V. Munck and A. Korotayev
Application of mathematical methods and models towards history and society on various scales - Introduction to Future Studies
Linda Groff and Paul Smoker
Examination of Future Studies Field’s history, methodology, design and views
3. Approaches |
Graphic Models and Tools
Concept Mapping
- Concept Mapping Resource Guide
Web Center for Social Research Methods
Includes introductory materials, case studies and other research, as well as information about Concept Systems software - Introduction to Concept Maps
The Discovery Team, Discovery System Online
Definition, purpose and applications of concept maps - Kinds of Concept Maps
The Discovery Team, Discovery System Online
Describes four categories: spider, hierarchy, flowchart and systems - The Theory Underlying Concept Maps and How to Construct and Use Them
Joseph D. Novak and Alberto J. Cañas
Psychological and epistemological foundations, construction guide, software toolkit, education model, and knowledge archiving - Types of Maps
Jon Margerum-Leys
Provides samples of concept maps with visual illustrations
Design Thinking
- Design Thinking Approach
IDEO, Inc.
Explains IDEO’s utilization of design thinking, including symbolic representation - Social Impact
IDEO, Inc.
Provides information on how IDEO uses design thinking to create social impact
Experience Modeling
- Experience Models: How Are They Made and What do They Offer?
Margaret Morris and Arnie Lund
Discussion of experience models and their value and opportunity among research, with case examples
Logic Model |
- Logic Model
University of Wisconsin - Extension
Extension's logic model presented in detail - Logic Model Development Guide: Using Logic Models to Bring Together Planning, Evaluation, and Action
W. K. Kellogg Foundation
Includes information on developing logic models for programs and theory-of-change
- Using A Logic Model for Evaluation Planning
US Department of Health and Human Services
Discusses benefits of using a logic model
4. Ethical Issues
- Ethical and Legal Aspects of Human Subjects Research on the Internet
Mark S. Frankel and Sanyin Siang
Examines basic principles, benefits and risks, informed consent, private and confidentiality, and justice - Ethical Issues in Qualitative Research on Internet Communities
Gunther Eysenbach and James E. Till
Examines Internet's potential usefulness to research and intrusiveness to subjects - Ethics in Research
Research Methods Knowledge Base
Discusses the fundamentals of research ethics - The Institutional Review Board - Discussion and News Forum
IRB Forum
Discussions on policy, ethical and regulatory concerns
5. Research Design & Methods
Instruments and Measures
- Alternative Approaches to Assessing Student Engagement Rates
Elaine Chapman
Discusses self-report measures, checklists and rating scales, direct observations, work sample analysis, and focused case studies - Buros Institute of Mental Measures
University of Nebraska - Lincoln
Provides assistance and information to help entities with test selection/utilization and practice
- Finding Tests, Surveys, and Measurements
University of North Carolina University
A library guide for individuals to find reviews of tests and acquire copies of them - Likert Scale
Compiled by Del Siegle
Likert Scale tables feature common choices to design an attitude instrument - Measure Chest
Academy of Management Research Methods Division
Listing of types of measures, including diversity and gender issues
Research Methods |
General
- By Design: Planning Research on Higher Education
Richard J. Light, Judith D. Singer, and John B. Willett
Focuses on research design that produces useful and effective findings - Communication Research Methods
Compiled by John C. Reinard
Outline (with concepts) of an experimental research design in communication - Methodological Advances and the Human Capital Initiative
National Science Foundation
Presents an array of statistics, surveys, methods and research - National Centre for Research Methods
Economic and Social Research Council
ESRC’s NCSRM research groups train and study certain social science methods - Research Methods Knowledge Base
Web Center for Social Research Methods
Web-based textbook focusing on the research process: sampling, measurement, design, data analysis, validity, reliability and ethics - Research Tools and Methods
Intute: Best of the Web
Allows individuals to search the Internet for social research methods
Case Studies
- The Case Study as a Research Method
Susan K. Soy
In six steps: research questions, determining data gathering, preparing to collect data, collection of data in field, evaluation and analyzing data, and preparing for report
Design-Based Research |
- Design-Based Research: Putting a Stake in the Ground
Sasha Barab and Kurt Squire
Focuses on characterizing design-based research, advancing credible assertions, and defining the naturalistic context - Design Research for Advancing the Integration of Digital Technologies into Teaching and Learning
Tom Reeves
Discusses pedagogy in solving local issues through a process: identify problems, develop prototype solutions, testing answers in situ, and obtain design standard - Instructional Design Perspectives on Mathematics Education with Reference to Vygotsky's Theory of Social Cognition
Brent G. Wilson, James L. Teslow and Lyn Taylor
Discusses paradigm wars in instructional design, mathematics and sensemaking, and teaching strategies
Experimental Research
- Controlling for Confounding Variables, Choosing a Design, Pre-Experimental Designs, Quasi-Experimental Designs, Experimental Designs, Activity on Experimental Designs, Single-Subject Design Ideas
San Diego State University
Guideline to aid in selecting a design for research including: pre-experimental, quasi-experimental, experimental, and single subject - Experimental Design: Control
Alan Marks
Chapter on “Control” and how to use it in various types of experiments - STEM EDUCATION RESEARCH DESIGNS: Conceptual and Practical Considerations for Planning Experimental Studies
MSPnet
Conference transcripts and PowerPoints on How Randomized Field Trails Help Democratize Knowledge in Education, STEM Education Research Designs, and A Claims-Based Approach to Evaluation
Interviews
- Conducting Qualitative In-Depth Interviews
William Marsiglio
Explore the purpose and basic technique associated with qualitative in-depth interviews
Program Evaluation
- Focus the Evaluation Design
Centers for Disease Control and Prevention
Program planner’s evaluation manual - Managing for Impact in Rural Development: A Guide for Project M&E
International Fund for Agricultural Development
Guide created to support and improve the quality of M&E in IFAD-supported projects - Evaluation Tools for Racial Equity
The Center for Assessment and Policy Development (CAPD) and MP Associates
Includes information on issues such as: racial equity, conducting evaluations, and terms and vocabulary
Sustainability |
- Evaluate Your Project's Sustainability
Frances Lawrenz and Nanette Keiser
Model for sustainability through evaluation, enhancement and checklist - Exploring Program Sustainability: Identifying Factors in Two Educational Initiatives in Victoria
Graeme Harvey and Rosalind Hurworth
Paper on two thriving school-based health initiatives with sustainability including: drug education and eating health - Institutionalization and Sustainability of the National Science Foundation’s Advanced Technological Education Program
Multiple authors
Examines the Advanced Technological Education program - Is Sustainability Possible? A Review and Commentary on Empirical Studies of Program Sustainability
Mary Ann Scheirer
Includes definitions such as measuring sustainability, measured benefits, and maintained community capacity, as well as five sustainability factors - Sustainability Checklist
Frances Lawrenz and Nanette Keiser
Includes decision making, support, promoting and marketing, and collaborative relationships - Sustainability Took Kit
Univerité de Montréal
Tool kit for assessing sustainability methods and levels of public health plans and projects - Sustaining and Institutionalizing Your Project
Sinclair Community College
Guide on sustainability and institutionalization for individual projects - The Sustainability of Advanced Technological Education Supported Efforts: An Evaluation
Wayne W. Welch and Arlen R. Gullickson
Report of Advanced Technology grantee’s methods and the degree on continuing projects after the termination of NSF funds
6. Analyzing Results
Statistics and Analysis
Longitudinal Data
- Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Judith D. Singer and John B. Willett
Applied Longitudinal Data Analysis book support and additional resources - Modern Statistical Techniques for the Analysis of Longitudinal Data in Biomedical Research
Lloyd J. Edwards
Discussion and analysis of longitudinal data executed by a study of two current statistical techniques used in Biomedical Research, where techniques include: general linear mixed model and generalized estimating equations - Multilevel & Longitudinal Analysis, Annotated Bibliography
Oregon Research Institute
Annotated bibliography of Multilevel & Longitudinal Analysis modeling across social science disciplines - Temporal GIS and Statistical Modeling of Personal Lifelines
Marius Thériault, Christophe Claramunt, Anne-Marie Ségun and Paul Villeneuve
Report on spatio-temporal database model across a time line integrating survival analysis, Cox regression and temporal GIS - Selected Papers on Discrete-Time Survival Analysis
Prepared by John B. Willett
Papers on Discrete-Time Survival Analysis presented by authors J. D. Singer and J. B. Willett
Multiple Imputation |
- Proper and Improper Multiple Imputation
Søren Feodor Nielson
Statistical paper argues how Bayesian multiple imputation does not lead to proper multiple imputation - The Multiple Imputation FAQ Page
Joseph L. Schafer
Answers questions around multiple imputation
Statistical vs. Substantive Significance
- The Concept of Statistical Significance in Testing Hypotheses
Julian L. Simon
Discusses interpretations of statistical significance as a concept, as well as "level of significance"
- Three Types of Significance
Department of Sociology, University of California Los Angeles
Explains statistical, substantive and causal significance (including asymmetry, time order, and counterfactual, intervention or "surgery")
Structural Equation Modeling
- Principles and Practice of Structural Equation Modeling
Rex B. Kline
Chapters 2-9 by NC State’s College of Humanities and Social Science - Stats: Structural Change
Australian Market and Social Research Society
Advantages of Structural Equation Modeling (SEM) and its place in linear regression - Structural Equation Model
Chong-ho Yu
The dissection of the Structural Equation Model (SEM) with a brief illustration of SEM’s AMOS software - Structural Equation Modeling
Dave Garson
Statnotes on Structural Equation Modeling (SEM) including key concepts, terms and models - Structural Equation Modeling
Electronic Statistics Textbook
Fundamental idea of Structural Equation Modeling including the path diagram
7. Report Writing |
Guidelines for Writing and Publishing a Research Report
- Empirical Research Report Format
WIRE (Writing in Rutgers Education)
Step by step guide to report writing: title, authors, abstract, introduction, methods and materials, results, discussion and references
- Science Research Report Format
Environmental Literacy Council
Provides tips for before writing, an outline for reporting, and common problems - Standards for Reporting on Empirical Social Science Research in AERA Publications
American Educational Research Association
Includes problem formulation; design and logic; sources of evidence; measurement and classification; analysis and interpretation; generalization; ethics in reporting; and title, abstract and heading - Writing an Empirical Paper APA Style
Psychology Writing Center, University of Washington
Detailed instructions on utilizing APA in the context of an empirical paper - Writing the Empirical Journal Article
Daryle J. Bem
Includes planning, writing, rewriting/polishing, and publishing your article, in addition to tips on style and references
8. Disseminating Results
Disseminating (and Utilizing) Results
- Impact of Research on Policy and Practice
John Young
Article examines which aspects should be strengthened to increase research’s influence on policy - Percolated or Espresso? The Ways in which Education Research Influences Policy Development in Australia
Louise Watson
Examines research’s influence on public policy development, the diverse research community’s disproportionate effect on public policy, and the policy development cycle - Using ‘Linkage and Exchange’ to Move Research into Policy at a Canadian Foundation
Jonathan Lomas
Essay provides information on the Canadian Health Services Research Foundation, arguments for collaboration, building in linkage and exchange, and plans for evaluation - Using Research-Based Evidence to Improve Policy, Programs and Practice in Canadian Health Systems
Irving Gold
PowerPoint provides background information on the Canadian Health Services Research Foundation, as well as Knowledge Transfer & Exchange (KT&E), including push, pull and exchange efforts - Role of Evidence in Policy Processes
Overseas Development Institute
Provides resources on improving the understanding of the role of research in policy processes - State Policy Guide: Using Research in Public Health Policymaking
The Council of State Governments
Report addresses the rationale for using research results in policymaking, key facts and terms in understanding public health research, and using research results in policymaking
Knowledge Building and Dissemination
- Dissemination and Implementation
U.S. Department of Health and Human Services
Translation of dissemination and implementation research in health - Science of Dissemination and Implementation: Building Research Capacity to Bridge the Gap from Science to Service
National Institutes of Health (NIH) Behavioral and Social Sciences Research (OBSSR)
Post-conference materials on: Capturing, Evaluating, and Incorporating Practice-Based Evidence; Conceptual Models for Implementation Research; Process of Disseminating Interventions; and Models for Implementing and Sustaining Evidence-Based Programs
- Knowledge Management and Dissemination
MSPnet
Focuses on research methodology, diversity and equity, and knowledge management in mathematics and science related fields from K-12
