Elements

The Research Roadmap
Version 1.8

	N/A 1 2 3 4 5 Done
O1. Collegiality. Does the research respect the scientific community, by reading, referencing and building on other's work?
O2. Scientific thinking. Does the research give reasons before conclusions, and derive conclusions from what went before?
O3. Academic format. Are ideas connected together logically and consistently?
O3a. Does the introduction define the literature review topic?
O3b. Does the theory review lead to a research question?
O3c. Is the method appropriate for the research question?
O3d. Does the method create data that answers the research question?
O3e. Do the analysis conclusions address the research question?
O3f. Are the implications derived from the conclusions?
O4. Correct language. Are there language errors (spelling or grammar)?
O5. Opinion statements. Are there unjustified opinion statements that cannot withstand critical review?
O6. Is the research relevant? ?Useful to others? (Introduction, Discussion)
O7. Is the research rigorous? –Scientifically correct? (Method, Results)
O8. Is the research generalizable? –Widely applicable? (Theory, Discussion)
O9. Is the research logical? ?Consistent and logical sequence of ideas? (All)
O10. Is the research well written? ?Interesting and understandable? (All)

N/A 1 2 3 4 5 Done

O1. Collegiality. Does the research respect the scientific community, by reading, referencing and building on other's work?

O2. Scientific thinking. Does the research give reasons before conclusions, and derive conclusions from what went before?

O3. Academic format. Are ideas connected together logically and consistently?

O3a. Does the introduction define the literature review topic?

O3b. Does the theory review lead to a research question?

O3c. Is the method appropriate for the research question?

O3d. Does the method create data that answers the research question?

O3e. Do the analysis conclusions address the research question?

O3f. Are the implications derived from the conclusions?

O4. Correct language. Are there language errors (spelling or grammar)?

O5. Opinion statements. Are there unjustified opinion statements that cannot withstand critical review?

O6. Is the research relevant? ?Useful to others? (Introduction, Discussion)

O7. Is the research rigorous? –Scientifically correct? (Method, Results)

O8. Is the research generalizable? –Widely applicable? (Theory, Discussion)

O9. Is the research logical? ?Consistent and logical sequence of ideas? (All)

O10. Is the research well written? ?Interesting and understandable? (All)

Introduction	N/A 1 2 3 4 5 Done
I1. Title. Does the title describe the topic/contribution in an interesting way, and invite the reader to read on?
I2. Author(s). Are authors in contribution order, and could each present the publication at a conference?
I3. Abstract. Does the abstract state the paper's main purpose, results and implications?
I4. Problem. Is the practical problem the research addresses stated?
I5. Topic. Is there one topic referred to consistently throughout the paper?
I6. Purpose. Is the research purpose stated in a single sentence within the first few pages?
I7. Publication type. Is publication type (e.g. review, proposal or empirical study) stated early, so readers know what to expect?
I8. Background. Does a brief background history introduce the research?
I9. Target audience. Is the target audience, who should read the paper, stated?

Introduction

N/A 1 2 3 4 5 Done

I1. Title. Does the title describe the topic/contribution in an interesting way, and invite the reader to read on?

I2. Author(s). Are authors in contribution order, and could each present the publication at a conference?

I3. Abstract. Does the abstract state the paper's main purpose, results and implications?

I4. Problem. Is the practical problem the research addresses stated?

I5. Topic. Is there one topic referred to consistently throughout the paper?

I6. Purpose. Is the research purpose stated in a single sentence within the first few pages?

I7. Publication type. Is publication type (e.g. review, proposal or empirical study) stated early, so readers know what to expect?

I8. Background. Does a brief background history introduce the research?

I9. Target audience. Is the target audience, who should read the paper, stated?

	N/A 1 2 3 4 5 Done
T1. Scope. Are the research boundaries defined and remained within?
T2. Literature review. Is the literature reviewed and analyzed by issues (agreements or contradictions), not as a sequential list of other's research?
T3. Topic Construct/ Dependent Variable. Is the topic construct (or dependent variable), which the research is mainly about, clearly identified or defined?
T4. Causal construct/ Independent variable. Is there confusion between what is causing and what is being caused?
T5. Conceptual framework. Is the conceptual framework the research will use stated, ideally with a diagram?
T6. Research question. Is the research question a single sentence (clear), with many possible answers (falsifiable), focused enough to allow feasible data collection (testable)?
T7. Research type. Is the chosen research type (exploratory, descriptive, correlational or explanatory) appropriate and feasible?
T8. Hypotheses.* Is each hypothesis argued for and stated individually?

N/A 1 2 3 4 5 Done

T1. Scope. Are the research boundaries defined and remained within?

T2. Literature review. Is the literature reviewed and analyzed by issues (agreements or contradictions), not as a sequential list of other's research?

T3. Topic Construct/ Dependent Variable. Is the topic construct (or dependent variable), which the research is mainly about, clearly identified or defined?

T4. Causal construct/ Independent variable. Is there confusion between what is causing and what is being caused?

T5. Conceptual framework. Is the conceptual framework the research will use stated, ideally with a diagram?

T6. Research question. Is the research question a single sentence (clear), with many possible answers (falsifiable), focused enough to allow feasible data collection (testable)?

T7. Research type. Is the chosen research type (exploratory, descriptive, correlational or explanatory) appropriate and feasible?

T8. Hypotheses*. Is each hypothesis argued for and stated individually?

	N/A 1 2 3 4 5 Done
M1. Methodology theory. Is the method theory covered only briefly?
M2. Qualitative vs Quantitative. Is the method use appropriate, e.g. a qualitative, quantitative or mixed-method approach?
M3. Pilot study. Are pilot testing changes in research method/tools reported?
M4. Research Design. Is the logic of how the method's data will answer the research question explicitly stated?
M5. Control group*. Is there a control group, with subjects randomly allocated to it?
M6. Measurement. Does the research justify the method(s) chosen measure constructs?
M7. Reliability. Is measurement reliability considered, e.g. by precedence, testretest or split-half checks?
M8. Validity. Is measurement validity considered, e.g. by content, criterion and construct validity?
M9. Unit of research. Is the unit(s) of research specified, i.e. what is one data gathering “case?
M10. Procedure. Is the data collection procedure sequence described, with any tools used, e.g. introduction script?
M11. Task.* Is the subject task, and any instructions involved, described?
M12. Question design.* Are questions asked of subjects understandable, unambiguous, unbiased, answerable and not offensive?
M13. Response scale design.* Are subject response scales easy to use, exhaustive and sensitive?
M14. Sample generalizability. Is it argued why sample results generalize to the population, e.g. that the sample is unbiased, big enough, and representative the population?
M15. Sample Size.* Is the sample is big enough for the question(s) asked of it?
M16. Replicability. Does the method given allow another researcher to repeat it (e.g. provide scripts and tools)?

N/A 1 2 3 4 5 Done

M1. Methodology theory. Is the method theory covered only briefly?

M2. Qualitative vs Quantitative. Is the method use appropriate, e.g. a qualitative, quantitative or mixed-method approach?

M3. Pilot study. Are pilot testing changes in research method/tools reported?

M4. Research Design. Is the logic of how the method's data will answer the research question explicitly stated?

M5. Control group*. Is there a control group, with subjects randomly allocated to it?

M6. Measurement. Does the research justify the method(s) chosen measure constructs?

M7. Reliability. Is measurement reliability considered, e.g. by precedence, testretest or split-half checks?

M8. Validity. Is measurement validity considered, e.g. by content, criterion and construct validity?

M9. Unit of research. Is the unit(s) of research specified, i.e. what is one data gathering “case?

M10. Procedure. Is the data collection procedure sequence described, with any tools used, e.g. introduction script?

M11. Task*. Is the subject task, and any instructions involved, described?

M12. Question design*. Are questions asked of subjects understandable, unambiguous, unbiased, answerable and not offensive?

M13. Response scale design*. Are subject response scales easy to use, exhaustive and sensitive?

M14. Sample generalizability. Is it argued why sample results generalize to the population, e.g. that the sample is unbiased, big enough, and representative the population?

M15. Sample Size*. Is the sample is big enough for the question(s) asked of it?

M16. Replicability. Does the method given allow another researcher to repeat it (e.g. provide scripts and tools)?

	N/A 1 2 3 4 5 Done
R1. Error type. Is the research rigorous enough (avoids Type I false claim errors), and sensitive enough (avoids Type II null result errors)?
R2. Data Conversion. Is how raw data was converted to descriptive data, and how missing values were handled, properly described?
R3. Demographics. Are sample demographics compared to population demographics?
R4. Information type. Is the information analyzed correctly according to type (qualitative, interval, ordinal, or categorical)?
R5. Descriptive summary. Is there a descriptive summary of the results (e.g. themes, or N, mean and variance) that is commented upon?
R6. Analytic statistics.* Are there analytic statistics for strength (e.g. Pearson 's r, Eta, Gamma, Phi, Lambda) and significance (e.g. t-test, F-test, Chi-squared), based on data type?
R7. Assumptions. Are the analysis assumptions stated and handled?
R8. Findings. Is each conclusion argued individually, one at a time, from the results?
R9. Tables.* Do tables have a title at the top, row/column headings, and a reference in the text?
R10. Frequency tables* Do frequency table percentages add up to 100% for each row, and vary the topic construct between rows?
R11. Mean tables* Do mean tables show dependent variable cell means varying by row/column causal variables?
R12. Graphs.* Do graphs have a title at the bottom, axis labels, and is the graph type (line, bar or pie) right for the information type?
R13. Summarize conclusions. Are the main research conclusions summarized in a numbered list, and is how they answer the research question?

N/A 1 2 3 4 5 Done

R1. Error type. Is the research rigorous enough (avoids Type I false claim errors), and sensitive enough (avoids Type II null result errors)?

R2. Data Conversion. Is how raw data was converted to descriptive data, and how missing values were handled, properly described?

R3. Demographics. Are sample demographics compared to population demographics?

R4. Information type. Is the information analyzed correctly according to type (qualitative, interval, ordinal, or categorical)?

R5. Descriptive summary. Is there a descriptive summary of the results (e.g. themes, or N, mean and variance) that is commented upon?

R6. Analytic statistics*. Are there analytic statistics for strength (e.g. Pearson 's r, Eta, Gamma, Phi, Lambda) and significance (e.g. t-test, F-test, Chi-squared), based on data type?

R7. Assumptions. Are the analysis assumptions stated and handled?

R8. Findings. Is each conclusion argued individually, one at a time, from the results?

R9. Tables*. Do tables have a title at the top, row/column headings, and a reference in the text?

R10. Frequency tables* Do frequency table percentages add up to 100% for each row, and vary the topic construct between rows?

R11. Mean tables* Do mean tables show dependent variable cell means varying by row/column causal variables?

R12. Graphs*. Do graphs have a title at the bottom, axis labels, and is the graph type (line, bar or pie) right for the information type?

R13. Summarize conclusions. Are the main research conclusions summarized in a numbered list, and is how they answer the research question?

	N/A 1 2 3 4 5 Done
D1. Research Contribution. Is the value this research adds, apart from what others have done, stated clearly?
D2. Limitations. Are the limitations of the research honestly declared?
D3. Implications. Are probable and possible implications of the findings for both theory and practice discussed?
D4. Future research. Are future research possibilities suggested?
D5. Acknowledgements. Is any help from others acknowledged?
D6. References. Are the references good quality, broad and up to date?

N/A 1 2 3 4 5 Done

D1. Research Contribution. Is the value this research adds, apart from what others have done, stated clearly?

D2. Limitations. Are the limitations of the research honestly declared?

D3. Implications. Are probable and possible implications of the findings for both theory and practice discussed?

D4. Future research. Are future research possibilities suggested?

D5. Acknowledgements. Is any help from others acknowledged?

D6. References. Are the references good quality, broad and up to date?

The research road map is designed to help you with your research. Please suggest other functions or features you would like to be added to this site. Any suggestions or comments are welcome.

Fill the form and click the Submit button.