Workflow of Data Analysis Using Stata: A Short Course

This seminar is for researchers who are trying to establish or improve their workflow. Participants do not need to be expert programmers; this seminar should be accessible to very novice Stata users, while still being useful to more advanced users. Lessons from this seminar balance ease of use with proper functioning, introducing researchers to useful tools, e.g., dual-pane browsers, macro programs, plain text editors, and GitHub. For those who are already familiar with these tools, this seminar will teach you how to optimize them. Lessons from this seminar should make conducting research less painful, more efficient, more accurate, and reproducible.

This is a hands-on seminar with ample opportunities to plan and practice your workflow.

Some highlights include:

• Planning (analyses, sensitivity analyses, variable construction, etc.)
• Directory structure
• Data preservation
• Documentation
• Dual workflow (separating data management and analyses)
• Writing robust script files
• Using log files
• Variable naming
• Value labeling
• Reproducibility and replication
• Examining data

The empirical examples and exercises in this course will emphasize Stata. To fully benefit from the course, you should use your own computer with a recent version of Stata installed. You are encouraged to use Stata version 17, but earlier versions should also work for most exercises. You should have familiarity with the Stata programming language.

For those who prefer R, equivalent R code will be provided on request.

Seminar participants who are not yet ready to purchase Stata could take advantage of StataCorp’s free 30-day evaluation offer or their 30-day software return policy.

This course is for anyone who wants to improve the efficiency and accuracy of their data analysis and presentation. You should have experience with data analysis.

PART 1: INTRODUCTION TO WORKFLOW

1. What is “workflow”?
2. Why care about WF?
3. WF and replication
4. Steps in and principles of WF

PART 2: PLAN, ORGANIZE, DOCUMENT, AND PRESERVE

1. Planning research projects in the:
   a. Large (overall questions, project checklist, and timeline)
   b. Middle (data cleaning, analyses, tables, and figures)
   c. Small (naming variables, naming files, value labels, and order of
   analyses/cleaning)
2. Organizing files and folders
3. Documentation
4. Preserving data and preventing loss
5. Replication

PART 3: SCRIPT FILES IN R

1. Strengths and weaknesses of R for workflow
2. Dual workflow
3. Robust script files
4. Legible script files
5. Automation in script files

PART 4: CLEANING, LABELING, & MISSING DATA

1. Naming and labeling variables
2. Missing data
3. Merging data
4. Verifying data

PART 5: ANALYZING & PRESENTING FINDINGS

1. Principles of data analysis
2. Documenting provenance
3. The posting principle
4. Presenting findings

PART 6: COLLABORATION

1. Key factors in collaboration
2. Introducing workflow with co-authors
3. Coordinating workflow with multiple authors

“This should be required learning for all researchers. The course covers the principles/rationale for having good workflow as well as concrete steps you can do right away to improve your own workflow. I was able to immediately implement steps that I know will make me a better researcher. I also have the resources I need to tackle larger changes to my workflow in the coming weeks. It’s been 5 years since I completed my PhD and I wish I had taken this course in my first year. I left this course feeling excited and empowered.”
  Marta Mulawa, Duke University

“The presentation of the topics, time management, and the content of the course were all excellent.” 
  Mbaraka Amuri, CDC 

“Great class! Bianca Manago is a superb teacher; positive, enthusiastic, extremely knowledgeable, clear, and responsive and helpful to students. I gained extremely valuable insights, principles, tips, and practical strategies that will improve the quality, reproducibility, and replicability of all my research.”
  Ken Coburn, Health Quality Partners (HQP)

“Bianca was a great, knowledgeable entertaining teacher.  She really made what could have been very dry material seem exciting. The knowledge I gained in this course will revolutionize the way I approach my research projects.”
  Laura Prichett, Johns Hopkins 

“This was a very informative seminar. I would suggest if for all data managers, analysts, and study team members. There are many practices suggested that would beneficial to a study team.”
  Angela Green, Johns Hopkins University