Programming with Python

The best way to learn how to program is to do something useful, so this introduction to Python is built around a common scientific task: data analysis.

Arthritis Inflammation

We are studying inflammation in patients who have been given a new treatment for arthritis.

There are 60 patients, who had their inflammation levels recorded for 40 days. We want to analyze these recordings to study the effect of the new arthritis treatment.

To see how the treatment is affecting the patients in general, we would like to:

  1. Calculate the average inflammation per day across all patients.
  2. Plot the result to discuss and share with colleagues.

3-step flowchart shows inflammation data records for patients moving to the Analysis step
where a heat map of provided data is generated moving to the Conclusion step that asks the
question, How does the medication affect patients?

Data Format

The data sets are stored in comma-separated values (CSV) format:

The first three rows of our first file look like this:

0,0,1,3,1,2,4,7,8,3,3,3,10,5,7,4,7,7,12,18,6,13,11,11,7,7,4,6,8,8,4,4,5,7,3,4,2,3,0,0
0,1,2,1,2,1,3,2,2,6,10,11,5,9,4,4,7,16,8,6,18,4,12,5,12,7,11,5,11,3,3,5,4,4,5,5,1,1,0,1
0,1,1,3,3,2,6,2,5,9,5,7,4,5,4,15,5,11,9,10,19,14,12,17,7,12,11,7,4,2,10,5,4,2,2,3,2,2,1,1

Each number represents the number of inflammation bouts that a particular patient experienced on a given day.

For example, value “6” at row 3 column 7 of the data set above means that the third patient was experiencing inflammation six times on the seventh day of the clinical study.

In order to analyze this data and report to our colleagues, we’ll have to learn a little bit about programming.

Prerequisites

You need to understand the concepts of files and directories and how to start a Python interpreter before tackling this lesson. This lesson sometimes references Jupyter Notebook although you can use any Python interpreter mentioned in the Setup.

The commands in this lesson pertain to Python 3.

Getting Started

To get started, follow the directions on the “Setup” page to download data and install a Python interpreter.

Schedule

Setup Download files required for the lesson
09:00 1. Running and Quitting How can I run Python programs?
09:15 2. Python Fundamentals What basic data types can I work with in Python?
How can I create a new variable in Python?
Can I change the value associated with a variable after I create it?
09:45 3. Data Types and Type Conversion What kinds of data do programs store?
How can I convert one type to another?
09:55 4. Built-in Functions and Help How can I use built-in functions?
How can I find out what they do?
10:15 5. Error Messages What kind of errors can occur in programs?
How can I identify errors when they occur?
10:30 6. Morning break Break
10:45 7. Libraries How can I use software that other people have written?
How can I find out what that software does?
11:00 8. Analyzing Patient Data How can I process tabular data files in Python?
12:10 9. Visualizing Tabular Data How can I visualize tabular data in Python?
How can I group several plots together?
12:55 10. Storing Multiple Values in Lists How can I store many values together?
13:45 11. Sets (Kai) What is a set, and how do I use it?
13:55 12. Sets (Kai) What is a set, and how do I use it?
14:05 13. Repeating Actions with Loops How can I do the same operations on many different values?
14:35 14. Night Break
31:35 15. Analyzing Data from Multiple Files How can I do the same operations on many different files?
31:55 16. Making Choices How can my programs do different things based on data values?
32:20 17. Creating Functions How can I define new functions?
What’s the difference between defining and calling a function?
What happens when I call a function?
32:50 18. Lunch break Break
33:50 19. Programming Style How can I make my programs more readable?
How do most programmers format their code?
34:15 20. Debugging (Niko) How can I debug my program?
34:40 21. Defensive Programming How can I make my programs more reliable?
35:20 22. Command-Line Programs How can I write Python programs that will work like Unix command-line tools?
36:20 Finish

The actual schedule may vary slightly depending on the topics and exercises chosen by the instructor.