What Is A Statistical Analysis T-Test And How To Perform One Using Flow Cytometry Data

Designing an antibody panel and running samples on a flow cytometer are not the only steps in a flow cytometry experiment.

After you run your experiment, you have to analyze the data. In particular, you need to perform statistical analyses of the data. This is especially true if you’re hoping to publish your data.

Once all the experiments are concluded and the preliminary analysis of the data performed, you must perform statistical analyses on the data to determine if there is significance in the data.

There are several different statistical tests that can be performed depending on the type of data and the comparisons being made. In the case of either making a comparison against a hypothetical mean, or comparison between two populations, the gold standard test is the Student’s T-Test.

What Is A Statistical T-Test?

The T-Test was developed by chemist William Sealy Gosset, who developed the test while working at the Guinness Brewery as a way to monitor the production of their most famous product.

Since he wasn’t allowed to publish his work directly, the paper was published under a pseudonym in the journal, Biometrika.

Before getting into the details of how the T-Test is performed and how the results are interpreted, there are several factors that need to be kept in mind…

The T-Test makes several assumptions about the data:

  • The data is from a Gaussian distribution
  • The data is continuous
  • The sample is a random sample of the population
  • The variance of the populations is equal (If not, there are variations on the theme to address this.)

There are three major variations on the T-Test:

  • One-sample T-Test – compares the mean of the experimental sample to a hypothetical mean.
  • Unpaired T-Test – compares the mean of the control and experimental samples.
  • Paired T-Test – compares the mean of two samples where the observations in one sample can be related to the observation in the second sample. (For example, the effects of treatment on patients where there is a before treatment and after treatment measurement.)

The three pieces of information needed to perform a T-Test:

  • The mean of both samples
  • The standard deviation of both samples
  • The number of observations

The T-Test compares the differences between the means of two populations to determine if the null hypothesis should be rejected. At a minimum, to perform the T-Test, one needs the means and standard deviations of both populations, and the number of measurements.

The researcher also needs to set the threshold value, also termed the α. We will compare this threshold to the P-value. If the P-value is greater than the α, there is no significance in the data. However, if the P-value is less than the α, there is significance in the data.

What Is A Null Hypothesis (HO)?

Simply stated, this is a statement about the relationship of the above two populations.  Mathematically, this can be expressed as:

μA = μB

The null hypothesis makes the assumption that our experimental results are from random variation. If, during the statistical analysis, the data is sufficient to show that random variation is not a sufficient explanation for the data, the alternative hypothesis (HA) must be accepted.

A One-Tailed Versus A Two-Tailed T-Test

A T-Test can either be one-tailed or two-tailed. The above example would be an appropriate null hypothesis for a two-tailed T-Test—that is, when the investigators do not know if the treatment will cause an increase or decrease in the measurement. If the investigators expect the treatment will cause an increase OR a decrease, a one-tailed T-Test is more appropriate.

How To Run A T-Test

In the following example, the researchers sought to determine if the percentage of CD4+ T-cells in patients who had Irumodic Syndrome was increased after treatment with Byphodine.

The percentage of CD4+ T-cells was measured on PBMCs before treatment and one week after treatment. Considering this information, this is how you would proceed to run a T-Test…

1. Establish the null hypothesis.

“In patients with Irumodic Syndrome, treatment by Byphodine either decreased or caused no change in the percentage of CD4+ T-cells.”

In this case, since the researchers are not concerned if the treatment causes a decrease in the CD4+ cell, a one-tailed T-test will be performed, and can be written as:

μA ≥ μB

2. Determine the alternate hypothesis.

“In patients with Irumodic Syndrome, treatment by Byphodine increases the percentage of CD4+ T-cells.”

3. Establish the threshold.

By convention, the α is typically set to 0.05. This comes from work by R.A. Fisher who stated in his work Statistical Methods for Research Workers (13th Edition):

The value for which P=0.05, or 1 in 20, is 1.96 or nearly 2; it is convenient to take this point as a limit in judging whether a deviation ought to be considered significant or not. Deviations exceeding twice the standard deviation are thus formally regarded as significant.

There are cases where the threshold can be changed. Increasing the α makes it easier to show significance at the expense of committing a Type I statistical error (false positive). Decreasing the α makes it hard to show significance, and increases the chance of committing a Type II statistical error (false negative). Care must be taken, however, to ensure that the reason for the change is well-documented and spelled out.

For this example, we will set the α to 0.05.

4. Collect the flow cytometry data.

Following all best practices, with a well-controlled instrument, all appropriate gating and reference controls used to generate the data table below.

Table of %CD4+ PBMCs

Pre-treatmentPost-treatment
18.526.7
20.122.2
25.234.5
16.523.6
23.329.6
22.629.1
18.040.1
19.335.3
17.439.5
19.931.4

Once this data is entered into our statistical analysis package of choice (we personally use Graphpad Prism), we can generate an appropriate graph:

t-test statistical analysis of flow cytometry data | Expert Cytometry | t-test formula for data analysis

In the above case, the data is plotted, with the mean and standard deviation plotted.

When the one-way T-Test is calculated, the P-value is 0.0003, which is lower than the threshold. Therefore, the null hypothesis is rejected, and the alternate hypothesis is accepted. As a result, this data supports the conclusion.

The use of the T-Test makes the assumption that the data follows a normal distribution.  If this is not the case, there are non-parametric tests that will allow for the statistical analysis similar to the T-Test. These include the Wilcoxon test and the Mann-Whitney test. In non-parametric tests, the data is ranked according to the value (from lowest to highest), regardless of where the data comes from.

Non-parametric tests test the null hypothesis that the data is distributed at random, with the alternate hypothesis being that the data is not randomly distributed, but one population has larger values than the other.

The Student’s T-Test is an essential tool in the researcher’s toolkit to confirm that the data generated in the course of the investigation supports the hypothesis driving the research. Proper application of the T-Test (and related non-parametric tests) to determine statistical significance in the data will improve confidence in the conclusions of any published work. Following the steps outlined above will allow the researcher to correctly apply the proper statistical tool for their data.

To learn more about getting your flow cytometry data published and to get access to all of our advanced materials including 20 training videos, presentations, workbooks, and private group membership, get on the Flow Cytometry Mastery Class wait list.

Join Expert Cytometry's Mastery Class
Tim Bushnell, PhD
Tim Bushnell, PhD

Tim Bushnell holds a PhD in Biology from the Rensselaer Polytechnic Institute. He is a co-founder of—and didactic mind behind—ExCyte, the world’s leading flow cytometry training company, which organization boasts a veritable library of in-the-lab resources on sequencing, microscopy, and related topics in the life sciences.

Similar Articles

Getting A New Flow Cytometer? Try Before You Buy (And 2 Other Tips)

Getting A New Flow Cytometer? Try Before You Buy (And 2 Other Tips)

By: Tim Bushnell, PhD

There are 4 major ways to sort cells. The first way can use magnetic beads coupled to antibodies and pass the cells through a magnetic field. The labeled cells will stick, and the unlabeled cells will remain in the supernatant. The second way is to use some sort of mechanical force like a flapper or air stream that separates the target cells from the bulk population. The third way is the recently introduced microfluidics sorter, which uses microfluidics channels to isolate the target cells. The last method, which is the most common––based on Fuwyler’s work––is the electrostatic cell sorter. This…

5-Point Guide To Buying A New Microscope For Your Lab

5-Point Guide To Buying A New Microscope For Your Lab

By: Heather Brown-Harding, PhD

Have you ever noticed how painful it can be to purchase a new microscope? It would be hard to miss – this can be a frustrating process. A lot of scientists and students consider the new microscope hunt quite scary for a variety of reasons. It might be that you’re worried you won’t get the right microscope and that you’ll regret it, or you may find that dealing with salespeople, in general, makes you kind of uncomfortable. But remember, salespeople are just human beings like you and me, and if we can treat them as such, the whole process of…

Ask These 7 Questions Before Purchasing A Flow Cytometer

Ask These 7 Questions Before Purchasing A Flow Cytometer

By: Tim Bushnell, PhD

I am still convinced that my first cell sorter was possessed. The number of issues that I had with the system remains hard for me to believe, even after all these years. It had been purchased, in part, from one vendor because the sales rep for a competitor was nowhere to be found. At that time, I admit I wasn’t overly diligent in my research process. Since then, I’ve pinpointed some critical questions that need to be answered before purchasing a new instrument. At the end of the process, a shiny new instrument will arrive at your facility. Make sure…

Instrument Quality Control For Reproducible Flow Cytometry Experiments

Instrument Quality Control For Reproducible Flow Cytometry Experiments

By: Tim Bushnell, PhD

The flow cytometer is an integral component of any flow cytometry experiment, and special attention should be paid to ensuring that it is working correctly and consistently. As an end-user, the researcher should be able to sit down at a machine and know that it is performing the same way today as it was yesterday and last week. Equally important is that if any changes in instrument performance have occured, the end-user knows how they have been addressed and corrected, rather than letting them fester and potentially affect the results. Quality control measurements can include a variety of targets, such…

How to Optimize Flow Cytometry Hardware For Rare Event Analysis

How to Optimize Flow Cytometry Hardware For Rare Event Analysis

By: Tim Bushnell, PhD

Preparing for rare event analysis requires an understanding of the power and limitation of the instrument to be used. From how fast to run the fluidics, to how the signal is processed to the number of gates that can be used in the sorting experiment, each factor impacts the outcome of the experiment.

3 Ways The ZE5 Cell Analyzer Accelerates Flow Cytometry Research Opportunities

3 Ways The ZE5 Cell Analyzer Accelerates Flow Cytometry Research Opportunities

By: Tim Bushnell, PhD

Some technological advances are incremental, while others are significant game-changing tools that offer the researcher the ability to significantly improve current assays while allowing for new and novel avenues of research to be performed. With speed, sensitivity, and capacity to spare, the ZE5 fits into the game-changing category. Reduced carryover, increased speed of acquisition, and a large number of parameters all open up new and novel assays while improving the quality and reproducibility of ongoing ones.

3 Advantages Of Using The ZE5 Cell Analyzer

3 Advantages Of Using The ZE5 Cell Analyzer

By: Tim Bushnell, PhD

Since the first laser was mounted to create the first flow cytometer, there has been a push for more - more lasers, more detectors, more colors. As a result, today’s researchers require a large number of lasers and detectors to ensure current panels can be run and new, expanded panels can be developed. This can be problematic because, in general, making one decision to improve a cell analyzer can limit the analyzer in other ways. It may seem like an impossible task, but the team of Bio-Rad and Propel Laboratories, collaborated to bring the ZE5™ Cell Analyzer to the market…

3 Advantages FCS Express 6 Has Over Other Flow Cytometry Data Analysis Software Programs

3 Advantages FCS Express 6 Has Over Other Flow Cytometry Data Analysis Software Programs

By: Tim Bushnell, PhD

FCS Express is the ideal data analysis software program to use when analyzing your flow cytometry experiments because it is the most user-friendly program available that is both aligned with current data analysis best practices and maintains rigorous quality control standards.

How To Use A Threshold To Reduce Background Noise In Flow Cytometry

How To Use A Threshold To Reduce Background Noise In Flow Cytometry

By: Tim Bushnell, PhD

Getting a clear signal with reduced noise is an essential component to good data. Adding a threshold when acquiring flow cytometry data is one way to do that. It reduces the number of events by setting a bar that a signal pulse must clear before it is counted as an event. Depending on the importance of the data, the downstream applications for the data (or sorted cells) will dictate how critical the threshold is. In combination with proper sample preparation, appropriate thresholding will reduce debris and ensure best outcome.

Top Technical Training eBooks

Get the Advanced Microscopy eBook

Get the Advanced Microscopy eBook

Heather Brown-Harding, PhD

Learn the best practices and advanced techniques across the diverse fields of microscopy, including instrumentation, experimental setup, image analysis, figure preparation, and more.

Get The Free Modern Flow Cytometry eBook

Get The Free Modern Flow Cytometry eBook

Tim Bushnell, PhD

Learn the best practices of flow cytometry experimentation, data analysis, figure preparation, antibody panel design, instrumentation and more.

Get The Free 4-10 Compensation eBook

Get The Free 4-10 Compensation eBook

Tim Bushnell, PhD

Advanced 4-10 Color Compensation, Learn strategies for designing advanced antibody compensation panels and how to use your compensation matrix to analyze your experimental data.