The false discovery rate (FDR) is a statistical prediction of how many results can be expected to be false positives. This allows researchers to analyze data to determine whether it is statistically meaningful or worthless. Depending on the type of project, there can be a high tolerance for a high false discovery rate, because the other findings still are valid and might be useful. Researchers usually present statistical analysis of their findings and discuss this in the presentation of their work.
This concept is related to the p-value, an estimate of the probability of getting a meaningful and valid result. Small p-values suggest that the data is not as meaningful, because there is a low statistical probability that it is unique. For example, if someone is pulling colored balls out of a bag that contains balls of three colors, that person would expect to pull roughly equal numbers of each color. If 20 balls are drawn and 10 of them are the same color, this would be statistically unlikely. To find the p-value, the researcher could run a statistical analysis to determine how likely it is to draw 10 balls of the same color in a 20-ball draw.
In the case of the FDR, there is more lenience than with a p-value. Rather than looking at the statistical probability that the results are actually unique, it examines the number of false positives that are likely to be found in the results. A high number of false positives could still yield useful data. The researchers will need to be able to identify and exclude the false positives from their results, but the remaining information could be very important.
Numerous calculations can be used to determine the false discovery rate. If researchers find that this rate is high when they set up an experiment, they might make some adjustments to control for it. This could include changes to the study’s methodology, such as getting a larger sample to lower the numbers of false positives. Meticulous study design is very important, because errors in this process could create problems with the experiment.
Computer programs to assist with false discovery rate calculations are available. It also is possible to perform them by hand. In the course of developing a study methodology, researchers might do some calculations to identify obvious flaws in the design before the experiment proceeds. This can help them find weak points and address them to make the experiment as strong and as useful as possible.