Penelitian Korelatif & Regresi
Published on September 25, 2026
DEFINITION | Statistical methods used to quantify the relationship between two or more variables; correlation measures the strength and direction of a linear association, while regression models the predictive relationship and estimates the effect of independent variables on a dependent outcome |
WHEN TO USE | When a question asks about the relationship between a continuous exposure and a continuous or categorical outcome, or when a study needs to adjust for confounding variables |
CORE METRICS | Correlation coefficient (), coefficient of determination (), regression coefficient (), odds ratio (from logistic regression), hazard ratio (from Cox regression) |
EXAM APPLICATION | Interpreting scatterplots, identifying confounders, choosing the correct statistical test for a given study design, distinguishing correlation from causation, understanding regression to the mean |
KEYWORDS | "Association," "linear relationship," "predictor variable," "adjusted for," "controlling for," "regression to the mean," "coefficient of determination," "best-fit line" |
01Core Concepts and Definitions
Correlation refers to the degree to which two continuous variables move together in a linear fashion. It is measured by the correlation coefficient (), which ranges from to . A value of indicates a perfect positive linear relationship (as one variable increases, the other increases proportionally), while indicates a perfect negative (inverse) linear relationship. A value of means there is no linear association between the two variables. This is a critical distinction: does not mean there is no relationship at all. A perfectly curved, parabolic relationship between two variables can yield because the correlation coefficient only captures linear trends.
The coefficient of determination () is simply the square of the correlation coefficient. It tells you the proportion of variance in the dependent variable that is explained by the independent variable. For example, if , then , meaning 49% of the variability in the outcome can be explained by the predictor. This is one of the most commonly tested calculations in biostatistics vignettes.
Regression goes a step further than correlation. While correlation tells you that two variables are associated, regression allows you to model and predict the value of one variable (the dependent or outcome variable) based on the value of another (the independent or predictor variable). Regression also quantifies the magnitude of effect: for every one-unit increase in X, how much does Y change? This is the regression coefficient (). Regression is the foundation for adjusting for confounders in clinical research, which is why it appears so frequently on the exam.
02Types of Correlation and Regression
Pearson correlation ()
VARIABLES
2 continuous
OUTCOME TYPE
N/A (association only)
USE CASE
Both variables are continuous and normally distributed
KEY OUTPUT
value ( to )
Spearman rank correlation ()
VARIABLES
2 ordinal or non-normal continuous
OUTCOME TYPE
N/A (association only)
USE CASE
Data is ordinal, ranked, or not normally distributed
KEY OUTPUT
value ( to )
Simple linear regression
VARIABLES
1 independent, 1 dependent
OUTCOME TYPE
Continuous
USE CASE
Predicting one continuous outcome from one continuous predictor
KEY OUTPUT
coefficient,
Multiple linear regression
VARIABLES
2+ independent, 1 dependent
OUTCOME TYPE
Continuous
USE CASE
Adjusting for confounders when outcome is continuous (e.g., blood pressure)
KEY OUTPUT
Adjusted coefficients
Logistic regression
VARIABLES
1+ independent, 1 dependent
OUTCOME TYPE
Binary/dichotomous
USE CASE
Adjusting for confounders when outcome is yes/no (e.g., disease vs. no disease)
KEY OUTPUT
Adjusted odds ratio (OR)
Cox proportional hazards regression
VARIABLES
1+ independent, 1 dependent
OUTCOME TYPE
Time-to-event
USE CASE
Adjusting for confounders when outcome involves survival or time to an event
KEY OUTPUT
Adjusted hazard ratio (HR)
TYPE | VARIABLES | OUTCOME TYPE | USE CASE | KEY OUTPUT |
|---|---|---|---|---|
Pearson correlation () | 2 continuous | N/A (association only) | Both variables are continuous and normally distributed | value ( to ) |
Spearman rank correlation () | 2 ordinal or non-normal continuous | N/A (association only) | Data is ordinal, ranked, or not normally distributed | value ( to ) |
Simple linear regression | 1 independent, 1 dependent | Continuous | Predicting one continuous outcome from one continuous predictor | coefficient, |
Multiple linear regression | 2+ independent, 1 dependent | Continuous | Adjusting for confounders when outcome is continuous (e.g., blood pressure) | Adjusted coefficients |
Logistic regression | 1+ independent, 1 dependent | Binary/dichotomous | Adjusting for confounders when outcome is yes/no (e.g., disease vs. no disease) | Adjusted odds ratio (OR) |
Cox proportional hazards regression | 1+ independent, 1 dependent | Time-to-event | Adjusting for confounders when outcome involves survival or time to an event | Adjusted hazard ratio (HR) |
Pearson vs. Spearman is a classic test question. The Pearson correlation requires that both variables be continuous and approximately normally distributed. If the data is ordinal (e.g., pain rated on a scale of 1 to 10) or if the distribution is heavily skewed, you must use the Spearman rank correlation instead. The Spearman method works by converting raw data into ranks and then computing the correlation on those ranks, making it resistant to outliers and non-normal distributions.
Simple linear regression fits a straight line () through a scatterplot. The slope () tells you the predicted change in Y for every one-unit increase in X. The intercept () is the predicted value of Y when X equals zero. On the exam, you may be given a regression equation and asked to predict an outcome or interpret the slope.
Multiple linear regression extends this by including more than one predictor variable. The formula becomes . The critical concept here is that each coefficient represents the effect of that variable while holding all other variables constant. This is how researchers adjust for confounders. If a vignette describes a study that "controlled for age, sex, and smoking status," the study almost certainly used some form of multiple regression.
Logistic regression is used when the outcome is binary (e.g., dead vs. alive, diseased vs. healthy). Instead of predicting a continuous number, logistic regression predicts the probability of an event occurring. Its output is expressed as an odds ratio (OR). This is the most commonly used regression method in case-control studies and clinical trials with dichotomous endpoints.
Cox proportional hazards regression is the method of choice for survival analysis. When the outcome is "time until an event" (e.g., time to death, time to relapse), Cox regression produces a hazard ratio (HR). An HR of 2.0 means the exposure group has twice the instantaneous rate of the event compared to the reference group at any given time point.
03Interpreting Outputs and Coefficients
MEANING
Strong positive linear correlation
EXAM INTERPRETATION
As X increases, Y increases; the relationship is strong
MEANING
Weak negative linear correlation
EXAM INTERPRETATION
As X increases, Y slightly decreases; the relationship is weak
MEANING
No linear correlation
EXAM INTERPRETATION
No straight-line relationship; does NOT rule out a nonlinear association
MEANING
64% of variance in Y is explained by X
EXAM INTERPRETATION
The model accounts for most of the variability in the outcome
(linear regression)
MEANING
For every 1-unit increase in X, Y increases by 3.5 units
EXAM INTERPRETATION
Quantifies the magnitude of the effect
OR = 2.4, 95% CI 1.3 to 4.2 (logistic regression)
MEANING
Exposure is associated with 2.4 times the odds of the outcome
EXAM INTERPRETATION
Statistically significant because the CI does not cross 1.0
OR = 1.1, 95% CI 0.7 to 1.8 (logistic regression)
MEANING
No statistically significant association
EXAM INTERPRETATION
The CI crosses 1.0, so we cannot reject the null hypothesis
HR = 0.6, 95% CI 0.4 to 0.9 (Cox regression)
MEANING
Exposure is associated with a 40% reduction in the rate of the event
EXAM INTERPRETATION
Statistically significant protective effect
OUTPUT | MEANING | EXAM INTERPRETATION |
|---|---|---|
Strong positive linear correlation | As X increases, Y increases; the relationship is strong | |
Weak negative linear correlation | As X increases, Y slightly decreases; the relationship is weak | |
No linear correlation | No straight-line relationship; does NOT rule out a nonlinear association | |
64% of variance in Y is explained by X | The model accounts for most of the variability in the outcome | |
(linear regression) | For every 1-unit increase in X, Y increases by 3.5 units | Quantifies the magnitude of the effect |
OR = 2.4, 95% CI 1.3 to 4.2 (logistic regression) | Exposure is associated with 2.4 times the odds of the outcome | Statistically significant because the CI does not cross 1.0 |
OR = 1.1, 95% CI 0.7 to 1.8 (logistic regression) | No statistically significant association | The CI crosses 1.0, so we cannot reject the null hypothesis |
HR = 0.6, 95% CI 0.4 to 0.9 (Cox regression) | Exposure is associated with a 40% reduction in the rate of the event | Statistically significant protective effect |
Interpreting confidence intervals around OR and HR is extremely high-yield. For ratios (OR, HR, relative risk), the null value is 1.0. If the 95% confidence interval includes 1.0, the result is not statistically significant at . For differences (mean difference, coefficient), the null value is 0. If the confidence interval includes 0, the result is not statistically significant.
When a vignette presents a multiple regression output table, pay close attention to whether the question asks about the crude (unadjusted) association or the adjusted association. A variable that is significant in crude analysis but becomes non-significant after adjustment suggests that the initial association was due to confounding. Conversely, a variable that becomes significant only after adjustment may have been masked by a confounder (a phenomenon sometimes called negative confounding or suppression).
04Assumptions, Violations, and Important Pitfalls
Linearity
DEFINITION
The relationship between X and Y must be linear for Pearson/ and linear regression
WHY IT MATTERS ON THE EXAM
A curved relationship will produce a misleadingly low
Homoscedasticity
DEFINITION
The spread (variance) of residuals should be constant across all values of X
WHY IT MATTERS ON THE EXAM
Violation (heteroscedasticity) makes standard errors unreliable
Normal distribution of residuals
DEFINITION
The residuals (errors) of the regression should be approximately normally distributed
WHY IT MATTERS ON THE EXAM
Required for valid hypothesis testing of coefficients
Independence of observations
DEFINITION
Each data point must be independent of the others
WHY IT MATTERS ON THE EXAM
Violated in repeated-measures or clustered data; requires mixed models
Multicollinearity
DEFINITION
Two or more predictor variables in a multiple regression are highly correlated with each other
WHY IT MATTERS ON THE EXAM
Inflates standard errors and makes individual coefficients unstable
Regression to the mean
DEFINITION
Extreme values on initial measurement tend to move closer to the population mean on subsequent measurement
WHY IT MATTERS ON THE EXAM
A common trap: improvement after selecting extreme cases may not reflect true treatment effect
Ecological fallacy
DEFINITION
Drawing conclusions about individuals from group-level (aggregate) data
WHY IT MATTERS ON THE EXAM
Correlation at the population level does not apply to individuals
Extrapolation
DEFINITION
Using a regression model to predict outcomes outside the range of the observed data
WHY IT MATTERS ON THE EXAM
Predictions become unreliable and potentially meaningless
Outliers
DEFINITION
Extreme data points that disproportionately influence and the regression line
WHY IT MATTERS ON THE EXAM
A single outlier can dramatically inflate or deflate ; always check the scatterplot
CONCEPT | DEFINITION | WHY IT MATTERS ON THE EXAM |
|---|---|---|
Linearity | The relationship between X and Y must be linear for Pearson/ and linear regression | A curved relationship will produce a misleadingly low |
Homoscedasticity | The spread (variance) of residuals should be constant across all values of X | Violation (heteroscedasticity) makes standard errors unreliable |
Normal distribution of residuals | The residuals (errors) of the regression should be approximately normally distributed | Required for valid hypothesis testing of coefficients |
Independence of observations | Each data point must be independent of the others | Violated in repeated-measures or clustered data; requires mixed models |
Multicollinearity | Two or more predictor variables in a multiple regression are highly correlated with each other | Inflates standard errors and makes individual coefficients unstable |
Regression to the mean | Extreme values on initial measurement tend to move closer to the population mean on subsequent measurement | A common trap: improvement after selecting extreme cases may not reflect true treatment effect |
Ecological fallacy | Drawing conclusions about individuals from group-level (aggregate) data | Correlation at the population level does not apply to individuals |
Extrapolation | Using a regression model to predict outcomes outside the range of the observed data | Predictions become unreliable and potentially meaningless |
Outliers | Extreme data points that disproportionately influence and the regression line | A single outlier can dramatically inflate or deflate ; always check the scatterplot |
Regression to the mean deserves special attention because it appears in clinical vignettes disguised as a treatment effect. Imagine a study that enrolls only patients with extremely high blood pressure readings. On repeat measurement, many of those readings will naturally drift downward toward the population average, regardless of any intervention. A question might describe a dramatic drop in blood pressure after starting a new drug in such a selected group and ask you to identify the most likely explanation. The answer is regression to the mean, not a true drug effect. The giveaway is that participants were selected based on extreme initial values without a control group for comparison.
Ecological fallacy is tested when a question presents data at the country or population level (e.g., "countries with higher fat intake have higher rates of heart disease") and then asks whether you can conclude that an individual who eats more fat will develop heart disease. You cannot. Aggregate associations do not translate to individual risk. This is a correlation-level error in reasoning.
Correlation does not imply causation is the single most tested principle in this topic. Even a strong value does not establish a cause-and-effect relationship. Establishing causation requires experimental design (randomized controlled trials), temporality, dose-response, and other Bradford Hill criteria. Observational studies, no matter how large, can only demonstrate association.
05Choosing the Right Test
Two continuous, normally distributed variables; question asks about the strength of association
CORRECT STATISTICAL METHOD
Pearson correlation ()
RATIONALE
Standard method for linear association between two continuous variables
Two ordinal variables or non-normally distributed continuous variables
CORRECT STATISTICAL METHOD
Spearman rank correlation ()
RATIONALE
Non-parametric alternative; does not assume normal distribution
One continuous predictor, one continuous outcome; question asks to predict Y from X
CORRECT STATISTICAL METHOD
Simple linear regression
RATIONALE
Models the predictive relationship and gives
Multiple predictors, one continuous outcome; study "adjusts for" confounders
CORRECT STATISTICAL METHOD
Multiple linear regression
RATIONALE
Produces adjusted coefficients while controlling for other variables
Multiple predictors, one binary outcome (yes/no); study "adjusts for" confounders
CORRECT STATISTICAL METHOD
Logistic regression
RATIONALE
Produces adjusted odds ratios
Multiple predictors, time-to-event outcome; study "adjusts for" confounders
CORRECT STATISTICAL METHOD
Cox proportional hazards regression
RATIONALE
Produces adjusted hazard ratios
Two continuous variables with a clearly curved (nonlinear) scatterplot
CORRECT STATISTICAL METHOD
Spearman rank correlation or nonlinear regression
RATIONALE
Pearson would underestimate the true association
Comparing means of two groups
CORRECT STATISTICAL METHOD
Student -test (not regression)
RATIONALE
Regression is not the right tool for simple group comparisons unless adjusting for confounders
Comparing proportions between two groups
CORRECT STATISTICAL METHOD
Chi-square test (not regression)
RATIONALE
Use logistic regression only when multiple confounders need adjustment
SCENARIO IN VIGNETTE | CORRECT STATISTICAL METHOD | RATIONALE |
|---|---|---|
Two continuous, normally distributed variables; question asks about the strength of association | Pearson correlation () | Standard method for linear association between two continuous variables |
Two ordinal variables or non-normally distributed continuous variables | Spearman rank correlation () | Non-parametric alternative; does not assume normal distribution |
One continuous predictor, one continuous outcome; question asks to predict Y from X | Simple linear regression | Models the predictive relationship and gives |
Multiple predictors, one continuous outcome; study "adjusts for" confounders | Multiple linear regression | Produces adjusted coefficients while controlling for other variables |
Multiple predictors, one binary outcome (yes/no); study "adjusts for" confounders | Logistic regression | Produces adjusted odds ratios |
Multiple predictors, time-to-event outcome; study "adjusts for" confounders | Cox proportional hazards regression | Produces adjusted hazard ratios |
Two continuous variables with a clearly curved (nonlinear) scatterplot | Spearman rank correlation or nonlinear regression | Pearson would underestimate the true association |
Comparing means of two groups | Student -test (not regression) | Regression is not the right tool for simple group comparisons unless adjusting for confounders |
Comparing proportions between two groups | Chi-square test (not regression) | Use logistic regression only when multiple confounders need adjustment |
The most common exam trap in this section is confusing when to use correlation vs. regression vs. a -test vs. chi-square. The decision always comes down to two questions: (1) What type of variables do you have? (continuous, ordinal, categorical/binary) and (2) What are you trying to do? (measure association, predict an outcome, compare groups, or adjust for confounders). If the vignette says the researchers "controlled for" or "adjusted for" other variables, the answer is almost always some form of multiple regression.
06Traps and High-Yield Pearls
The number-one way students lose points on correlation and regression questions is by conflating correlation with causation. When a question describes an observational study showing a strong correlation between two variables and asks what conclusion can be drawn, the correct answer is always limited to "there is an association." Never select an answer choice that uses causal language ("causes," "leads to," "results in") unless the study design is a randomized controlled trial.
The second major trap is regression to the mean. Any time a vignette selects patients based on an extreme initial value (highest blood pressure, worst pain scores, lowest test results) and then shows improvement on follow-up, consider this phenomenon before attributing the change to a treatment. The classic tell is the absence of a control or placebo group.
A third common mistake involves interpretation. Students often confuse with . If , the proportion of variance explained is , or only 25%, not 50%. The exam frequently tests whether you can perform this conversion and state what it means in plain terms.
Finally, watch for questions that present a confidence interval crossing the null value. For odds ratios and hazard ratios, a 95% CI that includes 1.0 means the finding is not statistically significant. For coefficients or mean differences, a CI that includes 0 is not significant. This is functionally equivalent to , and the exam loves to test this concept by giving you a table of regression outputs and asking which variables are independently associated with the outcome. Only those whose confidence intervals do not cross the null value qualify.
The core competency being tested across all correlation and regression questions is your ability to match the correct statistical method to a given study scenario, interpret the output without overclaiming causation, and recognize common analytical pitfalls like regression to the mean, ecological fallacy, and confounding.