e-Statistics
e-Statistics
For Students
For Contributors
Data in Statistical Studies
Textbook Data Sets
Worksheet Data Sets
Data and Story Library
Exploratory Graphics
Stem and Leaf Plot
Histogram
Boxplot
Scatter Plot
QQ plot
Bar Graph
Descriptive Statistics
Summary Statistics
Frequency Table
Grouped Data
Transformed Data
Normal Distribution
Normal Density Function
Z-score
Critical Value
Central Limit Theorem
Discrete Distributions
Binomial Distribution
Frequency Function
Normal Approximation
Inference on Mean
t-Distribution
Confidence Interval
Hypothesis Test
Power of Test
One-sided CI
Comparison of Two Groups
Test for Independent Groups
Nonparametric Test
Test for Paired Data
Simple Linear Regression
Regression Line
R Square
Residual Plot
Inference on Parameters
Predicting Responses
One-Way ANOVA Model
F-Distribution
Analysis of Variance
Strip Chart
Multiple Comparisons
Multiple Linear Regression
Model Estimate and Residuals
Model Selection and F-test
Two-Way Additive Model
Test of Effect
Analysis of Variance
Inference on Variances
Testing a Standard Deviation
Test for Two Groups
Test for Homogeneity
Inference on Proportions
Testing a Proportion
Comparison of Two Proportions
Chi-square Test
Chi-square Distribution
Goodness of Fit
Test for Homogeneity
Logistic Regression
Inference on parameters
Adjusted log OR

Simple Linear Regression

Suppose that the researcher wants to find how increasing the amount $ x$ of a certain chemical in the soil increases the amount $ y$ of that chemical found in the plants. Then $ n$ independent experiments are conducted with different amounts of the chemical, and data are produced, consisting of the amounts $ Y_1,\ldots,Y_n$ of the chemical in the plants paired with the respective amounts $ x_1,\ldots,x_n$ of the chemical in soil.

Amount in soil Amount in plant
$ x_1$ $ Y_1$
$ \vdots$ $ \vdots$
$ x_n$ $ Y_n$

We call the variable for $ x_i$'s independent (or explanatory) variable, and the variable for $ Y_i$'s dependent (or response) variable. When the relationship between the independent variable $ x_i$ and the dependent variable $ Y_i$ is approximated by

$\displaystyle Y_i = \beta_0 + \beta_1 x_i + \epsilon_i, $

it is called a simple linear regression model. Here $ \epsilon_i$ is introduced as “random error” due to difference between plants, soils, and other possible factors in the experiment.

© TTU Mathematics