where y i is the response variable for the ith observation. The quantity x i is a column vector of covariates, or explanatory variables, for observation i that is known from the experimental setting ...