What is a key limitation of relying solely on Adjusted R-squared for model evaluation in linear regression?
It is difficult to interpret.
It doesn't provide information about the magnitude of prediction errors.
It is highly sensitive to outliers.
It can be misleading when comparing models with different numbers of predictors.
Which metric penalizes large errors more heavily than smaller errors, making it particularly sensitive to outliers?
Mean Absolute Error (MAE)
Adjusted R-squared
Root Mean Squared Error (RMSE)
R-squared
How do polynomial features help in capturing non-linear relationships in data?
They introduce non-linear terms, allowing the model to fit curved relationships.
They make the model less complex and easier to interpret.
They convert categorical variables into numerical variables.
They reduce the impact of outliers on the regression line.
In the context of GLMs, what is the purpose of the inverse link function?
To obtain predictions on the scale of the response variable
To transform the predictor variables before analysis
To estimate the variance of the response variable
To assess the goodness-of-fit of the GLM
If we add more independent variables to a linear regression model, what will happen to the R-squared value?
Remain the same
Depend on the significance of the added variables
Always decrease
Always increase
What is the primary advantage of using Adjusted R-squared over R-squared when evaluating linear regression models?
Adjusted R-squared always increases when new predictors are added.
Adjusted R-squared is less sensitive to outliers compared to R-squared.
Adjusted R-squared penalizes the inclusion of irrelevant variables.
Adjusted R-squared is easier to interpret than R-squared.
What type of data is particularly well-suited for analysis using hierarchical linear models?
Nested data
Experimental data
Cross-sectional data
Time series data
What does Adjusted R-squared penalize that R-squared does not?
Inclusion of irrelevant predictor variables
Number of data points
Presence of outliers
Non-linearity in the relationship
Which robust regression technique is particularly well-suited for handling datasets with a high proportion of outliers?
Theil-Sen estimator
Huber regression
Ordinary Least Squares (OLS) regression
RANSAC (Random Sample Consensus)
Which evaluation metric is particularly sensitive to outliers in the dependent variable?
MAE
RMSE