When using Principal Component Analysis (PCA) as a remedy for multicollinearity, what is the primary aim?
To create new, uncorrelated variables from the original correlated ones
To remove all independent variables from the model
To introduce non-linearity into the model
To increase the sample size of the dataset
In Polynomial Regression, how does model interpretation change compared to simple Linear Regression?
Polynomial Regression makes no difference to model interpretation.
It becomes more complex as the relationship between the target and predictors might not be linear.
It becomes simpler because polynomial terms capture more variance, making the model easier to understand.
Interpretation is not relevant in Polynomial Regression.
Why is evaluating the model on a separate test set crucial in Polynomial Regression?
To calculate the model's complexity and determine the optimal degree of the polynomial.
To estimate the model's performance on unseen data and assess its generalization ability.
To visualize the residuals and check for any non-linear patterns.
To fine-tune the model's hyperparameters and improve its fit on the training data.
Which technique is particularly useful for feature selection when dealing with high-dimensional datasets where the number of features exceeds the number of samples?
Lasso Regression
Ridge Regression
Ordinary Least Squares Regression
Elastic Net Regression
Which of the following is a synonym for Hierarchical Linear Models?
Multilevel Models
Nonlinear Regression Models
Time Series Models
Simple Linear Models
How do polynomial features help in capturing non-linear relationships in data?
They reduce the impact of outliers on the regression line.
They introduce non-linear terms, allowing the model to fit curved relationships.
They make the model less complex and easier to interpret.
They convert categorical variables into numerical variables.
The performance of the Theil-Sen estimator can be sensitive to which characteristic of the data?
The presence of heteroscedasticity (unequal variances of errors)
The presence of multicollinearity (high correlation between independent variables)
The non-normality of the residuals
The presence of categorical variables
What advantage does Polynomial Regression offer over simple Linear Regression when dealing with non-linear relationships between variables?
It introduces polynomial terms, enabling the model to fit curved relationships in the data.
It always results in a better fit regardless of the data distribution.
It simplifies the model, making it easier to interpret.
It reduces the need for feature scaling.
Which metric is more interpretable in terms of the original units of the dependent variable?
None of the above
Adjusted R-squared
Both RMSE and MAE are equally interpretable.
Root Mean Squared Error (RMSE)
What is a key limitation of relying solely on Adjusted R-squared for model evaluation in linear regression?
It can be misleading when comparing models with different numbers of predictors.
It is difficult to interpret.
It doesn't provide information about the magnitude of prediction errors.
It is highly sensitive to outliers.