If a linear regression model has an Adjusted R-squared value of 0.85, what does it indicate about the goodness of fit?
The model explains 85% of the variation in the dependent variable, accounting for the number of predictors.
The model's predictions will be accurate 85% of the time.
The model is overfitting the data.
The model explains 15% of the variation in the dependent variable.
Elastic Net Regression combines the penalties of which two regularization techniques?
Ridge Regression and Polynomial Regression
Lasso Regression and Ridge Regression
Linear Regression and Ridge Regression
Lasso Regression and Polynomial Regression
What hyperparameter controls the strength of regularization in Ridge, Lasso, and Elastic Net Regression?
Number of Iterations
Tolerance
Regularization Parameter
Learning Rate
Why is evaluating the model on a separate test set crucial in Polynomial Regression?
To fine-tune the model's hyperparameters and improve its fit on the training data.
To estimate the model's performance on unseen data and assess its generalization ability.
To calculate the model's complexity and determine the optimal degree of the polynomial.
To visualize the residuals and check for any non-linear patterns.
What does a Variance Inflation Factor (VIF) value greater than 10 generally suggest?
Perfect multicollinearity
Heteroscedasticity
No multicollinearity
Severe multicollinearity
How does stepwise selection work in feature selection?
It ranks features based on their correlation with the target variable and selects the top-k features.
It iteratively adds or removes features based on a statistical criterion, aiming to find the best subset.
It transforms the original features into a lower-dimensional space while preserving important information.
It uses L1 or L2 regularization to shrink irrelevant feature coefficients to zero.
In Polynomial Regression, how does model interpretation change compared to simple Linear Regression?
It becomes simpler because polynomial terms capture more variance, making the model easier to understand.
Polynomial Regression makes no difference to model interpretation.
Interpretation is not relevant in Polynomial Regression.
It becomes more complex as the relationship between the target and predictors might not be linear.
How do hierarchical linear models help avoid misleading conclusions in nested data analysis?
By accounting for the correlation between observations within groups
By assuming all groups have the same effect on the outcome
By ignoring individual-level variations
By treating all observations as independent
Which technique is particularly useful for feature selection when dealing with high-dimensional datasets where the number of features exceeds the number of samples?
Elastic Net Regression
Ordinary Least Squares Regression
Lasso Regression
Ridge Regression
Poisson regression, another type of GLM, is particularly well-suited for analyzing which kind of data?
Ordinal data with a specific order
Count data of rare events
Continuous measurements
Proportions or percentages