You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi all, I've been testing HalvingGridSearchCV for a large grid of hyperparams, but always getting really bad winners compared to an exhaustive search. Tracking down the problem I realized what is obvious in hindsight: regularization controls (ridge) where set too high because of the small size of initial rounds samples, so the best candidates were rejected at the beginning. Now, it's not that I can set min_resources to a larger value without throwing the baby with the bathwater. Even if the estimator provided some sort of size-normalized regularization level, it would be heuristic at best. So is there any sensible strategy to cope with this? If not, it may be a good idea to add a big disclaimer in the user guide / reference. Thanks!
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Looking for the latest TMZ celebrity news? You've come to the right place. From shocking Hollywood scandals to exclusive videos, TMZ delivers it all in real time.
Whether it’s a red carpet slip-up, a viral paparazzi moment, or a legal drama involving your favorite stars, TMZ news is always first to break the story. Stay in the loop with daily updates, insider tips, and jaw-dropping photos.
🎥 Watch TMZ Live
TMZ Live brings you daily celebrity news and interviews straight from the TMZ newsroom. Don’t miss a beat—watch now and see what’s trending in Hollywood.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi all, I've been testing HalvingGridSearchCV for a large grid of hyperparams, but always getting really bad winners compared to an exhaustive search. Tracking down the problem I realized what is obvious in hindsight: regularization controls (ridge) where set too high because of the small size of initial rounds samples, so the best candidates were rejected at the beginning. Now, it's not that I can set
min_resources
to a larger value without throwing the baby with the bathwater. Even if the estimator provided some sort of size-normalized regularization level, it would be heuristic at best. So is there any sensible strategy to cope with this? If not, it may be a good idea to add a big disclaimer in the user guide / reference. Thanks!Beta Was this translation helpful? Give feedback.
All reactions