For hyperparameter tuning in an undergraduate thesis, it is recommended to use grid search combined with a small amount of manual adjustment, without needing to use automated tuning frameworks such as Optuna.