This CallbackResample predicts on an additional holdout task after training.
Arguments
- task
(Task)
The holdout task.
Examples
task = tsk("sonar")
task_holdout = task$clone()
learner = lrn("classif.rpart")
resampling = rsmp("cv", folds = 3)
splits = partition(task, 0.7)
task$filter(splits$train)
task_holdout$filter(splits$test)
callback = clbk("mlr3.holdout_task", task = task_holdout)
rr = resample(task, learner, resampling = resampling, callbacks = callback)
rr$data_extra
#> Key: <uhash, iteration>
#> uhash iteration data_extra
#> <char> <int> <list>
#> 1: 399c9e57-711f-4f60-a681-7cccfe04a4c2 1 <list[1]>
#> 2: 399c9e57-711f-4f60-a681-7cccfe04a4c2 2 <list[1]>
#> 3: 399c9e57-711f-4f60-a681-7cccfe04a4c2 3 <list[1]>