Skip to contents

This CallbackResample predicts on an additional holdout task after training.

Arguments

task

(Task)
The holdout task.

Examples

task = tsk("pima")
task_holdout = task$clone()
learner = lrn("classif.rpart")
resampling = rsmp("cv", folds = 3)
splits = partition(task, 0.7)

task$filter(splits$train)
task_holdout$filter(splits$test)

callback = clbk("mlr3.holdout_task", task = task_holdout)

rr = resample(task, learner, resampling = resampling, callbacks = callback)

rr$data_extra
#> Key: <uhash, iteration>
#>                                   uhash iteration data_extra
#>                                  <char>     <int>     <list>
#> 1: 52d182e9-19b7-4069-8960-aa9871c2e921         1  <list[1]>
#> 2: 52d182e9-19b7-4069-8960-aa9871c2e921         2  <list[1]>
#> 3: 52d182e9-19b7-4069-8960-aa9871c2e921         3  <list[1]>