Standard holdout CI.
Parameters
Only those from MeasureAbstractCi
.
Super classes
mlr3::Measure
-> mlr3inferr::MeasureAbstractCi
-> MeasureCiHoldout
Methods
Method new()
Creates a new instance of this R6 class.
Usage
MeasureCiHoldout$new(measure)
Arguments
measure
(
Measure
orcharacter(1)
)
A measure of ID of a measure.
Examples
ci_ho = msr("ci.holdout", "classif.acc")
ci_ho
#> <MeasureCiHoldout:classif.acc>: Holdout CI
#> * Packages: mlr3, mlr3measures, mlr3inferr
#> * Range: [0, 1]
#> * Minimize: FALSE
#> * Average: custom
#> * Parameters: alpha=0.05, within_range=TRUE
#> * Properties: primary_iters
#> * Predict type: response
rr = resample(tsk("sonar"), lrn("classif.featureless"), rsmp("holdout"))
rr$aggregate(ci_ho)
#> classif.acc classif.acc.lower classif.acc.upper
#> 0.5507246 0.4324975 0.6689518