* using log directory 'd:/Rcompile/CRANpkg/local/4.4/mlr3benchmark.Rcheck' * using R version 4.4.3 (2025-02-28 ucrt) * using platform: x86_64-w64-mingw32 * R was compiled by gcc.exe (GCC) 13.3.0 GNU Fortran (GCC) 13.3.0 * running under: Windows Server 2022 x64 (build 20348) * using session charset: UTF-8 * checking for file 'mlr3benchmark/DESCRIPTION' ... OK * this is package 'mlr3benchmark' version '0.1.7' * package encoding: UTF-8 * checking package namespace information ... OK * checking package dependencies ... OK * checking if this is a source package ... OK * checking if there is a namespace ... OK * checking for hidden files and directories ... OK * checking for portable file names ... OK * checking whether package 'mlr3benchmark' can be installed ... OK * checking installed package size ... OK * checking package directory ... OK * checking DESCRIPTION meta-information ... OK * checking top-level files ... OK * checking for left-over files ... OK * checking index information ... OK * checking package subdirectories ... OK * checking code files for non-ASCII characters ... OK * checking R files for syntax errors ... OK * checking whether the package can be loaded ... [2s] OK * checking whether the package can be loaded with stated dependencies ... [2s] OK * checking whether the package can be unloaded cleanly ... [2s] OK * checking whether the namespace can be loaded with stated dependencies ... [2s] OK * checking whether the namespace can be unloaded cleanly ... [2s] OK * checking loading without being on the library search path ... [2s] OK * checking use of S3 registration ... OK * checking dependencies in R code ... OK * checking S3 generic/method consistency ... OK * checking replacement functions ... OK * checking foreign function calls ... OK * checking R code for possible problems ... [7s] OK * checking Rd files ... [1s] OK * checking Rd metadata ... OK * checking Rd cross-references ... OK * checking for missing documentation entries ... OK * checking for code/documentation mismatches ... OK * checking Rd \usage sections ... OK * checking Rd contents ... OK * checking for unstated dependencies in examples ... OK * checking examples ... [13s] ERROR Running examples in 'mlr3benchmark-Ex.R' failed The error most likely occurred in: > ### Name: autoplot.BenchmarkAggr > ### Title: Plots for BenchmarkAggr > ### Aliases: autoplot.BenchmarkAggr > > ### ** Examples > > if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) { + library(mlr3) + library(mlr3learners) + library(ggplot2) + + set.seed(1) + task = tsks(c("iris", "sonar", "wine", "zoo")) + learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost")) + learns$classif.xgboost$param_set$values$nrounds = 50 + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3))) + obj = as_benchmark_aggr(bm) + + # mean and error bars + autoplot(obj, type = "mean", level = 0.95) + + if (requireNamespace("PMCMRplus", quietly = TRUE)) { + # critical differences + autoplot(obj, type = "cd",style = 1) + autoplot(obj, type = "cd",style = 2) + + # post-hoc friedman-nemenyi + autoplot(obj, type = "fn") + } + + } INFO [09:04:14.011] [mlr3] Running benchmark with 36 resampling iterations INFO [09:04:14.040] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [09:04:14.073] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [09:04:14.106] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [09:04:14.138] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [09:04:14.193] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [09:04:14.258] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [09:04:14.307] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3) INFO [09:04:14.420] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3) INFO [09:04:14.528] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3) INFO [09:04:14.610] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [09:04:14.651] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [09:04:14.700] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [09:04:14.741] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [09:04:14.820] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [09:04:14.898] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [09:04:14.960] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3) INFO [09:04:15.089] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3) INFO [09:04:15.181] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3) INFO [09:04:15.290] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3) INFO [09:04:15.332] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3) INFO [09:04:15.372] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3) INFO [09:04:15.404] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3) INFO [09:04:15.437] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3) INFO [09:04:15.484] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3) INFO [09:04:15.536] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3) INFO [09:04:15.656] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3) INFO [09:04:15.753] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3) INFO [09:04:15.825] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3) INFO [09:04:15.855] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3) INFO [09:04:15.895] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3) INFO [09:04:15.927] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3) INFO [09:04:15.961] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3) INFO [09:04:15.995] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3) INFO [09:04:16.029] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3) INFO [09:04:16.135] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3) INFO [09:04:16.244] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3) Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. INFO [09:04:16.413] [mlr3] Finished benchmark Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead. Execution halted * checking for unstated dependencies in 'tests' ... OK * checking tests ... [10s] OK Running 'testthat.R' [9s] * checking PDF version of manual ... [17s] OK * checking HTML version of manual ... [2s] OK * DONE Status: 1 ERROR