Package: BORG 0.3.1

BORG: Bounded Outcome Risk Guard for Model Evaluation

Comprehensive toolkit for valid spatial, temporal, and grouped model evaluation. Automatically detects data dependencies (spatial autocorrelation, temporal structure, clustered observations), generates appropriate cross-validation schemes (spatial blocking, checkerboard, hexagonal, KNNDM, environmental blocking, leave-location-out, purged CV), and validates evaluation pipelines for leakage. Includes area of applicability (AOA) assessment following Meyer & Pebesma (2021) <doi:10.1111/2041-210X.13650>, forward feature selection with blocked CV, spatial thinning, block-permutation variable importance, extrapolation detection, and interactive visualizations. Integrates with 'tidymodels', 'caret', 'mlr3', 'ENMeval', and 'biomod2'. Based on evaluation principles described in Roberts et al. (2017) <doi:10.1111/ecog.02881>, Kaufman et al. (2012) <doi:10.1145/2382577.2382579>, Kapoor & Narayanan (2023) <doi:10.1016/j.patter.2023.100804>, and Linnenbrink et al. (2024) <doi:10.5194/gmd-17-5897-2024>.

Authors:Gilles Colling [aut, cre, cph]

BORG_0.3.1.tar.gz
BORG_0.3.1.zip(r-4.7)BORG_0.3.1.zip(r-4.6)BORG_0.3.1.zip(r-4.5)
BORG_0.3.1.tgz(r-4.6-x86_64)BORG_0.3.1.tgz(r-4.6-arm64)BORG_0.3.1.tgz(r-4.5-x86_64)BORG_0.3.1.tgz(r-4.5-arm64)
BORG_0.3.1.tar.gz(r-4.7-arm64)BORG_0.3.1.tar.gz(r-4.7-x86_64)BORG_0.3.1.tar.gz(r-4.6-arm64)BORG_0.3.1.tar.gz(r-4.6-x86_64)
BORG_0.3.1.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
card.svg |card.png
BORG/json (API)
NEWS

# Install 'BORG' in R:
install.packages('BORG', repos = c('https://gcol33.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/gcol33/borg/issues

Pkgdown/docs site:https://gillescolling.com

Uses libs:
  • c++– GNU Standard C++ Library v3

On CRAN:

Conda:

dependencemodel-evaluationriskvalidationcpp

5.81 score 13 scripts 523 downloads 81 exports 1 dependencies

Last updated from:8308c6be19. Checks:11 NOTE, 2 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-arm64NOTE181
linux-devel-x86_64NOTE207
source / vignettesOK303
linux-release-arm64NOTE184
linux-release-x86_64NOTE225
macos-release-arm64NOTE150
macos-release-x86_64NOTE226
macos-oldrel-arm64NOTE146
macos-oldrel-x86_64NOTE278
windows-develNOTE205
windows-releaseNOTE188
windows-oldrelNOTE171
wasm-releaseOK144

Exports:audit_importanceaudit_predictionsborgborg_adversarialborg_aoaborg_assimilateborg_auto_checkborg_best_subsetborg_block_sizeborg_bootstrapborg_cache_clearborg_cache_getborg_cache_infoborg_cache_setborg_calibrationborg_certificateborg_checkborg_check_coverageborg_check_nested_cvborg_check_residualsborg_compare_cvborg_compare_modelsborg_conformalborg_cvborg_debiasborg_diborg_diagnoseborg_disc_cvborg_driftborg_ensembleborg_error_profileborg_explain_riskborg_exportborg_extractborg_extrapolationborg_fairnessborg_fold_performanceborg_fold_similarityborg_forward_selectionborg_geodistborg_global_validationborg_group_vfold_cvborg_importanceborg_initial_splitborg_inspectborg_leafletborg_literature_checkborg_local_moranborg_metricsborg_multiscaleborg_null_testborg_optionsborg_pipelineborg_powerborg_predict_rasterborg_prediction_mapborg_register_hooksborg_repeated_cvborg_reportborg_rsetborg_sample_designborg_shapborg_simulateborg_spatial_cvborg_spatial_looborg_stabilityborg_stability_mapborg_temporal_cvborg_thinborg_to_biomod2borg_to_enmevalborg_to_mlr3borg_trainControlborg_transferabilityborg_unregister_hooksborg_validateborg_vfold_cvborg_willmottborg_workflowcv_leakage_reportshow

Dependencies:Rcpp

Area of Applicability and Extrapolation Detection

Gilles Colling

Rendered fromaoa-extrapolation.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-03-31

Feature Selection with Blocked Cross-Validation

Gilles Colling

Rendered fromfeature-selection.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-03-31

Framework Integration

Gilles Colling

Rendered fromframeworks.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-01-07

Model Comparison with Blocked Cross-Validation

Gilles Colling

Rendered frommodel-comparison.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-03-31

Post-Fit Diagnostics

Gilles Colling

Rendered fromdiagnostics.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-03-31

Quick Start

Gilles Colling

Rendered fromquickstart.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-01-07

Risk Taxonomy

Gilles Colling

Rendered fromrisk-taxonomy.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-01-07

Spatial Cross-Validation

Gilles Colling

Rendered fromspatial-cv.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-03-31

Temporal Cross-Validation

Gilles Colling

Rendered fromtemporal-cv.Rmdusingknitr::rmarkdownon Jun 15 2026.

Last update: 2026-03-31
Started: 2026-03-31

Readme and manuals

Help Manual

Help pageTopics
Coerce BorgDiagnosis to Data Frameas.data.frame.BorgDiagnosis
Coerce BorgRisk to Data Frameas.data.frame.BorgRisk
Audit Feature Importance Calculationsaudit_importance
Audit Predictions for Data Leakageaudit_predictions
Autoplot Method for borg_comparison Objectsautoplot.borg_comparison
Autoplot Method for borg_cv Objectsautoplot.borg_cv
Autoplot Method for borg_fold_perf Objectsautoplot.borg_fold_perf
Autoplot Method for borg_result Objectsautoplot.borg_result
Autoplot Method for BorgDiagnosis Objectsautoplot.BorgDiagnosis
Autoplot Method for BorgRisk Objectsautoplot.BorgRisk
BORG: Guard Your Model Evaluationborg
Adversarial Validationborg_adversarial
Area of Applicabilityborg_aoa
Assimilate Leaky Evaluation Pipelinesborg_assimilate
Enable/Disable BORG Auto-Check Modeborg_auto_check
Best Subset Variable Selection with Blocked CVborg_best_subset
Optimize Spatial Block Sizeborg_block_size
Block Bootstrap Confidence Intervals for CV Metricsborg_bootstrap
Cache and Retrieve BORG Diagnosesborg_cache borg_cache_clear borg_cache_get borg_cache_info borg_cache_set
Model Calibration Diagnosticsborg_calibration
Create Validation Certificateborg_certificate
Quick Leakage Check (Pipe-Friendly)borg_check
Check Geographic Representativeness of CV Foldsborg_check_coverage
Check Nested CV for Leakageborg_check_nested_cv
Check Residual Spatial Autocorrelationborg_check_residuals
Compare Random vs Blocked Cross-Validationborg_compare_cv
Compare Multiple Models with Spatial CVborg_compare_models
Conformal Prediction with Spatial Dependenceborg_conformal
Generate Valid Cross-Validation Schemeborg_cv
Spatial+ Debiasing for Spatial Confoundingborg_debias
Dissimilarity Indexborg_di
Diagnose Data Dependency Structureborg_diagnose
Leave-Disc-Out Cross-Validationborg_disc_cv
Detect Distribution Shift Between Training and Deployment Databorg_drift
Ensemble Predictions from CV Fold Modelsborg_ensemble
Calibrate Dissimilarity Index to Prediction Errorborg_error_profile
Explain Risks in Plain Language with Actionable Recommendationsborg_explain_risk
Export Validation Certificateborg_export
Extract Raster Values at Point Locations for BORGborg_extract
Detect Model Extrapolationborg_extrapolation
Detect Performance Disparities Across Subgroups Under Blocked CVborg_fairness
Evaluate Per-Fold Model Performanceborg_fold_performance
Per-Fold Environmental Similarity (MESS)borg_fold_similarity
Forward Feature Selection with Spatial/Blocked CVborg_forward_selection
Distance Distribution Diagnosticsborg_geodist
Global (Pooled) Cross-Validation Metricsborg_global_validation
BORG-Guarded group_vfold_cvborg_group_vfold_cv
Block-Permutation Variable Importanceborg_importance
BORG-Guarded initial_splitborg_initial_split
Inspect R Objects for Evaluation Risksborg_inspect
Interactive Leaflet Map of Spatial CV Foldsborg_leaflet
Scan Methods Text for Common Leakage Patternsborg_literature_check
Local Moran's I for Residualsborg_local_moran
Available Classification Metricsborg_metrics
Multi-Scale Performance Assessmentborg_multiscale
Null Model Significance Testborg_null_test
Get Current BORG Optionsborg_options
Validate an Entire Modeling Pipelineborg_pipeline
Estimate Statistical Power After Blockingborg_power
Predict onto a SpatRaster with AOA Maskingborg_predict_raster
Spatial Prediction Uncertainty Mapborg_prediction_map
Register BORG Hooksborg_register_hooks
Repeated Blocked Cross-Validationborg_repeated_cv
Generate BORG HTML Diagnostic Reportborg_report
Convert BORG Folds to an rsample rset Objectborg_rset
Suggest Sampling Locations to Improve AOAborg_sample_design
Spatial SHAP Valuesborg_shap
Generate Synthetic Data with Known Leakageborg_simulate
Spatial Block Cross-Validation (rsample-compatible)borg_spatial_cv
Buffered Leave-One-Out Cross-Validationborg_spatial_loo
Analyze CV Fold Stability Across Repeatsborg_stability
Prediction Stability Mapborg_stability_map
Temporal Block Cross-Validation (rsample-compatible)borg_temporal_cv
Spatially Thin Occurrence Databorg_thin
Convert BORG Folds to biomod2 Formatborg_to_biomod2
Convert BORG Folds to ENMeval Partition Formatborg_to_enmeval
mlr3 Resampling for BORG Cross-Validationborg_to_mlr3
BORG-Guarded trainControlborg_trainControl
Assess Geographic Transferabilityborg_transferability
Unregister BORG Hooksborg_unregister_hooks
Validate Complete Evaluation Workflowborg_validate
BORG-Guarded vfold_cvborg_vfold_cv
Willmott's Index of Agreementborg_willmott
Create a BORG Validation Workflowborg_workflow
BORG-Guarded Cross-Validation Functionsborg-wrappers
BorgDiagnosis S4 ClassBorgDiagnosis BorgDiagnosis-class show,BorgDiagnosis-method
BorgRisk S4 ClassBorgRisk BorgRisk-class show,BorgRisk-method
Generate CV Leakage Reportcv_leakage_report
Plot CV Comparison Resultsplot.borg_comparison
Plot BORG Result Objectsplot.borg_result
Plot BORG Objectsplot.BorgRisk
Print CV Leakage Reportprint.borg_cv_report
Summarize BORG Cross-Validationsummary.borg_cv
Summarize BORG Pipeline Validationsummary.borg_pipeline
Summarize BORG Power Analysissummary.borg_power
Summarize BORG Resultsummary.borg_result
Summarize BORG Diagnosissummary.BorgDiagnosis
Summarize BORG Risk Assessmentsummary.BorgRisk