Issues

• ImportError for register_spark() does not raise from actual ImportError

  joblib/joblib-spark#64 · Filter by author mikeweltevrede opened on Nov 21, 2025

• Optuna not parallelising across workers using joblib spark backend on Databricks

  joblib/joblib-spark#61 · Filter by author alexisdrakopoulos opened on Mar 18, 2025

• Cannot register_spark() for Databricks Runtime ML 16.0 and 16.1

  joblib/joblib-spark#60 · Filter by author splatt92 opened on Jan 7, 2025
  1

• SparkDistributedBackend._is_support_stage_scheduling always prints warning

  joblib/joblib-spark#59 · Filter by author philipmat opened on Dec 30, 2024

• catboost & joblib spark

  joblib/joblib-spark#58 · Filter by author timpiperseek opened on Sep 10, 2024

• [Bug] Method cpus does not exist, version 0.5.3 doesn't work with spark 3.4 or 3.5

  joblib/joblib-spark#57 · Filter by author thinkall opened on Aug 15, 2024
  1

• Is there a plan to implement Spark Connect to Joblib-spark?

  joblib/joblib-spark#50 · Filter by author Kurdzik opened on Jul 4, 2023

• Is Databricks auto-scaling supposed to work with joblib-spark?

  joblib/joblib-spark#45 · Filter by author pauljohn32 opened on Jan 5, 2023
  1

• Parallelisation not working for BIRCH clustering

  joblib/joblib-spark#42 · Filter by author siddharth-redseer opened on Aug 26, 2022
  1

• Ability to reuse existing spark session for ParallelBackend

  joblib/joblib-spark#40 · Filter by author aaronzo opened on May 29, 2022

• ModuleNotFoundError: No module named 'sklearn.svm.classes

  joblib/joblib-spark#39 · Filter by author jayasuriya888 opened on Jan 28, 2022
  1

• Use pyspark.InheritableThread as the base thread class for threadpool

  joblib/joblib-spark#32 · Filter by author NivekNey opened on Jul 19, 2021
  1

• Print warning if estimator/model/transformer doesn't support job-lib spark parallelism.

  joblib/joblib-spark#31 · Filter by author WeichenXu123 opened on Jul 16, 2021

• Driver executor disk space fills up with temp files

  joblib/joblib-spark#30 · Filter by author warwickhadley opened on Jun 28, 2021
  2

• getting _FuncWrapper attribute not found

  joblib/joblib-spark#29 · Filter by author cvsekhar opened on Jan 19, 2021

• Parallelization Within Tasks

  joblib/joblib-spark#25 · Filter by author davidcereal opened on Aug 27, 2020

• Running parallel gridsearch via databricks-connect

  joblib/joblib-spark#24 · Filter by author stelsemeyer opened on Aug 18, 2020

• Memory leak in task serialization

  joblib/joblib-spark#16 · Filter by author gench opened on May 1, 2020
  3