# Custom Scripts Docker Images ## Supported Python Versions * Python 3.12 * Python 3.10 * Python 3.9 ## Supported Docker Images Currently, Treasure Workflow supports the following Docker images: * treasuredata/customscript-python:3.12.11-td1 [current stable] * digdag/digdag-python:3.10.18-td0 * digdag/digdag-python:3.10.1 (3.10) [deprecated] * digdag/digdag-python:3.9.22-td2 * digdag/digdag-python:3.9.2 [deprecated] * digdag/digdag-python:3.9.1 (3.9) [deprecated] Some images listed above still use the deprecated versioning scheme (such as 3.9, 3.9.1, 3.9.2) and contain security vulnerabilities. We recommend using images with the current versioning scheme (such as 3.12.11-td1) that include security fixes. For details about our versioning policy, see [Docker Image Versioning Policy](/products/customer-data-platform/data-workbench/workflows/customscript/custom-scripts-docker-image-versioning). ## Installed Python and Library Versions The Python libraries installed in the Custom Script Docker image are divided into two groups: "required libraries" and "installed libraries". "required libraries" are libraries listed in requirements.txt. They are installed as long as the Python minor version is the same. For example, the `pystan` library is in the "required libraries" of the 3.9.1 image, so you can expect the 3.9.77-td88 image will contain the `pystan` library. However, the 3.10.88-td99 image may not contain the `pystan` library. On the other hand, "installed libraries" include dependencies of required libraries as well as required libraries. The libraries other than required libraries may not exist in the next version of the image. ### treasuredata/customscript-python:3.12.11-td1 [current stable] - Python 3.12.11 - required libraries: ``` boto3 convertdate Cython holidays hyperopt lightgbm lunarcalendar matplotlib memory_profiler nltk numpy optuna optuna-integration[sklearn] pandas plotly prophet pyarrow pystan pytd pytest requests scikit-learn scipy seaborn simplejson tqdm ``` - installed libraries: ``` Package Version --------------------- ---------- aiohappyeyeballs 2.6.1 aiohttp 3.12.15 aiosignal 1.4.0 alembic 1.16.4 appdirs 1.4.4 attrs 25.3.0 boto3 1.40.16 botocore 1.40.16 certifi 2025.8.3 charset-normalizer 3.4.3 click 8.2.1 clikit 0.6.2 cloudpickle 3.1.1 cmdstanpy 1.2.5 colorlog 6.9.0 contourpy 1.3.3 convertdate 2.4.0 crashtest 0.3.1 cycler 0.12.1 Cython 3.1.3 ephem 4.2 fonttools 4.59.1 frozenlist 1.7.0 future 1.0.0 greenlet 3.2.4 holidays 0.79 httpstan 4.13.0 hyperopt 0.2.7 idna 3.10 importlib_resources 6.5.2 iniconfig 2.1.0 jmespath 1.0.1 joblib 1.5.1 kiwisolver 1.4.9 lightgbm 4.6.0 LunarCalendar 0.0.9 lz4 4.4.4 Mako 1.3.10 MarkupSafe 3.0.2 marshmallow 3.26.1 matplotlib 3.10.5 memory-profiler 0.61.0 msgpack 1.1.1 multidict 6.6.4 narwhals 2.2.0 networkx 3.5 nltk 3.9.1 numpy 2.3.2 optuna 4.5.0 optuna-integration 4.5.0 orjson 3.11.2 packaging 25.0 pandas 2.3.2 pastel 0.2.1 pillow 11.3.0 plotly 6.3.0 pluggy 1.6.0 propcache 0.3.2 prophet 1.1.7 psutil 7.0.0 py4j 0.10.9.9 pyarrow 21.0.0 Pygments 2.19.2 pylev 1.4.0 PyMeeus 0.5.12 pyparsing 3.2.3 pysimdjson 6.0.2 pystan 3.10.0 pytd 2.2.0 pytest 8.4.1 python-dateutil 2.9.0.post0 pytz 2025.2 PyYAML 6.0.2 regex 2025.7.34 requests 2.32.5 s3transfer 0.13.1 scikit-learn 1.7.1 scipy 1.16.1 seaborn 0.13.2 setuptools 80.9.0 simplejson 3.20.1 six 1.17.0 SQLAlchemy 2.0.43 stanio 0.5.1 td-client 1.5.0 threadpoolctl 3.6.0 tqdm 4.67.1 trino 0.336.0 typing_extensions 4.14.1 tzdata 2025.2 tzlocal 5.3.1 urllib3 2.5.0 webargs 8.7.0 yarl 1.20.1 zstandard 0.24.0 ``` ### digdag/digdag-python:3.10.18-td0 - Python 3.10.18 - required libraries: ``` boto3 convertdate Cython holidays hyperopt lightgbm lunarcalendar matplotlib memory_profiler nltk numpy optuna optuna-integration[sklearn] pandas plotly prophet pyarrow pystan pytd[spark] pytest requests scikit-learn scipy seaborn simplejson td_pyspark[spark]==24.4.0 tqdm ``` - installed libraries: ``` Package Version --------------------- --------- aiohappyeyeballs 2.6.1 aiohttp 3.12.15 aiosignal 1.4.0 alembic 1.16.5 appdirs 1.4.4 async-timeout 5.0.1 attrs 25.3.0 boto3 1.40.34 botocore 1.40.34 certifi 2025.8.3 charset-normalizer 3.4.3 click 8.3.0 clikit 0.6.2 cloudpickle 3.1.1 cmdstanpy 1.2.5 colorlog 6.9.0 contourpy 1.3.2 convertdate 2.4.0 crashtest 0.3.1 cycler 0.12.1 Cython 3.1.4 ephem 4.2 exceptiongroup 1.3.0 fonttools 4.60.0 frozenlist 1.7.0 future 1.0.0 greenlet 3.2.4 holidays 0.81 httpstan 4.13.0 hyperopt 0.2.7 idna 3.10 importlib_resources 6.5.2 iniconfig 2.1.0 jmespath 1.0.1 joblib 1.5.2 kiwisolver 1.4.9 lightgbm 4.6.0 LunarCalendar 0.0.9 lz4 4.4.4 Mako 1.3.10 MarkupSafe 3.0.2 marshmallow 3.26.1 matplotlib 3.10.6 memory-profiler 0.61.0 msgpack 1.1.1 multidict 6.6.4 narwhals 2.5.0 networkx 3.4.2 nltk 3.9.1 numpy 2.2.6 optuna 4.5.0 optuna-integration 4.5.0 orjson 3.11.3 packaging 25.0 pandas 2.3.2 pastel 0.2.1 pillow 11.3.0 plotly 6.3.0 pluggy 1.6.0 propcache 0.3.2 prophet 1.1.7 psutil 7.1.0 py4j 0.10.9.7 pyarrow 21.0.0 Pygments 2.19.2 pylev 1.4.0 PyMeeus 0.5.12 pyparsing 3.2.4 pysimdjson 6.0.2 pyspark 3.4.4 pystan 3.10.0 pytd 2.2.0 pytest 8.4.2 python-dateutil 2.9.0.post0 pytz 2025.2 PyYAML 6.0.2 regex 2025.9.18 requests 2.32.5 s3transfer 0.14.0 scikit-learn 1.7.2 scipy 1.15.3 seaborn 0.13.2 simplejson 3.20.1 six 1.17.0 SQLAlchemy 2.0.43 stanio 0.5.1 td-client 1.5.0 td_pyspark 24.4.0 threadpoolctl 3.6.0 tomli 2.2.1 tqdm 4.67.1 trino 0.336.0 typing_extensions 4.15.0 tzdata 2025.2 tzlocal 5.3.1 urllib3 2.5.0 webargs 8.7.0 yarl 1.20.1 zstandard 0.25.0 ``` ### digdag/digdag-python:3.10.1 (3.10) - Python 3.10.11 - required libraries: ``` boto3 convertdate Cython futures holidays hyperopt lightgbm lunarcalendar matplotlib memory_profiler nltk numpy optuna pandas plotly prophet pyarrow pystan pytd[spark] pytest requests scikit-learn scipy seaborn simplejson td-pyspark-ea tqdm ``` - installed libraries: ``` Package Version --------------------- -------- aiohttp 3.8.4 aiosignal 1.3.1 alembic 1.10.4 appdirs 1.4.4 async-timeout 4.0.2 attrs 23.1.0 boto3 1.26.132 botocore 1.29.132 certifi 2023.5.7 charset-normalizer 3.1.0 click 8.1.3 clikit 0.6.2 cloudpickle 2.2.1 cmaes 0.9.1 cmdstanpy 1.1.0 colorlog 6.7.0 contourpy 1.0.7 convertdate 2.4.0 crashtest 0.3.1 cycler 0.11.0 Cython 0.29.34 ephem 4.1.4 exceptiongroup 1.1.1 fonttools 4.39.4 frozenlist 1.3.3 future 0.18.3 futures 3.0.5 greenlet 2.0.2 hijri-converter 2.3.1 holidays 0.24 httpstan 4.10.0 hyperopt 0.2.7 idna 3.4 iniconfig 2.0.0 jmespath 1.0.1 joblib 1.2.0 kiwisolver 1.4.4 korean-lunar-calendar 0.3.1 lightgbm 3.3.5 LunarCalendar 0.0.9 Mako 1.2.4 MarkupSafe 2.1.2 marshmallow 3.19.0 matplotlib 3.7.1 memory-profiler 0.61.0 msgpack 1.0.5 multidict 6.0.4 networkx 3.1 nltk 3.8.1 numpy 1.23.5 optuna 3.1.1 packaging 23.1 pandas 1.5.3 pastel 0.2.1 Pillow 9.5.0 plotly 5.14.1 pluggy 1.0.0 presto-python-client 0.8.3 prophet 1.1.2 psutil 5.9.5 py4j 0.10.9.7 pyarrow 12.0.0 pylev 1.4.0 PyMeeus 0.5.12 pyparsing 3.0.9 pysimdjson 5.0.2 pyspark 3.4.0 pystan 3.7.0 pytd 1.5.1 pytest 7.3.1 python-dateutil 2.8.2 pytz 2023.3 PyYAML 6.0 regex 2023.5.5 requests 2.30.0 s3transfer 0.6.1 scikit-learn 1.2.2 scipy 1.10.1 seaborn 0.12.2 setuptools 65.5.1 simplejson 3.19.1 six 1.16.0 SQLAlchemy 2.0.13 td-client 1.2.1 td-pyspark 22.7.1 td-pyspark-ea 20.12.0 tenacity 8.2.2 threadpoolctl 3.1.0 tomli 2.0.1 tqdm 4.65.0 typing_extensions 4.5.0 urllib3 1.26.15 webargs 8.2.0 wheel 0.38.4 yarl 1.9.2 ``` ### digdag/digdag-python:3.9.22-td2 - Python 3.9.22 - required libraries: ``` boto3 fbprophet futures hyperopt lightgbm matplotlib memory_profiler nltk numpy optuna pandas plotly pystan pytd[spark] pytest requests scikit-learn scipy seaborn simplejson td-pyspark-ea tqdm ``` - installed libraries: ``` Package Version --------------------- --------- alembic 1.5.8 attrs 20.3.0 boto3 1.26.132 botocore 1.29.132 certifi 2025.4.26 chardet 4.0.0 click 7.1.2 cliff 3.5.0 cloudpickle 1.6.0 cmaes 0.8.2 cmd2 1.5.0 cmdstanpy 0.9.5 colorama 0.4.4 colorlog 4.8.0 convertdate 2.2.0 cycler 0.10.0 Cython 0.29.22 ephem 3.7.7.1 fbprophet 0.7.1 future 0.18.3 greenlet 1.0.0 holidays 0.10.4 hyperopt 0.2.5 idna 2.10 iniconfig 1.1.1 jmespath 0.10.0 joblib 1.1.1 kiwisolver 1.3.1 korean-lunar-calendar 0.2.1 lightgbm 4.6.0 LunarCalendar 0.0.9 Mako 1.1.4 MarkupSafe 1.1.1 matplotlib 3.4.1 memory-profiler 0.58.0 msgpack 1.0.2 networkx 2.6 nltk 3.9.1 numpy 1.20.2 optuna 2.7.0 packaging 20.9 pandas 1.3.0 pbr 5.5.1 pillow 10.3.0 plotly 4.14.3 pluggy 0.13.1 presto-python-client 0.7.0 prettytable 0.7.2 psutil 5.8.0 py 1.10.0 py4j 0.10.9.7 pyarrow 14.0.1 PyMeeus 0.5.11 pyparsing 2.4.7 pyperclip 1.8.2 pyspark 3.5.5 pystan 2.19.1.1 pytd 1.5.2 pytest 6.2.3 python-dateutil 2.8.1 python-editor 1.0.4 pytz 2019.3 PyYAML 5.4.1 regex 2021.8.3 requests 2.25.1 retrying 1.3.3 s3transfer 0.6.1 scikit-learn 0.24.1 scipy 1.8.0 seaborn 0.11.1 setuptools 58.1.0 setuptools-git 1.2 simplejson 3.17.2 six 1.15.0 SQLAlchemy 1.4.5 stevedore 3.3.0 td-client 1.2.1 td-pyspark 21.3.0 td-pyspark-ea 20.12.0 threadpoolctl 2.1.0 toml 0.10.2 tqdm 4.60.0 urllib3 1.26.0 wcwidth 0.2.5 wheel 0.45.1 ``` ### digdag/digdag-python:3.9.2 - Python 3.9.16 - required libraries: ``` boto3 fbprophet futures hyperopt lightgbm matplotlib memory_profiler nltk numpy optuna pandas plotly pystan pytd[spark] pytest requests scikit-learn scipy seaborn simplejson td-pyspark-ea tqdm ``` - installed libraries: ``` Package Version --------------------- --------- alembic 1.5.8 attrs 20.3.0 boto3 1.26.132 botocore 1.29.132 certifi 2020.12.5 chardet 4.0.0 click 7.1.2 cliff 3.5.0 cloudpickle 1.6.0 cmaes 0.8.2 cmd2 1.5.0 cmdstanpy 0.9.5 colorama 0.4.4 colorlog 4.8.0 convertdate 2.2.0 cycler 0.10.0 Cython 0.29.22 ephem 3.7.7.1 fbprophet 0.7.1 future 0.18.3 futures 3.1.1 greenlet 1.0.0 holidays 0.10.4 hyperopt 0.2.5 idna 2.10 iniconfig 1.1.1 jmespath 0.10.0 joblib 1.1.1 kiwisolver 1.3.1 korean-lunar-calendar 0.2.1 lightgbm 3.2.0 LunarCalendar 0.0.9 Mako 1.1.4 MarkupSafe 1.1.1 matplotlib 3.4.1 memory-profiler 0.58.0 msgpack 1.0.2 networkx 2.6 nltk 3.6.6 numpy 1.20.2 optuna 2.7.0 packaging 20.9 pandas 1.3.0 pbr 5.5.1 Pillow 9.0.0 plotly 4.14.3 pluggy 0.13.1 presto-python-client 0.7.0 prettytable 0.7.2 psutil 5.8.0 py 1.10.0 py4j 0.10.9.7 pyarrow 12.0.0 PyMeeus 0.5.11 pyparsing 2.4.7 pyperclip 1.8.2 pyspark 3.4.0 pystan 2.19.1.1 pytd 1.5.1 pytest 6.2.3 python-dateutil 2.8.1 python-editor 1.0.4 pytz 2019.3 PyYAML 5.4.1 regex 2021.8.3 requests 2.25.1 retrying 1.3.3 s3transfer 0.6.1 scikit-learn 0.24.1 scipy 1.6.2 seaborn 0.11.1 setuptools 58.1.0 setuptools-git 1.2 simplejson 3.17.2 six 1.15.0 SQLAlchemy 1.4.5 stevedore 3.3.0 td-client 1.2.1 td-pyspark 21.3.0 td-pyspark-ea 20.12.0 threadpoolctl 2.1.0 toml 0.10.2 tqdm 4.60.0 urllib3 1.26.0 wcwidth 0.2.5 wheel 0.40.0 ``` ### digdag/digdag-python:3.9.1 (3.9) - Python 3.9.15 - required libraries: ``` boto3 fbprophet futures hyperopt lightgbm matplotlib memory_profiler nltk numpy optuna pandas plotly pystan pytd[spark] pytest requests scikit-learn scipy seaborn simplejson td-pyspark-ea tqdm ``` - installed libraries: ``` Package Version --------------------- --------- alembic 1.5.8 attrs 20.3.0 boto3 1.15.18 botocore 1.18.18 certifi 2020.12.5 chardet 4.0.0 click 7.1.2 cliff 3.5.0 cloudpickle 1.6.0 cmaes 0.8.2 cmd2 1.5.0 cmdstanpy 0.9.5 colorama 0.4.4 colorlog 4.8.0 convertdate 2.2.0 cycler 0.10.0 Cython 0.29.22 decorator 4.4.2 ephem 3.7.7.1 fbprophet 0.7.1 future 0.18.2 futures 3.1.1 greenlet 1.0.0 holidays 0.10.4 hyperopt 0.2.5 idna 2.10 iniconfig 1.1.1 jmespath 0.10.0 joblib 1.0.1 kiwisolver 1.3.1 korean-lunar-calendar 0.2.1 lightgbm 3.2.0 LunarCalendar 0.0.9 Mako 1.1.4 MarkupSafe 1.1.1 matplotlib 3.4.1 memory-profiler 0.58.0 msgpack 1.0.2 networkx 2.5.1 nltk 3.5 numpy 1.20.2 optuna 2.7.0 packaging 20.9 pandas 1.2.3 pbr 5.5.1 Pillow 8.2.0 plotly 4.14.3 pluggy 0.13.1 presto-python-client 0.7.0 prettytable 0.7.2 psutil 5.8.0 py 1.10.0 py4j 0.10.9 pyarrow 3.0.0 PyMeeus 0.5.11 pyparsing 2.4.7 pyperclip 1.8.2 pyspark 3.1.1 pystan 2.19.1.1 pytd 1.4.0 pytest 6.2.3 python-dateutil 2.8.1 python-editor 1.0.4 pytz 2019.3 PyYAML 5.4.1 regex 2021.4.4 requests 2.25.1 retrying 1.3.3 s3transfer 0.3.6 scikit-learn 0.24.1 scipy 1.6.2 seaborn 0.11.1 setuptools 58.1.0 setuptools-git 1.2 simplejson 3.17.2 six 1.15.0 SQLAlchemy 1.4.5 stevedore 3.3.0 td-client 1.2.1 td-pyspark 21.3.0 td-pyspark-ea 20.12.0 threadpoolctl 2.1.0 toml 0.10.2 tqdm 4.60.0 urllib3 1.24.3 wcwidth 0.2.5 wheel 0.38.4 ``` Warning Starting from Python 3.12, the image namespace has changed from `digdag` to `treasuredata`, and the image name has changed from `digdag-python` to `customscript-python`. PySpark is no longer installed in Python 3.12+ images, unlike previous versions.