磚7.6運行時機器學習(不支持)

磚在2021年2月發布了這張照片。

磚7.6運行時機器學習為機器學習和數據提供了一個準備好了環境科學的基礎上磚運行時的7.6(不支持)。磚運行時毫升含有許多流行的機器學習庫,包括TensorFlow PyTorch, XGBoost。它還支持使用Horovod分布深度學習培訓。

更多信息,包括指令創建磚集群運行時毫升、明白了介紹磚運行時機器學習

尋求幫助從磚遷移運行時6。x,看到磚運行時7。x遷移指南

新功能和重大變化

磚磚的運行時7.6毫升之上7.6運行時。有什麼新信息的磚7.6運行時,包括Apache火花MLlib和SparkR,看到磚運行時的7.6(不支持)發行說明。

的用法

  • Tensoflow 1。x將在即將到來的主要版本不支持磚的運行時

  • 棄用和以下CUDA包將被刪除在即將到來的磚的主要發布運行時:

    • cuda-command-line-tools

    • cuda-compiler

    • cuda-cudart-dev

    • cuda-cufft

    • cuda-cufft-dev

    • cuda-cuobjdump

    • cuda-cupti

    • cuda-curand

    • cuda-curand-dev

    • cuda-cusolver

    • cuda-cusolver-dev

    • cuda-cusparse

    • cuda-cusparse-dev

    • cuda-documentation

    • cuda-driver-dev

    • cuda-gdb

    • cuda-gpu-library-advisor

    • cuda-libraries-dev

    • cuda-license

    • cuda-memcheck

    • cuda-minimal-build

    • cuda-misc-headers

    • cuda-npp

    • cuda-npp-dev

    • cuda-nsight

    • cuda-nvcc

    • cuda-nvdisasm

    • cuda-nvgraph

    • cuda-nvgraph-dev

    • cuda-nvjpeg

    • cuda-nvjpeg-dev

    • cuda-nvml-dev

    • cuda-nvprune

    • cuda-nvrtc-dev

    • cuda-nvvp

    • cuda-samples

    • cuda-sanitizer-api

    • cuda

    • cuda-tools

    • cuda-visual-tools

    • freeglut3

    • libcublas-dev

    • libcudnn7-dev

    • libdrm-dev

    • libegl1

    • libegm-mesa0

    • libgbl1-mesa-dev

    • libgbm1

    • libgles1

    • libgles2

    • libglu1-mesa

    • libglu1-mesa-dev

    • libnccl-dev

    • libnvinfer-dev

    • libnvinfer-plugin-dev

    • libopengl0

    • libwayland-server0

    • libx11-xcb-dev

    • libxcb-dri2-0-dev

    • libxcb-dri3-dev

    • libxcb-glx0-dev

    • libxcb-present-dev

    • libxcb-randr0

    • libxcb-randr0-dev

    • libxcb-render0-dev

    • libxcb-shape0-dev

    • libxcb-sync-dev

    • libxcb-xfixes0

    • libxcb-xfixes0-dev

    • libxdamage-dev

    • libxext-dev

    • libxfixes-dev

    • libxi-dev

    • libxmu-dev

    • libxmu-headers

    • libxshmfence-dev

    • libxxf86vm-dev

    • mesa-common-dev

    • nsight-compute

    • nsight-systems

    • x11proto-damage-dev

    • x11proto-fixes-dev

    • x11proto-input-dev

    • x11proto-xext-dev

    • x11proto-xf86vidmode-dev

重大變化磚Python運行時毫升的環境

看到磚運行時的7.6(不支持)對磚Python運行時環境的重大變化。安裝Python包的完整列表和他們的版本,看Python庫

Python包升級

  • databricks-cli 0.14.0 - > 0.14.1

  • 考拉1.4.0 - > 1.5.0

  • lightgbm tripwire - > 3.1.1

  • mlflow 1.12.1 - > 1.13.1

  • 情節4.12.0 - > 4.14.1

  • pytorch 1.7.0 - > 1.7.1上

  • torchvision 0.8.1 - > 0.8.2

  • xgboost 1.2.1 - > 1.3.1

改進

PySpark集成XGBoost(公共預覽版)

XGBoost集成與PySpark已得到改進。這個包sparkdl2.1.0-db5包括兩個新的PySpark ML估計,XgboostRegressorXgboostClassifier,讓用戶培訓XGBoost PySpark毫升管道模型。

在這個版本之前,XGBoost並不與PySpark集成。用戶必須使用xgboost4j-spark在Scala中管道或打破PySpark毫升、收集火花DataFrame司機作為大熊貓DataFrame,並使用Python包xgboost。看到sparkdl API文檔使用XGBoost磚為更多的細節。

係統環境

磚的係統環境運行時7.6毫升不同於磚運行時的7.6如下:

  • DBUtils運行時毫升不包含:磚庫工具(dbutils.library)。您可以使用%皮普% conda而不是命令。看到Notebook-scoped Python庫

  • GPU集群,磚包括以下運行時毫升NVIDIA GPU的庫:

    • CUDA 10.1更新2

    • cuDNN 7.6.5

    • NCCL 2.7.3

    • TensorRT 6.0.1中

下麵的章節列表庫包含在磚運行時的7.6毫升,不同於那些包含在磚7.6運行時。

Python庫

磚運行時7.6毫升使用Conda Python包管理,包括許多流行毫升包。

除了包中指定Conda環境在下麵幾節中,磚運行時7.6毫升也安裝以下軟件包:

  • hyperopt 0.2.5.db1

  • sparkdl 2.1.0-db5

Python庫對CPU集群

的名字:databricks-ml渠道:- - - - - -pytorch- - - - - -違約依賴關係:- - - - - -_libgcc_mutex = 0.1 =主要- - - - - -absl-py = 0.9.0 = py37_0- - - - - -= py37_1 1.3.0 asn1crypto =版本- - - - - -阿斯特= 0.8.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -補丁= 1.0 = pyhd3eb1b0_2- - - - - -bcrypt = 3.2.0 = py37h7b6447c_0- - - - - -布拉斯特區= 1.0 = mkl- - - - - -信號燈= 1.4 = py37_0- - - - - -boto3 = 1.12.0 = py_0- - - - - -botocore = 1.15.0 = py_0- - - - - -c-ares = 1.17.1 = h27cfd23_0- - - - - -ca證書= 2021.1.19 = h06a4308_12021年5月26日#(更新h06a4308_0維護更新)- - - - - -cachetools = 4.2.0 = pyhd3eb1b0_0- - - - - -certifi = 2020.12.5 = py37h06a4308_0- - - - - -cffi = 1.14.0 = py37he30daa8_12021年5月26日#(更新py37h2e261b9_0維護更新)- - - - - -chardet = 3.0.4 = py37h06a4308_1003- - - - - -單擊= 7.0 = py37_0- - - - - -cloudpickle = 1.4.1 = py_0- - - - - -configparser = 3.7.4 = py37_0- - - - - -cpuonly = 1.0 = 0- - - - - -密碼= 2.8 = py37h1ba5d50_0- - - - - -周期計= 0.10.0 = py37_0- - - - - -cython = 0.29.15 = py37he6710b0_0- - - - - -4.4.1裝飾= = py_0- - - - - -蒔蘿= 0.3.1.1 = py37_1- - - - - -docutils = 0.15.2 = py37_0- - - - - -entrypoints = 0.3 = py37_0- - - - - -瓶= 1.1.1 = py_1- - - - - -freetype的= 2.9.1 = h8a8886c_1- - - - - -未來= 0.18.2 = py37_1- - - - - -恐嚇= 0.3.3 = py_0- - - - - -gitdb =你= py_0- - - - - -gitpython = 3.1.0 = py_0- - - - - -google-auth = 1.11.2 = py_0- - - - - -google-auth-oauthlib = 0.4.1 = py_2- - - - - -google-pasta = 0.2.0 = py_0- - - - - -grpcio = 1.27.2 = py37hf8bcb03_0- - - - - -gunicorn = 20.0.4 = py37_0- - - - - -h5py = 2.10.0 = py37h7918eee_0- - - - - -hdf5 = 1.10.4 = hb1b8bf9_0- - - - - -icu = 58.2 = he6710b0_3- - - - - -idna = 2.8 = py37_0- - - - - -intel-openmp = 2020.0 = 166- - - - - -ipykernel = 5.1.4 = py37h39e3cac_0- - - - - -ipython = 7.12.0 = py37h5ca1d4c_0- - - - - -ipython_genutils = 0.2.0 = pyhd3eb1b0_1- - - - - -isodate = 0.6.0 = py_1- - - - - -itsdangerous = 1.1.0 = py37_0- - - - - -絕地= 0.17.2 = py37h06a4308_1- - - - - -jinja2 = 2.11.1 = py_0- - - - - -jmespath = 0.10.0 = py_0- - - - - -joblib = 0.14.1 = py_0- - - - - -jpeg = 9 b = h024ee3a_2- - - - - -jupyter_client = 5.3.4 = py37_0- - - - - -jupyter_core = 4.6.1 = py37_0- - - - - -kiwisolver = 1.1.0 = py37he6710b0_0- - - - - -krb5 = 1.17.1 = h173b8e3_02021年5月26日#(更新1.16.4維護更新)- - - - - -ld_impl_linux - 64 = 2.33.1 = h53a641e_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.3 = he6710b0_2#(2021年5月26日,從3.2.1版本更新維護更新)- - - - - -libgcc-ng = 9.1.0 = hdf63c60_0- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libpng = 1.6.37 = hbc83047_0- - - - - -libpq = 12.2 = h20c2e04_0#(2021年5月26日從11.2更新維護更新)- - - - - -libprotobuf = 3.11.4 = hd408876_0- - - - - -libsodium = 1.0.16 = h1bed415_0- - - - - -libstdcxx-ng = 9.1.0 = hdf63c60_0- - - - - -libtiff = 4.1.0 = h2733197_0- - - - - -libuv = 1.40.0 = h7b6447c_0- - - - - -lightgbm = 3.1.1 = py37h2531618_0- - - - - -lz4-c = 1.8.1.2 = h14c3975_0- - - - - -尖吻鯖鯊= 1.1.2 = py_0- - - - - -減價= 3.1.1 = py37_0- - - - - -markupsafe = 1.1.1 = py37h14c3975_1- - - - - -matplotlib-base = 3.1.3 = py37hef1b27d_0- - - - - -mkl = 2020.0 = 166- - - - - -mkl-service = tripwire = py37he8ac12f_0- - - - - -mkl_fft = 1.0.15 = py37ha843d7b_0- - - - - -mkl_random = 1.1.0 = py37hd6b4f25_0- - - - - -ncurses = 6.2 = he6710b0_1- - - - - -networkx = 2.4 = py_1- - - - - -忍者= 1.10.2 = py37hff7bd54_0- - - - - -nltk = 3.4.5 = py37_0- - - - - -numpy = 1.18.1 = py37h4f9e942_0- - - - - -numpy-base = 1.18.1 = py37hde5b4d6_1- - - - - -oauthlib = 3.1.0 = py_0- - - - - -olefile = 0.46 = py37_0- - - - - -openssl = 1.1.1k = h27cfd23_02021年5月26日#(更新1.1.1i維護更新)- - - - - -包裝= 20.1 = py_0- - - - - -熊貓= 1.0.1 = py37h0573a6f_0- - - - - -paramiko = 2.7.1 = py_0- - - - - -parso = 0.7.0 = py_0- - - - - -容易受騙的人= 0.5.1 = py37_0- - - - - -pexpect = 4.8.0 = pyhd3eb1b0_3- - - - - -pickleshare = 0.7.5 = pyhd3eb1b0_1003- - - - - -枕頭= 7.0.0 = py37hb39fc2d_0- - - - - -皮普= 20.0.2 = py37_3- - - - - -情節= 4.14.1 = pyhd3eb1b0_0- - - - - -prompt_toolkit = 3.0.3 = py_0- - - - - -protobuf = 3.11.4 = py37he6710b0_0- - - - - -psutil = 5.6.7 = py37h7b6447c_0- - - - - -psycopg2 = 2.8.6 = py37h3c74f83_12021年5月26日#(更新2.8.4維護更新)- - - - - -ptyprocess = 0.6.0 = pyhd3eb1b0_2- - - - - -pyasn1 = 0.4.8 = py_0- - - - - -pyasn1-modules = 0.2.8 = py_0- - - - - -pycparser = 2.19 = py37_0- - - - - -pygments = 2.5.2 = py_0- - - - - -pyjwt = 2.0.1 = py37h06a4308_0- - - - - -= py37h7b6447c_0 1.3.0 pynacl =版本- - - - - -pyodbc = 4.0.30 = py37he6710b0_0- - - - - -pyopenssl = 19.1.0 = pyhd3eb1b0_1- - - - - -pyparsing = 2.4.6 = py_0- - - - - -pysocks = 1.7.1上= py37_1- - - - - -python = 3.7.10 = hdb3f193_0#(2021年5月26日,從第3.7.6更新維護更新)- - - - - -python-dateutil = 2.8.1發布= py_0- - - - - -python編輯器的1.0.4 = = py_0- - - - - -pytorch = 1.7.1上= py3.7_cpu_0- - - - - -pytz = 2019.3 = py_0- - - - - -pyzmq = 18.1.1 = py37he6710b0_0- - - - - -readline = 8.1 = h27cfd23_0#(2021年5月26日從7.0更新維護更新)- - - - - -= 2.22.0 = py37_1請求- - - - - -= py_0 1.3.0 requests-oauthlib =版本- - - - - -重試= 1.3.3 = py37_2- - - - - -rsa = 4.0 = py_0- - - - - -s3transfer = 0.3.4 = pyhd3eb1b0_0- - - - - -scikit-learn = 0.22.1 = py37hd81dba3_0- - - - - -scipy = 1.4.1 = py37h0b6359f_0- - - - - -setuptools = 45.2.0 = py37_0- - - - - -simplejson = 3.17.0 = py37h7b6447c_0- - - - - -6 = 1.14.0 = py37h06a4308_0- - - - - -smmap = 3.0.4 = py_0- - - - - -sqlite = 3.35.4 = hdfb4753_02021年5月26日#(更新3.31.1維護更新)- - - - - -sqlparse = 0.4.1 = py_0- - - - - -statsmodels = 0.11.0 = py37h7b6447c_0它- - - - - -彙總= 0.8.3 = py37_0- - - - - -tk = 8.6.10 = hbc83047_02021年5月26日#(更新8.6.8維護更新)- - - - - -torchvision = 0.8.2 = py37_cpu- - - - - -龍卷風= 6.0.3 = py37h7b6447c_3- - - - - -tqdm = 4.42.1 = py_0- - - - - -traitlets = 4.3.3 = py37_0- - - - - -typing_extensions = 3.7.4.3 = py_0- - - - - -unixodbc = 2.3.7 = h14c3975_0- - - - - -urllib3 = 1.25.8 = py37_0- - - - - -wcwidth = 0.1.8 = py_0- - - - - -websocket-client = 0.56.0 = py37_0- - - - - -werkzeug = 1.0.0 = py_0- - - - - -輪= 0.34.2 = py37_0- - - - - -打包= 1.11.2 = py37h7b6447c_0- - - - - -xz = 5.2.5 = h7b6447c_02021年5月26日#(更新5.2.4維護更新)- - - - - -zeromq = 4.3.1 = he6710b0_3- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -zstd = 1.3.7 = h0b5b093_0- - - - - -皮普:- - - - - -astunparse = = 1.6.3- - - - - -azure-core = = 1.10.0- - - - - -azure-storage-blob = = 12.7.0- - - - - -databricks-cli = = 0.14.1- - - - - -diskcache = = 5.1.0- - - - - -4.4.1碼頭工人= =- - - - - -大猩猩= = 0.3.0- - - - - -horovod = = 0.20.3- - - - - -joblibspark = = 0.3.0- - - - - -keras-preprocessing = = 1.1.2- - - - - -考拉= = 1.5.0- - - - - -mleap = = 0.16.1- - - - - -mlflow = = 1.13.1- - - - - -msr = = 0.6.19- - - - - -opt-einsum = = 3.3.0- - - - - -petastorm = = 0.9.7- - - - - -pyarrow = = 1.0.1- - - - - -pyyaml = = 5.4- - - - - -querystring-parser = = 4- - - - - -seaborn = = 0.10.0- - - - - -spark-tensorflow-distributor = = 0.1.0- - - - - -tensorboard = = tripwire- - - - - -tensorboard-plugin-wit = = 1.8.0- - - - - -tensorflow-cpu = = 2.3.1- - - - - -tensorflow-estimator = = tripwire- - - - - -termcolor = = 1.1.0- - - - - -xgboost = = 1.3.1前綴:/磚/ conda / env / databricks-ml

Python庫在GPU集群

的名字:databricks-ml-gpu渠道:- - - - - -pytorch- - - - - -違約依賴關係:- - - - - -_libgcc_mutex = 0.1 =主要- - - - - -absl-py = 0.9.0 = py37_0- - - - - -= py37_1 1.3.0 asn1crypto =版本- - - - - -阿斯特= 0.8.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -補丁= 1.0 = pyhd3eb1b0_2- - - - - -bcrypt = 3.2.0 = py37h7b6447c_0- - - - - -布拉斯特區= 1.0 = mkl- - - - - -信號燈= 1.4 = py37_0- - - - - -boto3 = 1.12.0 = py_0- - - - - -botocore = 1.15.0 = py_0- - - - - -c-ares = 1.17.1 = h27cfd23_0- - - - - -ca證書= 2021.1.19 = h06a4308_12021年5月26日#(更新h06a4308_0維護更新)- - - - - -cachetools = 4.2.0 = pyhd3eb1b0_0- - - - - -certifi = 2020.12.5 = py37h06a4308_0- - - - - -cffi = 1.14.0 = py37he30daa8_12021年5月26日#(更新py37h2e261b9_0維護更新)- - - - - -chardet = 3.0.4 = py37h06a4308_1003- - - - - -單擊= 7.0 = py37_0- - - - - -cloudpickle = 1.4.1 = py_0- - - - - -configparser = 3.7.4 = py37_0- - - - - -密碼= 2.8 = py37h1ba5d50_0- - - - - -cudatoolkit = 10.1.243 = h6bb024c_0- - - - - -周期計= 0.10.0 = py37_0- - - - - -cython = 0.29.15 = py37he6710b0_0- - - - - -4.4.1裝飾= = py_0- - - - - -蒔蘿= 0.3.1.1 = py37_1- - - - - -docutils = 0.15.2 = py37_0- - - - - -entrypoints = 0.3 = py37_0- - - - - -瓶= 1.1.1 = py_1- - - - - -freetype的= 2.9.1 = h8a8886c_1- - - - - -未來= 0.18.2 = py37_1- - - - - -恐嚇= 0.3.3 = py_0- - - - - -gitdb =你= py_0- - - - - -gitpython = 3.1.0 = py_0- - - - - -google-auth = 1.11.2 = py_0- - - - - -google-auth-oauthlib = 0.4.1 = py_2- - - - - -google-pasta = 0.2.0 = py_0- - - - - -grpcio = 1.27.2 = py37hf8bcb03_0- - - - - -gunicorn = 20.0.4 = py37_0- - - - - -h5py = 2.10.0 = py37h7918eee_0- - - - - -hdf5 = 1.10.4 = hb1b8bf9_0- - - - - -icu = 58.2 = he6710b0_3- - - - - -idna = 2.8 = py37_0- - - - - -intel-openmp = 2020.0 = 166- - - - - -ipykernel = 5.1.4 = py37h39e3cac_0- - - - - -ipython = 7.12.0 = py37h5ca1d4c_0- - - - - -ipython_genutils = 0.2.0 = pyhd3eb1b0_1- - - - - -isodate = 0.6.0 = py_1- - - - - -itsdangerous = 1.1.0 = py37_0- - - - - -絕地= 0.17.2 = py37h06a4308_1- - - - - -jinja2 = 2.11.1 = py_0- - - - - -jmespath = 0.10.0 = py_0- - - - - -joblib = 0.14.1 = py_0- - - - - -jpeg = 9 b = h024ee3a_2- - - - - -jupyter_client = 5.3.4 = py37_0- - - - - -jupyter_core = 4.6.1 = py37_0- - - - - -kiwisolver = 1.1.0 = py37he6710b0_0- - - - - -krb5 = 1.17.1 = h173b8e3_02021年5月26日#(更新1.16.4維護更新)- - - - - -ld_impl_linux - 64 = 2.33.1 = h53a641e_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.3 = he6710b0_2#(2021年5月26日,從3.2.1版本更新維護更新)- - - - - -libgcc-ng = 9.1.0 = hdf63c60_0- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libpng = 1.6.37 = hbc83047_0- - - - - -libpq = 12.2 = h20c2e04_0#(2021年5月26日從11.2更新維護更新)- - - - - -libprotobuf = 3.11.4 = hd408876_0- - - - - -libsodium = 1.0.16 = h1bed415_0- - - - - -libstdcxx-ng = 9.1.0 = hdf63c60_0- - - - - -libtiff = 4.1.0 = h2733197_0- - - - - -libuv = 1.40.0 = h7b6447c_0- - - - - -lightgbm = 3.1.1 = py37h2531618_0- - - - - -lz4-c = 1.8.1.2 = h14c3975_0- - - - - -尖吻鯖鯊= 1.1.2 = py_0- - - - - -減價= 3.1.1 = py37_0- - - - - -markupsafe = 1.1.1 = py37h14c3975_1- - - - - -matplotlib-base = 3.1.3 = py37hef1b27d_0- - - - - -mkl = 2020.0 = 166- - - - - -mkl-service = tripwire = py37he8ac12f_0- - - - - -mkl_fft = 1.0.15 = py37ha843d7b_0- - - - - -mkl_random = 1.1.0 = py37hd6b4f25_0- - - - - -ncurses = 6.2 = he6710b0_1- - - - - -networkx = 2.4 = py_1- - - - - -忍者= 1.10.2 = py37hff7bd54_0- - - - - -nltk = 3.4.5 = py37_0- - - - - -numpy = 1.18.1 = py37h4f9e942_0- - - - - -numpy-base = 1.18.1 = py37hde5b4d6_1- - - - - -oauthlib = 3.1.0 = py_0- - - - - -olefile = 0.46 = py37_0- - - - - -openssl = 1.1.1k = h27cfd23_02021年5月26日#(更新1.1.1i維護更新)- - - - - -包裝= 20.1 = py_0- - - - - -熊貓= 1.0.1 = py37h0573a6f_0- - - - - -paramiko = 2.7.1 = py_0- - - - - -parso = 0.7.0 = py_0- - - - - -容易受騙的人= 0.5.1 = py37_0- - - - - -pexpect = 4.8.0 = pyhd3eb1b0_3- - - - - -pickleshare = 0.7.5 = pyhd3eb1b0_1003- - - - - -枕頭= 7.0.0 = py37hb39fc2d_0- - - - - -皮普= 20.0.2 = py37_3- - - - - -情節= 4.14.1 = pyhd3eb1b0_0- - - - - -prompt_toolkit = 3.0.3 = py_0- - - - - -protobuf = 3.11.4 = py37he6710b0_0- - - - - -psutil = 5.6.7 = py37h7b6447c_0- - - - - -psycopg2 = 2.8.6 = py37h3c74f83_12021年5月26日#(更新2.8.4維護更新)- - - - - -ptyprocess = 0.6.0 = pyhd3eb1b0_2- - - - - -pyasn1 = 0.4.8 = py_0- - - - - -pyasn1-modules = 0.2.8 = py_0- - - - - -pycparser = 2.19 = py37_0- - - - - -pygments = 2.5.2 = py_0- - - - - -pyjwt = 2.0.1 = py37h06a4308_0- - - - - -= py37h7b6447c_0 1.3.0 pynacl =版本- - - - - -pyodbc = 4.0.30 = py37he6710b0_0- - - - - -pyopenssl = 19.1.0 = pyhd3eb1b0_1- - - - - -pyparsing = 2.4.6 = py_0- - - - - -pysocks = 1.7.1上= py37_1- - - - - -python = 3.7.10 = hdb3f193_0#(2021年5月26日,從第3.7.6更新維護更新)- - - - - -python-dateutil = 2.8.1發布= py_0- - - - - -python編輯器的1.0.4 = = py_0- - - - - -pytorch = 1.7.1上= py3.7_cuda10.1.243_cudnn7.6.3_0- - - - - -pytz = 2019.3 = py_0- - - - - -pyzmq = 18.1.1 = py37he6710b0_0- - - - - -readline = 8.1 = h27cfd23_0#(2021年5月26日從7.0更新維護更新)- - - - - -= 2.22.0 = py37_1請求- - - - - -= py_0 1.3.0 requests-oauthlib =版本- - - - - -重試= 1.3.3 = py37_2- - - - - -rsa = 4.0 = py_0- - - - - -s3transfer = 0.3.4 = pyhd3eb1b0_0- - - - - -scikit-learn = 0.22.1 = py37hd81dba3_0- - - - - -scipy = 1.4.1 = py37h0b6359f_0- - - - - -setuptools = 45.2.0 = py37_0- - - - - -simplejson = 3.17.0 = py37h7b6447c_0- - - - - -6 = 1.14.0 = py37h06a4308_0- - - - - -smmap = 3.0.4 = py_0- - - - - -sqlite = 3.35.4 = hdfb4753_02021年5月26日#(更新3.31.1維護更新)- - - - - -sqlparse = 0.4.1 = py_0- - - - - -statsmodels = 0.11.0 = py37h7b6447c_0它- - - - - -彙總= 0.8.3 = py37_0- - - - - -tk = 8.6.10 = hbc83047_02021年5月26日#(更新8.6.8維護更新)- - - - - -torchvision = 0.8.2 = py37_cu101- - - - - -龍卷風= 6.0.3 = py37h7b6447c_3- - - - - -tqdm = 4.42.1 = py_0- - - - - -traitlets = 4.3.3 = py37_0- - - - - -typing_extensions = 3.7.4.3 = py_0- - - - - -unixodbc = 2.3.7 = h14c3975_0- - - - - -urllib3 = 1.25.8 = py37_0- - - - - -wcwidth = 0.1.8 = py_0- - - - - -websocket-client = 0.56.0 = py37_0- - - - - -werkzeug = 1.0.0 = py_0- - - - - -輪= 0.34.2 = py37_0- - - - - -打包= 1.11.2 = py37h7b6447c_0- - - - - -xz = 5.2.5 = h7b6447c_02021年5月26日#(更新5.2.4維護更新)- - - - - -zeromq = 4.3.1 = he6710b0_3- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -zstd = 1.3.7 = h0b5b093_0- - - - - -皮普:- - - - - -astunparse = = 1.6.3- - - - - -azure-core = = 1.10.0- - - - - -azure-storage-blob = = 12.7.0- - - - - -databricks-cli = = 0.14.1- - - - - -diskcache = = 5.1.0- - - - - -4.4.1碼頭工人= =- - - - - -大猩猩= = 0.3.0- - - - - -horovod = = 0.20.3- - - - - -joblibspark = = 0.3.0- - - - - -keras-preprocessing = = 1.1.2- - - - - -考拉= = 1.5.0- - - - - -mleap = = 0.16.1- - - - - -mlflow = = 1.13.1- - - - - -msr = = 0.6.19- - - - - -opt-einsum = = 3.3.0- - - - - -petastorm = = 0.9.7- - - - - -pyarrow = = 1.0.1- - - - - -pyyaml = = 5.4- - - - - -querystring-parser = = 4- - - - - -seaborn = = 0.10.0- - - - - -spark-tensorflow-distributor = = 0.1.0- - - - - -tensorboard = = tripwire- - - - - -tensorboard-plugin-wit = = 1.8.0- - - - - -tensorflow = = 2.3.1- - - - - -tensorflow-estimator = = tripwire- - - - - -termcolor = = 1.1.0- - - - - -xgboost = = 1.3.1前綴:/磚/ conda / env / databricks-ml-gpu

引發包包含Python模塊

火花包

Python模塊

版本

graphframes

graphframes

0.8.1-db1-spark3.0

R庫

R庫的完全相同R庫在磚7.6運行時。

Java和Scala庫(Scala 2.12集群)

除了Java和Scala庫磚7.6運行時,磚運行時7.6毫升包含以下jar:

CPU集群

組ID

工件ID

版本

com.typesafe.akka

akka-actor_2.12

2.5.23

ml.combust.mleap

mleap-databricks-runtime_2.12

0.17.3-4882dc3

ml.dmlc

xgboost4j-spark_2.12

1.2.0

ml.dmlc

xgboost4j_2.12

1.2.0

org.mlflow

mlflow-client

1.13.1

org.scala-lang.modules

scala-java8-compat_2.12

0.8.0

org.tensorflow

spark-tensorflow-connector_2.12

1.15.0

GPU集群

組ID

工件ID

版本

com.typesafe.akka

akka-actor_2.12

2.5.23

ml.combust.mleap

mleap-databricks-runtime_2.12

0.17.3-4882dc3

ml.dmlc

xgboost4j-spark-gpu_2.12

1.2.0

ml.dmlc

xgboost4j-gpu_2.12

1.2.0

org.mlflow

mlflow-client

1.13.1

org.scala-lang.modules

scala-java8-compat_2.12

0.8.0

org.tensorflow

spark-tensorflow-connector_2.12

1.15.0