磚運行時為6.2毫升(不支持)

磚在2019年12月發布了這張照片。

磚6.2運行時機器學習為機器學習和數據提供了一個準備好了環境科學的基礎上磚運行時的6.2(不支持)。磚運行時毫升含有許多流行的機器學習庫,包括TensorFlow PyTorch Keras, XGBoost。它還支持使用Horovod分布深度學習培訓。

更多信息,包括指令創建磚集群運行時毫升、明白了磚運行時機器學習

新功能

磚磚的運行時6.2毫升之上6.2運行時。有什麼新信息的磚6.2運行時,看到的磚運行時的6.2(不支持)發行說明。

改進

升級機器學習庫

  • TensorFlow TensorBoard: 1.14.0 1.15.0。有兩個已知問題:

    • 你可能需要進口tensorflow模塊明確函數來避免PySpark酸洗問題,HorovodRunner HyperOpt和其他機器學習庫。

    • 投影機在TensorBoard是空白標簽。作為一個解決方案,直接訪問投影機頁麵,你可以替換#投影儀在URL中,數據/插件/投影儀/ projector_binary.html

  • 2.2.5 Keras: 2.2.4)。

    請注意

    如果你使用Keras TensorFlow端,磚推薦使用tf.keras代替。

  • 1.3.0 PyTorch: 1.2.0版本。

  • tensorboardX: 1.8至1.9。

    請注意

    因為現在PyTorch正式支持TensorBoard,我們將刪除tensorboardX下一個主要版本。

  • 1.3.0 MLflow:版本1.4.0。

    • Keras和TensorFlow autologging和Keras模型持久性api兼容TensorFlow 2.0。

    • get_run,get_experiment,get_experiment_by_name功能

  • 與磚Hyperopt: 0.2 db1 MLflow集成。

  • mleap-databricks-runtime 0.15.0和包括mleap-xgboost-runtime。

支持廣播變量SparkTrials補充道

不能使用以前,Hyperopt SparkTrials PySpark廣播變量。現在,廣播變量可以包含在功能fn傳遞給fmin ()

的用法

除了與磚6.2運行時,下麵的包是棄用和將被刪除的下一個主要版本:

  • TensorFrames。使用熊貓UDF代替。

  • 幾個模塊和類在Python包sparkdl。主要的是:

    • sparkdl.HorovodEstimator。使用sparkdl.HorovodRunner代替。

    • sparkdl.graph。使用一個熊貓UDF代替。

    • sparkdl.udf。使用一個熊貓UDF代替。

    • 《變形金剛》,估計用於火花毫升管道被棄用。使用以下選擇:

      • 使用一個熊貓UDF作為一個替代以下變壓器:

        • TFImageTransformer

        • TFTransformer

        • DeepImagePredictor

        • DeepImageFeaturizer

        • KerasImageFileTransformer

        • KerasTransformer

      • KerasImageFileEstimator:對於優化深度學習模型,使用Hyperopt代替。

更多細節和建議的替代方案,看看棄用消息當你使用這些包在一個筆記本上。

錯誤修複

在磚Community Edition, PySpark工人現在可以找到預裝包的火花。

係統環境

磚的係統環境運行時6.2毫升不同於磚運行時的6.2如下:

  • DBUtils:不包含庫工具(dbutils.library)

  • GPU集群,下麵的NVIDIA GPU庫:

    • NVIDIA驅動418.40

    • CUDA 10.0

    • cuDNN 7.6.4

    • NCCL 2.4.7

下麵的章節列表庫包含在磚運行時的6.2毫升,不同於那些包含在磚6.2運行時。

Python庫

磚運行時6.2毫升使用Conda Python包管理,包括許多流行毫升包。以下部分描述了Conda磚運行時環境6.2毫升。

Python對CPU的集群

的名字:databricks-ml渠道:- - - - - -- - - - - -pytorch- - - - - -違約依賴關係:- - - - - -_libgcc_mutex = 0.1 =主要- - - - - -_py-xgboost-mutex = 2.0 = cpu_0- - - - - -_tflow_select = tripwire = mkl- - - - - -absl-py = 0.8.1 = py37_0- - - - - -asn1crypto = 0.24.0 = py37_0- - - - - -阿斯特= 0.8.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -補丁= 1.0 = py_2- - - - - -bcrypt = 3.1.7 = py37h7b6447c_0- - - - - -布拉斯特區= 1.0 = mkl- - - - - -寶途= 2.49.0 = py37_0- - - - - -boto3 = 1.9.162 = py_0- - - - - -botocore = 1.12.163 = py_0- - - - - -c-ares = 1.15.0 = h7b6447c_1001- - - - - -ca證書= 2019.1.23 = 0- - - - - -certifi = 2019.3.9 = py37_0- - - - - -cffi = 1.12.2 = py37h2e261b9_1- - - - - -chardet = 3.0.4 = py37_1003- - - - - -單擊= 7.0 = py_0- - - - - -cloudpickle = 0.8.0 = py37_0- - - - - -彩色光= 0.4.1 = py_0- - - - - -configparser = 3.7.4 = py37_0- - - - - -cpuonly = 1.0 = 0- - - - - -密碼= 2.6.1 = py37h1ba5d50_0- - - - - -周期計= 0.10.0 = py37_0- - - - - -cython = 0.29.6 = py37he6710b0_0- - - - - -decorator = 4.4.0 = py37_1- - - - - -docutils = 0.14 = py37_0- - - - - -entrypoints = 0.3 = py37_0- - - - - -et_xmlfile = 1.0.1 = py37_0- - - - - -瓶1.0.2 = = py37_1- - - - - -freetype的= 2.9.1 = h8a8886c_1- - - - - -未來= 0.17.1 = py37_0- - - - - -恐嚇= 0.2.2 = py37_0- - - - - -gitdb2 = 2.0.6 = py_0- - - - - -gitpython = 2.1.11 = py37_0- - - - - -google-pasta = 0.1.8 = py_0- - - - - -grpcio = 1.16.1 = py37hf8bcb03_1- - - - - -gunicorn = 19.9.0 = py37_0- - - - - -h5py = 2.9.0 = py37h7918eee_0- - - - - -hdf5 = 1.10.4 = hb1b8bf9_0- - - - - -html5lib = 1.0.1 = py_0- - - - - -icu = 58.2 = h9c2bf20_1- - - - - -idna = 2.8 = py37_0- - - - - -intel-openmp = 2019.3 = 199- - - - - -ipython = 7.4.0 = py37h39e3cac_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -itsdangerous = 1.1.0 = py_0- - - - - -jdcal = 1.4 = py37_0- - - - - -絕地= 0.13.3 = py37_0- - - - - -jinja2 = 2.10 = py37_0- - - - - -jmespath = 0.9.4 = py_0- - - - - -jpeg = 9 b = h024ee3a_2- - - - - -keras-applications = 1.0.8 = py_0- - - - - -keras-preprocessing = 1.1.0 = py_1- - - - - -kiwisolver = 1.0.1 = py37hf484d3e_0- - - - - -krb5 = 1.16.1 = h173b8e3_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 8.2.0 = hdf63c60_1- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libpng = 1.6.36 = hbc83047_0- - - - - -libpq = 11.2 = h20c2e04_0- - - - - -libprotobuf = 3.9.2 = hd408876_0- - - - - -libsodium = 1.0.16 = h1bed415_0- - - - - -libstdcxx-ng = 8.2.0 = hdf63c60_1- - - - - -libtiff = 4.0.10 = h2733197_2- - - - - -libxgboost = 0.90 = he6710b0_1- - - - - -libxml2 = 2.9.9 = hea5a465_1- - - - - -libxslt = 1.1.33 = h7d1a2b0_0- - - - - -llvmlite = 0.28.0 = py37hd408876_0- - - - - -lxml = 4.3.2 = py37hefd8a0e_0- - - - - -尖吻鯖鯊= 1.0.10 = py_0- - - - - -減價= 3.1.1 = py37_0- - - - - -markupsafe = 1.1.1 = py37h7b6447c_0- - - - - -mkl = 2019.3 = 199- - - - - -mkl_fft = 1.0.10 = py37ha843d7b_0- - - - - -1.0.2 mkl_random = = py37hd81dba3_0- - - - - -ncurses = 6.1 = he6710b0_1- - - - - -networkx = 2.2 = py37_1- - - - - -忍者= 1.9.0 = py37hfd86e86_0- - - - - -鼻子= 1.3.7 = py37_2- - - - - -numba = 0.43.1 = py37h962f231_0- - - - - -numpy = 1.16.2 = py37h7e9f1db_0- - - - - -numpy-base = 1.16.2 = py37hde5b4d6_0- - - - - -olefile = 0.46 = py_0- - - - - -openpyxl = 2.6.1 = py37_1- - - - - -openssl = 1.1.1b = h7b6447c_1- - - - - -opt_einsum = 3.1.0 = py_0- - - - - -熊貓= 0.24.2 = py37he6710b0_0- - - - - -paramiko = 2.4.2 = py37_0- - - - - -parso = 0.3.4 = py37_0- - - - - -pathlib2 = 2.3.3 = py37_0- - - - - -容易受騙的人= 0.5.1 = py37_0- - - - - -pexpect = 4.6.0 = py37_0- - - - - -pickleshare = 0.7.5 = py37_0- - - - - -枕頭= 5.4.1之前= py37h34e0f95_0- - - - - -皮普= 19.0.3 = py37_0- - - - - -厚度= 3.11 = py37_0- - - - - -prompt_toolkit = 2.0.9 = py37_0- - - - - -protobuf = 3.9.2 = py37he6710b0_0- - - - - -psutil = 5.6.1 = py37h7b6447c_0- - - - - -psycopg2 = 2.7.6.1 = py37h1ba5d50_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -py-xgboost = 0.90 = py37he6710b0_1- - - - - -py-xgboost-cpu = 0.90 = py37_1- - - - - -pyasn1 = 0.4.8 = py_0- - - - - -pycparser = 2.19 = py_0- - - - - -pygments = 2.3.1 = py37_0- - - - - -pymongo = 3.8.0 = py37he6710b0_1- - - - - -= py37h7b6447c_0 1.3.0 pynacl =版本- - - - - -pyopenssl = 19.0.0 = py37_0- - - - - -pyparsing = 2.3.1 = py37_0- - - - - -pysocks = 1.6.8 = py37_0- - - - - -python = 3.7.3 = h0371630_0- - - - - -python-dateutil = 2.8.0 = py37_0- - - - - -python編輯器的1.0.4 = = py_0- - - - - -= py3.7_cpu_0 1.3.0 pytorch =版本- - - - - -pytz = 2018.9 = py37_0- - - - - -pyyaml = 5.1 = py37h7b6447c_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -= 2.21.0 = py37_0請求- - - - - -s3transfer = 0.2.1 = py37_0- - - - - -scikit-learn = 0.20.3 = py37hd81dba3_0- - - - - -scipy = 1.2.1 = py37h7c811a0_0- - - - - -setuptools = 40.8.0 = py37_0- - - - - -simplejson = 3.16.0 = py37h14c3975_0- - - - - -singledispatch = 3.4.0.3 = py37_0- - - - - -6 = 1.12.0 = py37_0- - - - - -smmap2 = 2.0.5 = py_0- - - - - -sqlite = 3.27.2 = h7b6447c_0- - - - - -sqlparse = 0.3.0 = py_0- - - - - -statsmodels = 0.9.0 = py37h035aef0_0- - - - - -彙總= 0.8.3 = py37_0- - - - - -db2 = pyhb230dea_0 tensorboard = 1.15.0 +- - - - - -db2 = mkl_py37hc5fbf04_0 tensorflow = 1.15.0 +- - - - - -db2 = mkl_py37h2ae1e84_0 tensorflow-base = 1.15.0 +- - - - - -db2 = pyh2649769_0 tensorflow-estimator = 1.15.1 +- - - - - -db2 = h4fcabd2_0 tensorflow-mkl = 1.15.0 +- - - - - -termcolor = 1.1.0 = py37_1- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -torchvision = 0.4.1 = py37_cpu- - - - - -tqdm = 4.31.1 = py37_1- - - - - -traitlets = 4.3.2 = py37_0- - - - - -urllib3 = 1.24.1 = py37_0- - - - - -virtualenv = 16.0.0 = py37_0- - - - - -wcwidth = 0.1.7 = py37_0- - - - - -webencodings = 0.5.1 = py37_1- - - - - -websocket-client = 0.56.0 = py37_0- - - - - -werkzeug = 0.14.1 = py37_0- - - - - -輪= 0.33.1 = py37_0- - - - - -打包= 1.11.1 = py37h7b6447c_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -yaml = 0.1.7 = had09818_2- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -zstd = 1.3.7 = h0b5b093_0- - - - - -皮普:- - - - - -argparse = = 1.4.0- - - - - -databricks-cli = = 0.9.1- - - - - -棄用= = 1.2.7- - - - - -碼頭工人= = 4.1.0- - - - - -fusepy = = 2.0.4- - - - - -大猩猩= = 0.3.0- - - - - -horovod = = 0.18.2- - - - - -hyperopt = = 0.2.1.db1- - - - - -2.2.5 keras = =)- - - - - -matplotlib = = 3.0.3- - - - - -mleap = = 0.8.1- - - - - -mlflow = = 1.4.0- - - - - -nose-exclude = = 0.5.0- - - - - -pyarrow = = 0.13.0- - - - - -querystring-parser = = 4- - - - - -seaborn = = 0.9.0- - - - - -tensorboardx = = 1.9前綴:/磚/ conda / env / databricks-ml

Python在GPU集群

的名字:databricks-ml-gpu渠道:- - - - - -- - - - - -pytorch- - - - - -違約依賴關係:- - - - - -_libgcc_mutex = 0.1 =主要- - - - - -_py-xgboost-mutex = 1.0 = gpu_0- - - - - -_tflow_select = 2.1.0 = gpu- - - - - -absl-py = 0.8.1 = py37_0- - - - - -asn1crypto = 0.24.0 = py37_0- - - - - -阿斯特= 0.8.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -補丁= 1.0 = py_2- - - - - -bcrypt = 3.1.7 = py37h7b6447c_0- - - - - -布拉斯特區= 1.0 = mkl- - - - - -寶途= 2.49.0 = py37_0- - - - - -boto3 = 1.9.162 = py_0- - - - - -botocore = 1.12.163 = py_0- - - - - -c-ares = 1.15.0 = h7b6447c_1001- - - - - -ca證書= 2019.1.23 = 0- - - - - -certifi = 2019.3.9 = py37_0- - - - - -cffi = 1.12.2 = py37h2e261b9_1- - - - - -chardet = 3.0.4 = py37_1003- - - - - -單擊= 7.0 = py_0- - - - - -cloudpickle = 0.8.0 = py37_0- - - - - -彩色光= 0.4.1 = py_0- - - - - -configparser = 3.7.4 = py37_0- - - - - -密碼= 2.6.1 = py37h1ba5d50_0- - - - - -cudatoolkit = 10.0.130 = 0- - - - - -cudnn = 7.6.4 = cuda10.0_0- - - - - -cupti = 10.0.130 = 0- - - - - -周期計= 0.10.0 = py37_0- - - - - -cython = 0.29.6 = py37he6710b0_0- - - - - -decorator = 4.4.0 = py37_1- - - - - -docutils = 0.14 = py37_0- - - - - -entrypoints = 0.3 = py37_0- - - - - -et_xmlfile = 1.0.1 = py37_0- - - - - -瓶1.0.2 = = py37_1- - - - - -freetype的= 2.9.1 = h8a8886c_1- - - - - -未來= 0.17.1 = py37_0- - - - - -恐嚇= 0.2.2 = py37_0- - - - - -gitdb2 = 2.0.6 = py_0- - - - - -gitpython = 2.1.11 = py37_0- - - - - -google-pasta = 0.1.8 = py_0- - - - - -grpcio = 1.16.1 = py37hf8bcb03_1- - - - - -gunicorn = 19.9.0 = py37_0- - - - - -h5py = 2.9.0 = py37h7918eee_0- - - - - -hdf5 = 1.10.4 = hb1b8bf9_0- - - - - -html5lib = 1.0.1 = py_0- - - - - -icu = 58.2 = h9c2bf20_1- - - - - -idna = 2.8 = py37_0- - - - - -intel-openmp = 2019.3 = 199- - - - - -ipython = 7.4.0 = py37h39e3cac_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -itsdangerous = 1.1.0 = py_0- - - - - -jdcal = 1.4 = py37_0- - - - - -絕地= 0.13.3 = py37_0- - - - - -jinja2 = 2.10 = py37_0- - - - - -jmespath = 0.9.4 = py_0- - - - - -jpeg = 9 b = h024ee3a_2- - - - - -keras-applications = 1.0.8 = py_0- - - - - -keras-preprocessing = 1.1.0 = py_1- - - - - -kiwisolver = 1.0.1 = py37hf484d3e_0- - - - - -krb5 = 1.16.1 = h173b8e3_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 8.2.0 = hdf63c60_1- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libpng = 1.6.36 = hbc83047_0- - - - - -libpq = 11.2 = h20c2e04_0- - - - - -libprotobuf = 3.9.2 = hd408876_0- - - - - -libsodium = 1.0.16 = h1bed415_0- - - - - -libstdcxx-ng = 8.2.0 = hdf63c60_1- - - - - -libtiff = 4.0.10 = h2733197_2- - - - - -libxgboost = 0.90 = h688424c_0- - - - - -libxml2 = 2.9.9 = hea5a465_1- - - - - -libxslt = 1.1.33 = h7d1a2b0_0- - - - - -llvmlite = 0.28.0 = py37hd408876_0- - - - - -lxml = 4.3.2 = py37hefd8a0e_0- - - - - -尖吻鯖鯊= 1.0.10 = py_0- - - - - -減價= 3.1.1 = py37_0- - - - - -markupsafe = 1.1.1 = py37h7b6447c_0- - - - - -mkl = 2019.3 = 199- - - - - -mkl_fft = 1.0.10 = py37ha843d7b_0- - - - - -1.0.2 mkl_random = = py37hd81dba3_0- - - - - -ncurses = 6.1 = he6710b0_1- - - - - -networkx = 2.2 = py37_1- - - - - -忍者= 1.9.0 = py37hfd86e86_0- - - - - -鼻子= 1.3.7 = py37_2- - - - - -numba = 0.43.1 = py37h962f231_0- - - - - -numpy = 1.16.2 = py37h7e9f1db_0- - - - - -numpy-base = 1.16.2 = py37hde5b4d6_0- - - - - -olefile = 0.46 = py_0- - - - - -openpyxl = 2.6.1 = py37_1- - - - - -openssl = 1.1.1b = h7b6447c_1- - - - - -opt_einsum = 3.1.0 = py_0- - - - - -熊貓= 0.24.2 = py37he6710b0_0- - - - - -paramiko = 2.4.2 = py37_0- - - - - -parso = 0.3.4 = py37_0- - - - - -pathlib2 = 2.3.3 = py37_0- - - - - -容易受騙的人= 0.5.1 = py37_0- - - - - -pexpect = 4.6.0 = py37_0- - - - - -pickleshare = 0.7.5 = py37_0- - - - - -枕頭= 5.4.1之前= py37h34e0f95_0- - - - - -皮普= 19.0.3 = py37_0- - - - - -厚度= 3.11 = py37_0- - - - - -prompt_toolkit = 2.0.9 = py37_0- - - - - -protobuf = 3.9.2 = py37he6710b0_0- - - - - -psutil = 5.6.1 = py37h7b6447c_0- - - - - -psycopg2 = 2.7.6.1 = py37h1ba5d50_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -py-xgboost = 0.90 = py37h688424c_0- - - - - -py-xgboost-gpu = 0.90 = py37h28bbb66_0- - - - - -pyasn1 = 0.4.8 = py_0- - - - - -pycparser = 2.19 = py_0- - - - - -pygments = 2.3.1 = py37_0- - - - - -pymongo = 3.8.0 = py37he6710b0_1- - - - - -= py37h7b6447c_0 1.3.0 pynacl =版本- - - - - -pyopenssl = 19.0.0 = py37_0- - - - - -pyparsing = 2.3.1 = py37_0- - - - - -pysocks = 1.6.8 = py37_0- - - - - -python = 3.7.3 = h0371630_0- - - - - -python-dateutil = 2.8.0 = py37_0- - - - - -python編輯器的1.0.4 = = py_0- - - - - -= py3.7_cuda10.0.130_cudnn7.6.3_0 1.3.0 pytorch =版本- - - - - -pytz = 2018.9 = py37_0- - - - - -pyyaml = 5.1 = py37h7b6447c_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -= 2.21.0 = py37_0請求- - - - - -s3transfer = 0.2.1 = py37_0- - - - - -scikit-learn = 0.20.3 = py37hd81dba3_0- - - - - -scipy = 1.2.1 = py37h7c811a0_0- - - - - -setuptools = 40.8.0 = py37_0- - - - - -simplejson = 3.16.0 = py37h14c3975_0- - - - - -singledispatch = 3.4.0.3 = py37_0- - - - - -6 = 1.12.0 = py37_0- - - - - -smmap2 = 2.0.5 = py_0- - - - - -sqlite = 3.27.2 = h7b6447c_0- - - - - -sqlparse = 0.3.0 = py_0- - - - - -statsmodels = 0.9.0 = py37h035aef0_0- - - - - -彙總= 0.8.3 = py37_0- - - - - -db2 = pyhb230dea_0 tensorboard = 1.15.0 +- - - - - -db2 = gpu_py37h9fd0ff8_0 tensorflow = 1.15.0 +- - - - - -db2 = gpu_py37hd56f5dd_0 tensorflow-base = 1.15.0 +- - - - - -db2 = pyh2649769_0 tensorflow-estimator = 1.15.1 +- - - - - -db2 = h0d30ee6_0 tensorflow-gpu = 1.15.0 +- - - - - -termcolor = 1.1.0 = py37_1- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -torchvision = 0.4.1 = py37_cu100- - - - - -tqdm = 4.31.1 = py37_1- - - - - -traitlets = 4.3.2 = py37_0- - - - - -urllib3 = 1.24.1 = py37_0- - - - - -virtualenv = 16.0.0 = py37_0- - - - - -wcwidth = 0.1.7 = py37_0- - - - - -webencodings = 0.5.1 = py37_1- - - - - -websocket-client = 0.56.0 = py37_0- - - - - -werkzeug = 0.14.1 = py37_0- - - - - -輪= 0.33.1 = py37_0- - - - - -打包= 1.11.1 = py37h7b6447c_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -yaml = 0.1.7 = had09818_2- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -zstd = 1.3.7 = h0b5b093_0- - - - - -皮普:- - - - - -argparse = = 1.4.0- - - - - -databricks-cli = = 0.9.1- - - - - -棄用= = 1.2.7- - - - - -碼頭工人= = 4.1.0- - - - - -fusepy = = 2.0.4- - - - - -大猩猩= = 0.3.0- - - - - -horovod = = 0.18.2- - - - - -hyperopt = = 0.2.1.db1- - - - - -2.2.5 keras = =)- - - - - -matplotlib = = 3.0.3- - - - - -mleap = = 0.8.1- - - - - -mlflow = = 1.4.0- - - - - -nose-exclude = = 0.5.0- - - - - -pyarrow = = 0.13.0- - - - - -querystring-parser = = 4- - - - - -seaborn = = 0.9.0- - - - - -tensorboardx = = 1.9前綴:/磚/ conda / env / databricks-ml-gpu

引發包包含Python模塊

火花包

Python模塊

版本

graphframes

graphframes

0.7.0-db1-spark2.4

spark-deep-learning

sparkdl

1.5.0-db12-spark2.4

tensorframes

tensorframes

0.8.2-s_2.11

R庫

R庫的完全相同R圖書館磚6.2運行時

Java和Scala庫(Scala 2.11集群)

除了Java和Scala庫磚6.2運行時,磚運行時6.2毫升包含以下jar:

組ID

工件ID

版本

com.databricks

spark-deep-learning

1.5.0-db12-spark2.4

com.typesafe.akka

akka-actor_2.11

2.3.11

ml.combust.mleap

mleap-databricks-runtime_2.11

0.15.0

ml.dmlc

xgboost4j

0.90

ml.dmlc

xgboost4j-spark

0.90

org.graphframes

graphframes_2.11

0.7.0-db1-spark2.4

org.mlflow

mlflow-client

1.4.0

org.tensorflow

libtensorflow

1.15.0

org.tensorflow

libtensorflow_jni

1.15.0

org.tensorflow

spark-tensorflow-connector_2.11

1.15.0

org.tensorflow

tensorflow

1.15.0

org.tensorframes

tensorframes

0.8.2-s_2.11