1

Azure 机器学习 python 包偶尔会在 Databricks 上返回依赖项错误。我正在使用带有azureml-sdk[databricks]PyPi 包的 Databricks 运行时 6.0（非 ML）。特别是，安装时cryptography和pyopenssl包从 2.6.1 和 19.0.0 降级到 1.5 和 16.0.0 azureml-sdk[databricks]。安装另一个具有该要求的包会pyopenssl>=18.0.0成功，就像在 Databricks 集群上单独安装cryptography==2.6.1和pyopenssl==19.0.0单独安装一样，但有时在作业期间会出现如下错误：

Failure while loading azureml_run_type_providers. Failed to load entrypoint hyperdrive = azureml.train.hyperdrive:HyperDriveRun._from_run_dto with exception (cryptography 1.5 (/databricks/python3/lib/python3.7/site-packages), Requirement.parse('cryptography>=2.3'), {'pyopenssl'}).
Failure while loading azureml_run_type_providers. Failed to load entrypoint azureml.PipelineRun = azureml.pipeline.core.run:PipelineRun._from_dto with exception (cryptography 1.5 (/databricks/python3/lib/python3.7/site-packages), Requirement.parse('cryptography>=2.3'), {'pyopenssl'}).
Failure while loading azureml_run_type_providers. Failed to load entrypoint azureml.ReusedStepRun = azureml.pipeline.core.run:StepRun._from_reused_dto with exception (cryptography 1.5 (/databricks/python3/lib/python3.7/site-packages), Requirement.parse('cryptography>=2.3'), {'pyopenssl'}).
Failure while loading azureml_run_type_providers. Failed to load entrypoint azureml.StepRun = azureml.pipeline.core.run:StepRun._from_dto with exception (cryptography 1.5 (/databricks/python3/lib/python3.7/site-packages), Requirement.parse('cryptography>=2.3'), {'pyopenssl'}).
Failure while loading azureml_run_type_providers. Failed to load entrypoint azureml.scriptrun = azureml.core.script_run:ScriptRun._from_run_dto with exception (cryptography 1.5 (/databricks/python3/lib/python3.7/site-packages), Requirement.parse('cryptography>=2.3'), {'pyopenssl'}).
From cffi callback <function _verify_callback at 0x7f587ef90268>:
Traceback (most recent call last):
  File "/databricks/python/lib/python3.7/site-packages/OpenSSL/SSL.py", line 309, in wrapper
    _lib.X509_up_ref(x509)
AttributeError: module 'lib' has no attribute 'X509_up_ref'
From cffi callback <function _verify_callback at 0x7f587ef90d08>:
Traceback (most recent call last):
  File "/databricks/python/lib/python3.7/site-packages/OpenSSL/SSL.py", line 309, in wrapper
    _lib.X509_up_ref(x509)
AttributeError: module 'lib' has no attribute 'X509_up_ref'
From cffi callback <function _verify_callback at 0x7f587dc1d950>:
Traceback (most recent call last):
  File "/databricks/python/lib/python3.7/site-packages/OpenSSL/SSL.py", line 309, in wrapper
    _lib.X509_up_ref(x509)
AttributeError: module 'lib' has no attribute 'X509_up_ref'
From cffi callback <function _verify_callback at 0x7f587dc25268>:
Traceback (most recent call last):
  File "/databricks/python/lib/python3.7/site-packages/OpenSSL/SSL.py", line 309, in wrapper
    _lib.X509_up_ref(x509)
AttributeError: module 'lib' has no attribute 'X509_up_ref'

SSLError: HTTPSConnectionPool(host='southcentralus.experiments.azureml.net', port=443): Max retries exceeded with url: /discovery (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')])")))

并非每次运行作业时都会发生这种情况。我尝试切换安装软件包的顺序，但它仍然间歇性地发生。是否有理由azureml-sdk[databricks]需要一个更低版本的cryptography和pyopenssl比没有它的集群，或者有azureml-sdk？我能做些什么来确保所有依赖项都得到满足？

4

0 回答 0