政府和建築主題

磚工作空間在我們的聯接

ArjenSmedes — 結婚,2023年8月16日15:10:28格林尼治時間

我們在我們自己的設置一個磚工作區Azure聯接,其中包括一個私人端點。連接到WS沒問題(通過私有ip地址)。然而,在創建第一個集群時,我碰到這個問題: < H3 > <字體=“arial, helvetica,無襯線”大小=“4”>“ADD_NODES_FAILED < / H3 > … 未能獲得實例引導步驟從磚控製飛機。請檢查連接到實例數據磚控製飛機。 …

and then further on:

Non-authoritative answer: adb-3485221775054017.17.azuredatabricks.net canonical name = adb-3485221775054017.17.privatelink.azuredatabricks.net. adb-3485221775054017.17.privatelink.azuredatabricks.net canonical name = westeurope-c2.azuredatabricks.net. Name: westeurope-c2.azuredatabricks.net Address: 40.74.30.80."

Now, what we haven't yet done is setup an entry in our private DNS zone (we need to setup privatelink.azuredatabricks.net on our site, which will be done tomorrow morning hopefully).

Question: Is it true that the data plane is running IN our VNET and thus, when DNS has been fixed, it will pick up the right ip address and provisioning of the cluster will work?

(just so I understood the concepts properly).

Kind Regards,

Arjen

SSO Azure的Active Directory:身份驗證失敗

fradetjulien — 結婚,09年2023年8月13:16:05格林尼治時間

我有一個磚磚平台的賬戶與E2版本。Beplay体育安卓版本統一登錄不上啟用帳戶,因為它是在6月21日之前創建的,2023。 我SSO身份驗證配置賬戶,對於一個給定的工作區(分別)。兩個配置使用相同的身份提供者賬戶層麵和在工作空間的水平。身份提供者是Azure Active Directory的房客。 SSO帳戶級別配置使用OpenID連接(OIDC)協議是推薦的文檔。< A href = " https://docs.m.eheci.com/en/administration-guide/account-settings-e2/single-sign-on/azure-ad.html " target = "平等rel = " noopener " > https://docs.m.eheci.com/en/administration-guide/account-settings-e2/single-sign-on/azure-ad.html < / > SSO工作區配置使用SAML協議。< A href = " https://docs.m.eheci.com/en/administration-guide/users-groups/single-sign-on/azure-ad.html " target = "平等rel = " noopener " > https://docs.m.eheci.com/en/administration-guide/users-groups/single-sign-on/azure-ad.html < / > 允許汽車用戶創建和讓我角色權利自動同步特性不激活。 SCIM配置功能沒有被激活。我們想有一個成功的身份驗證之前激活它。 我們跟著文檔的每一步但是我們仍然收到以下錯誤消息:<強>單點登錄身份驗證失敗的< /強>。 我們驗證每一個配置值,讀故障排除的部分文檔。 https://docs.m.eheci.com/en/administration-guide/users-groups/single-sign-on/index.html#troubleshooting

I installed the SAML Tracer extension and analysed the SAML response. I seems that it is correctly signed. You can find it inside the file attached to this message.

Any help would be really appreciated,

無法登錄accounts.azuredatabricks.net和創建管理員帳戶

Olex — 星期二,2023年8月08年18:28:01格林尼治時間

Hello everyone

I'm trying to setup my admin account in Databricks Admin Console and am following these steps:
https://learn.microsoft.com/en-us/azure/databricks/administration-guide/#--what-are-account-admins

However, when I access accounts.azuredatabricks.net page, click "Sign in with Azure ID" button and select my personal account, I see the following error:

Selected user account does not exist in tenant 'Microsoft Services' and cannot access the application '2xx81xxx-x30x-xabx-x5cx-xxxe6f879xxx' in that tenant. The account needs to be added as an external user in the tenant first. Please use a different account.

I've been stuck for the second day actually and can't find any relevant information how to resolve the issue or configure my account in Azure AD.
Probably I should register an app in Azure AD? If yes, could someone point me to the documentation please.

I have a tenant in Azure AD, with a single user (which I'm trying to use for login), the user has just one role "Global Administrator".

Thanks for the help!

起程拓殖回購Git URL允許列表

paritoshsh — 星期二,2023年8月08年15:51:59格林尼治時間

你好, 我供應磚起程拓殖和想要添加特定的工作區使用github回購可以使用url。在UI是一個選擇,但當談到起程拓殖沒有具體。

I came across custom_config option here but not sure how to use this for adding github url list. Can anyone help me with this?

數據市場私人交流

•派克 — 星期二,2023年8月08年14:00:43格林尼治時間

我想用數據Markerplace但隻有私人/本地模式,所以不想發表我的組織以外的任何產品。 我知道我可以創建私人清單,但這是可以做到的隻有從提供者控製台。 我添加到市場的作用,但沒有看到該選項。

My question is , if I don't want to create only private shares, I probably still have to be registered provider at databricks ?

如何刪除或更新集群級init腳本

dbx_8451 — 媽,07年8月2023 22:14:25 GMT

我們正在反對dbfs基於集群級init腳本和用基於工作空間,因此找到一個方法來刪除dbfs集群級init腳本從所有正在運行的集群在我們的環境中使用REST API。 I couldn't not find a way to delete them using REST API, therefore reaching you out for a help.

your early response is very much appreciated.

全球搜索編程

jrosend — 媽,07年8月2023 17:11:02 GMT

你好! 在工作區頭,有一個搜索框,允許我們尋找一個文本在工作區中所有筆記本電腦。

Is there a way via CLI or API to call the global search https:///graphql/SearchGql so the result can be analysed automaticaly with a script? I couldn`t find a way in the documentation.

Right now I'm having to download all notebooks (API) to execute the search locally. The download itself takes too long (several hours) for there are thousands of notebooks across multiple workspaces. Even if i multithread, there's a limit of 30 requests per second. I also have to account for unsupported file formats and path size limitations.

So it would be best to use Databicks indexing to make this faster.

The request itself uses cookies to get the session ID and authenticate (I think) and I don't know how to reproduce it, say, in postman.

Is there a way to use a user token instead?

Thanks!

啟用自動模式演化為三角洲湖合並為一個SQL倉庫

807326年 — 媽,07年8月2023 11:44:20 GMT

你好!

We tried to update our integration scripts and use SQL warehouses instead of general compute clusters to fetch and update data, but we faced a problem. We use automatic schema evolution when we merge tables, but with SQL warehouse, when we try to enable it before running a merge query (set spark.databricks.delta.schema.autoMerge.enabled = true), we get an error:

databricks.sql.exc.DatabaseError: Error running query: [_LEGACY_ERROR_TEMP_DBR_0222] org.apache.spark.sql.AnalysisException: Configuration spark.databricks.delta.schema.autoMerge.enabled is not available.

Is there any way to enable automatic schema evolution for Delta Lake merge for an SQL warehouse?

將磚賬戶管理角色分配給用戶組

NadithK — 媽,07年8月2023 08:09:54 GMT

我現在的組織,我們有一些用戶提供磚賬戶管理角色分配。但是根據我們公司的政策,個人用戶不應該被給予如此高的特權。他們應該給用戶組,用戶在這些組可以在廣告管理水平。 在這個意義上,是否有辦法將磚賬戶管理的角色分配給一個用戶組,而不是個人用戶。 我們目前使用Azure廣告和它與磚同步使用SCIM。 感謝

REST API的工作區與查詢內容不工作列表

Xyguo — 太陽,06年2023年8月15:28:54格林尼治時間

Hi,

I'm trying to export the SQL Queries in certain folders in workspace, but the list content API call

GET /api/2.0/workspace/list doesnt work with queries? how should I export only queries in a certain folder in workspace?

Thank you very much

磚運行時的JDK 17升級

奧林克 — 星期四,2023年8月3日17:56:28格林尼治時間

Hey

I'm using Databricks Runtime 13.2 https://docs.m.eheci.com/en/release-notes/runtime/13.2.html#system-environment

It uses JDK 8.

Question: Is it possible to upgrade the Java version to JDK 17?

Thanks!

磚提高工作與時間閾值監控工作流

Hubert_Dudek1 — 星期四,2023年8月3日11:51:56格林尼治時間

磚引入了工作流的時間閾值。這個新成員允許用戶為工作流執行設置時間限製,大大提高監測的工作性能。當一份工作超過預設時間,係統觸發警報,促進快速應對潛在的效率低下。 <跨類=“lia-inline-image-display-wrapper lia-image-align-inline”圖片alt = " ezgif-4-8ab9474b98。gif”風格= "寬度:999 px;< img src = " https://community.m.eheci.com/t5/image/serverpage/image-id/3051iF8DB8E992AE0EEA0/image-size/large? " >v=v2&px=999" role="button" title="ezgif-4-8ab9474b98.gif" alt="ezgif-4-8ab9474b98.gif" />

幫助需要:授予剩餘刪除組和服務主體

JoeStringer — 星期一,2023年7月31日22:01:29格林尼治時間

我們有一個問題在工作區由起程拓殖,改變進去更新組和服務主體(SP)的名字但由於內部訂單組和SP被授予前移除和替換更新。 如果我們現在試圖刪除舊的授予集團/ SP通過起程拓殖,UI或CLI,我們不能,和接收錯誤類似於說:“校長& lt; entity>無法找到“(& lt; entity>是一組名稱或SP ID) 最奇怪的事情是當清單贈款,已被刪除的組帳戶/工作區偶爾不顯示,但是幾秒鍾後返回。反複運行cli命令以獲得贈款的反複影響目錄顯示組返回和消失,這也可以在UI中。 在下麵的輸出“青銅集團”,“銀集團”,“黃金集團”和“unity_admins”已被刪除的組,與“& lt;老服務主體id>”也被刪除。 這第一個請求顯示所有組: < PRE >✦❯磚撥款獲得目錄生產 { “privilege_assignments”: [ { “本金”:“青銅組”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“青銅”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“& lt;老服務主體id>”“特權”, : [ “ALL_PRIVILEGES” ] }, { “本金”:“unity_admins”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“UnityAdmins”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“銀集團”, “特權”:[ “USE_CATALOG” ] }, { “本金”:“& lt;新服務主體id>”“特權”, : [ “ALL_PRIVILEGES” ] }, { “本金”:“黃金集團”, “特權”:[ “USE_CATALOG” ] } ] } < / PRE > ,這下一個幾秒鍾後返回,但沒有“青銅集團”或“銀集團” < PRE >✦❯磚撥款獲得目錄生產 { “privilege_assignments”: [ { “本金”:“青銅”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“& lt;老服務主體id>”“特權”, : [ “ALL_PRIVILEGES” ] }, { “本金”:“unity_admins”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“UnityAdmins”, “特權”:[ “ALL_PRIVILEGES” ] }, { “本金”:“& lt;新服務主體id>”“特權”, : [ “ALL_PRIVILEGES” ] }, { “本金”:“黃金集團”, “特權”:[ “USE_CATALOG” ] } ] } < / PRE > 我試著重建組在相同的名稱,但是我無法把他們從賬戶工作區與類似的錯誤(“未能添加組:主要與id & lt;組id>不存在”),這似乎是相同的底層問題,在工作區中存在某種形式的內部狀態,無法清理/刪除引用舊的組織和服務主體。 (我們目前無法提高磚的支持請求在這個時候,我們已經在這裏建議提高並等待下一個可用的辦公時間) 任何支持讚賞!喬

在資源組管理多個孤兒vm啟動和終止我個人的集群

milicevica — 星期一,2023年7月31日17:03:56格林尼治時間

你好,今天,我已經開始集群的問題,因此我做了多次明星和終止。問題是,這種行為總是啟動一個新的虛擬機資源組管理但不關掉它。因此我最終與多個孤兒VM,我不能阻止或刪除。

Is there a ways to stop those machines? Does somebody have the same problem?

Br,

Aleksandar

多銅層:多客戶數據

vasu2 — 星期五,2023年7月28日05:55:32格林尼治時間

來自多個數據源的數據屬於多個客戶。beplay体育app下载地址 我應該創建單一存儲帳戶名青銅然後單獨為每個客戶的數據容器。 然後銀層中的數據合並。在這種情況下有什麼最好的架構。謝謝。

無法訪問帳戶管理控製台

助教 — 星期四,2023年7月27日15:13:25格林尼治時間

你好! 我有問題,登錄到管理控製台。 單擊管理帳戶按鈕後,我花了工作區選擇窗口,選擇其中任何一個之後,我的工作區中打開了。 第一次登錄是由Acitve目錄全球管理員和帳戶管理控製台設置我的賬戶。可能是什麼問題?

INVALID_PARAMETER_VALUE。LOCATION_OVERLAP:重疊與S3存儲管理錯誤路徑

shawnbarrick — 星期二,2023年7月25日12:23:08格林尼治時間

我們試圖讀取一個S3 bucket使用統一目錄和選擇性得到“ INVALID_PARAMETER_VALUE。LOCATION_OVERLAP: overlaps with managed storage error" errors within the same bucket.

This works:

"dbutils.fs.ls("s3://BUCKETNAME/dev/health")"

But within the same bucket we get the location overlap error when running: "dbutils.fs.ls("s3://BUCKETNAME/dev/claims/")"

I reviewed the article https://kb.m.eheci.com/en_US/unity-catalog/invalid_parameter_valuelocation_overlap-overlaps-with-managed-storage-error, but it's unclear to me why one path works. Is there something I should check other than IAM permissions for the bucket in question?

不能使用起程拓殖設置賬戶管理

niklas — 星期二,2023年7月25日12:14:30格林尼治時間

我想設置的賬戶管理服務主體為了創建統一目錄metastore。The Terraform code looks like this:

data "databricks_service_principal" "application" { count = var.environment == "dev" ? 1 : 0 application_id = "00000000-0000-0000-0000-000000000000" } resource "databricks_service_principal_role" "account_admin" { count = var.environment == "dev" ? 1 : 0 service_principal_id = data.databricks_service_principal.application[0].id role = "account_admin" }

This should theoretically work according to the answers in this thread.

But unfortunately I get following error from Terraform for the resource "databricks_service_principal_role": Error: cannot read service principal role: Service Principal has no role

For me this error message is not very useful and I don't know what is wrong here. Is this maybe a bug in the Databricks Terraform provider?

Site notes (if relevant):

I'm using the newest Databricks Terraform provider (V 1.21)
The Databricks workspace is deployed in Azure.
Using the "databrick_user_role" resource and trying to assign the account_admin role to a Databricks user will produce the same error message: User has no role

Looking at the source code on GitHub (Databricks Terraform provider) I found the error message from above but I don't understand why the "ReadContext" section in there is even executed.

It would be really nice if someone can help me, as I have to enable the Unity Catalog metastore very soon

禁用有害命令在磚集群/工作空間的水平

PallaviVetal — 星期四,2023年7月20 11:41:38格林尼治時間

你好, 我想阻止用戶執行命令像dbutils.fs有害。rm在集群級別/工作空間的水平。 在磚我們能做這個嗎?有任何類/ api,我們可以覆蓋嗎?

AWS S3對象鎖的時間表

timlopez — 星期二,2023年7月18日21:46:03格林尼治時間

Hello,

I see that Object Lock is not currently supported by Databricks:

https://kb.m.eheci.com/en_US/delta/object-lock-error-write-delta-s3

Is there any timeline / roadmap for the support of this feature?