- 5996 Views
- 2 replies
- 0 kudos
- 5996 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @joao vnb​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we c...
- 0 kudos
- 3924 Views
- 2 replies
- 0 kudos
Resolved! Table access control is deprecated in Databricks Runtime for Machine Learning
After reviewing this Deprecations, I discovered that Table Access Control is not supported in Databricks Runtime for Machine Learning.I want to understand why table access control is not designed for ML runtime. Is there any reason behind this?
- 3924 Views
- 2 replies
- 0 kudos
- 0 kudos
@Thanapat Sontayasara​ Table Access Control (TAC) is a feature in Databricks that allows you to restrict access to specific tables in your workspace based on user or group identity.According to the Databricks documentation, TAC is not supported in th...
- 0 kudos
- 2202 Views
- 2 replies
- 0 kudos
Not able to merge Databricks cluster delta tables(location Abfs) with PowerBi for analytics Purpose
Hi everyone .. i have an issue while connecting azure Databricks cluster delta tables(location Abfs) with PowerBi for analytics Purpose. but after succesfully linking cluster using Server Hostname and HTTP Path with powerbi is showing an error:-Data...
- 2202 Views
- 2 replies
- 0 kudos
- 8359 Views
- 2 replies
- 0 kudos
AttributeError: module 'pyspark.dbutils' has no attribute 'fs'
`AttributeError` when attempting to transfer files from `dbfs` filestore in DataBricks to a local directory. import pyspark.dbutils as pdbutils pdbutils.fs.cp("/dbfs/Data/file1.csv", "/Users/Downloads/") Traceback (most recent call last): ...
- 8359 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Keval Shah​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 0 kudos
- 2860 Views
- 2 replies
- 0 kudos
Need pattern for loading a million small XML files
Hi, looking for the right solution pattern for this scenario: We have millions of relatively small XML files (currently sitting in ADLS) that we have to load into delta lake. Each XML file has to be read, parsed, and pivoted before writing to a delta...
- 2860 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Steph Swierenga​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answe...
- 0 kudos
- 9439 Views
- 4 replies
- 0 kudos
Error while mounting ADLS in python using AccountKey
I'm using the below code using Account key to mount ADLS in python but running into error:shaded.databricks.org.apache.hadoop.fs.azure.AzureException: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string. Can you pleas...
- 9439 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Krish Lam​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers you...
- 0 kudos
- 4855 Views
- 6 replies
- 2 kudos
Resolved! Auto-Suggestion Completes with Return, want only Tab
How do I adjust the settings for the auto-suggestion? If I click Return, then it fills in the suggestion. If I click Tab, then it fills in the suggestion. I would really like it to only use the auto-suggestion value when I click Tab. How can I change...
- 4855 Views
- 6 replies
- 2 kudos
- 2 kudos
Hi @Dagart Allison​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
- 2 kudos
- 4506 Views
- 2 replies
- 3 kudos
Resolved! Azure Key Vault Keys client library for Python - keys list permission issue
Dear Databricks ExpertI am trying to get a key which is stored in the Azure Key Vault, using Azure Key Vault Keys client library for Python. However error was met.Python Code:#from azure.identity import DefaultAzureCredentialfrom azure.identity impor...
- 4506 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @KS LAU​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your q...
- 3 kudos
- 47284 Views
- 7 replies
- 13 kudos
Resolved! How to read data from a table into a dataframe outside of Databricks environment?
Hi, I am working on an ML project and I need to access the data in tables hosted in my Databricks cluster through a notebook that I am running locally. This has been very easy while I run the notebooks in Databricks but I cannot figure out how to do ...
- 47284 Views
- 7 replies
- 13 kudos
- 13 kudos
We can use Apis and pyodbc to achieve this. Once go through the official documentation of databricks that might be helpful to access outside of the databricks environment.
- 13 kudos
- 5413 Views
- 3 replies
- 1 kudos
Resolved! Loading data from dataframe to Azure Storage Queue/Message Queue.
Hi Experts,We do have one use case where we have batch load that create a dataframe at end and now we want to load this data at Azure Storage Queue/Message Queue so that some Rest API can read the data/messages from the queue later and process it acc...
- 5413 Views
- 3 replies
- 1 kudos
- 750 Views
- 0 replies
- 0 kudos
test
txt
- 750 Views
- 0 replies
- 0 kudos
- 6422 Views
- 4 replies
- 1 kudos
Partner session - Data Engineer Associate Course Schedule help
I have been wanting to enroll into the Data Engineer Associate Course as my co is a Databricks partner. I have been unsuccessful thusfar whenever the session has happened in North America and have always been waitlisted.1.Is there a hack to get a slo...
- 6422 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Lokesh AR​,Just a friendly follow-up. Do you still need help? Please let us know if you still need help
- 1 kudos
- 1432 Views
- 1 replies
- 0 kudos
Not ab;e to login into databricks community edition
I forgot my password and when i am trying to reset my password , it was struck at reset password page.Could you please help me with it.
- 1432 Views
- 1 replies
- 0 kudos
- 0 kudos
Adding @Vidula Khanna​ and @Kaniz Fatma​ for visibility to help with this request
- 0 kudos
- 14379 Views
- 5 replies
- 0 kudos
Databricks SQL Dashboard refresh not updating
I am trying to create a SQL Dashboard on top of a streaming dataset (Delta format). I created multiple queries referencing the file on the datalake, not a hive table. With these queries I created multiple visualizations in a Databricks SQL Dashboard....
- 14379 Views
- 5 replies
- 0 kudos
- 0 kudos
@Jasper Puts​ :Here are some potential solutions or next steps you can try:Check the query refresh rate: Confirm that the queries are also set to refresh every minute or less. If the queries are not refreshing at the same rate as the dashboard, this ...
- 0 kudos
- 10069 Views
- 5 replies
- 1 kudos
Resolved! Databricks job about spark structured streaming zero downtime deployment in terraform.
I would like to ask how to implement zero downtime deployment of spark structured streaming in databricks job compute with terraform. Because we will upgrade spark application code version. But currently we found every deployment will cancel original...
- 10069 Views
- 5 replies
- 1 kudos
- 1 kudos
@Mars Su​ :Yes, you can implement zero downtime deployment of Spark Structured Streaming in Databricks job compute using Terraform. One way to achieve this is by using Databricks' "job clusters" feature, which allows you to create a cluster specifica...
- 1 kudos
| User | Count |
|---|---|
| 1613 | |
| 771 | |
| 349 | |
| 286 | |
| 253 |
