Local instance of Databricks for development

Question

I am currently working on a small team that is developing a Databricks based solution. For now we are small enough to work off of cloud instances of Databricks. As the group grows this will not really be practical.

Is there a "local" install of Databricks that can be installed for development purposes (it doesn't need to be a scalable version but does need to be essentially fully featured)? In other words, is there a way each developer can create their own development instance of Databricks on their local machine?

Is there another way to provide a dedicated Databricks environment for each developer?

Answer 1

Unfortunately, Local instance of databricks is not available.

Only way to use Databricks is via cloud only.

Databricks is available from Microsoft and AWS.

If you want to test databricks, you can use Databricks community Edition which is free of cost. (If you getting something for free then definitely there will be some limitations).

What is the Databricks Community Edition?

The Databricks Community Edition is the free version of our cloud-based big data platform. Its users can access a micro-cluster as well as a cluster manager and notebook environment. All users can share their notebooks and host them free of charge with Databricks. We hope this will enable everyone to create new and exciting content that will benefit the entire Apache Spark™ community.

Limitation with community edition:

• Only Single cluster limited to 15 GB and only driver node & no worker nodes.
• Basic notebooks without collaboration
• Limited to 3 max users
• Public environment to share your work

For more details, Try Databricks and Databricks community Edition - FAQ