Databricks

About The Client

Databricks is an enterprise software company founded by the creators of Apache Spark. They are based in San Francisco, California, and specialize in offering big data solutions that combine data warehouses & data lakes into a lakehouse architecture. Seamless collaboration and ease of use are key features of their platform, as well as powerful analytics and enterprise-level scaling.

In December 2021, I joined one of their core teams as a Freelance Software Engineer. My goals were to extend and build features for their SQL editors and visualization library, write tests, and improve overall code quality.

Technical Details

Databricks' platform is powered by React, Next.js, and TypeScript. After the acquisition of Hue and Redash, they wanted to marry both projects together. Hue offered much better autocompletion, syntax highlighting, and other features for writing SQL queries. Unfortunately, the Hue editor was developed as a Vue.js project; hence, an easy integration into the existing infrastructure was impossible. 

During my time there, I was tasked with making the Hue editor compatible and ready to integrate into the codebase by performing necessary refactorings. After weeks of looking for a suitable solution, we ended up compiling the editor into a generic web component via Vue's APIs. With that done, integrating the editor into the platform was simple and laid the groundwork for a later transition.

Tests were written in Jest and Cypress, ensuring that the integration worked as expected.