Summary
The DataBricks Developer is responsible for designing, implementing, and managing Big Data solutions using DataBricks platform. The role involves data ingestion, transformation, and visualization to drive insights and support decision-making.
Responsibilities
Develop and maintain DataBricks notebooks for data transformations and analysis,
Implement ETL pipelines,
Optimize data storage and query performance,
Collaborate with Data Scientists and Data Analysts,
Ensure data security and compliance,
Document code and data architecture.
Qualifications and Requirements
Bachelor’s degree in Computer Science, Engineering, or related field,
Minimum 3 years of experience in Data Engineering,
Proficient in SQL and at least one programming language like Python or Scala,
Experience with Big Data technologies like Spark,
Familiarity with cloud platforms such as Azure or AWS,
Certification in DataBricks is a plus.