Job Summary
We are seeking a highly skilled and motivated Sr. Data Engineer to join our dynamic team. The ideal candidate will have extensive experience developing on Databricks with a dbt transformation layer.
Duties
• Work in all areas of Databricks including ingestion, transformations and data modeling within Azure Databricks.
• Create silver (transformation) and gold (mart) layer models using dbt on Databricks.
• Develop models in conformance with industry and customer standards
• Perform testing/QA on models to ensure accuracy and performance
• Work within the customer's CI/CD framework
• Troubleshoot complex technical issues and provide effective solutions.
• Document processes, technical specifications, and project updates for internal use.
• Support the finance and marketing teams or others as assigned.
• Migrate existing data sets from legacy systems into Databricks.
Experience
• Strong SQL, dbt and databricks skills
• 3+ Years of strong dbt experience including dbt core, dbt elementary, dbt loom
• Extensive experience calling REST APIs including performance tuning, pagination etc.
• Excellent problem-solving skills with a keen attention to detail.
• Strong interpersonal skills with the ability to communicate complex ideas clearly to diverse audiences.
• Experience being the key contributor/SME for a specific data set and reporting area
• Proven experience in a technical leadership role within the field of Data Analytics, Data Warehousing with a focus in dbt, Databricks and Power BI
• 6+ Years of Databricks/PySpark experience
• 10+ Years of software development with proficiency in SQL, Python, PySpark, GITHUB, VS Code
• A degree in Computer Science, Engineering, or a related field is preferred.
Type of Role: Contract
Duration: 6 Months + possibility of extension
Pay: $70.00 - $80.00 per hour
Application Question(s):
• REST API programming
Experience:
• Python: 6 years (Required)
• SQL: 6 years (Required)
• Data analytics: 10 years (Required)
• dbt - Data Build Tool: 3 years (Required)
Work Location: Remote
Apply tot his job
Apply To this Job