[Remote] Data Engineer - Databricks
Note: The job is a remote job and is open to candidates in USA. Dexian is a leading technology and professional staffing company with a global presence. They are seeking a Junior Data Engineer to focus on Databricks development and assist in migrating legacy data warehouses to a modern cloud architecture.
Responsibilities
- Support migration and transition of existing ETL pipelines into Databricks environments
- Develop, maintain, and optimize data engineering workflows primarily using Databricks (PySpark, SQL, Python)
- Assist with the adaptation and creation of dashboards using Power BI and potentially Power Apps
- Participate in ongoing efforts to decommission legacy systems, including Tableau dashboards (experience with Tableau is a plus but not critical)
- Collaborate with cross-functional teams to ensure smooth data governance and change data capture processes
- Support AI and machine learning pipelines as needed, although the main focus is on data engineering, not data science
- Engage in technical discussions relating to data governance, data quality, and pipeline management
Skills
- 1-2 years experience in a data engineering role (junior level preferred)
- Strong proficiency with Databricks, including working knowledge of PySpark, Python, and SQL
- Experience with Power BI or Power Apps development or support
- Familiarity with cloud environments, preferably Microsoft Azure, especially Databricks service on Azure
- Understanding and experience with ETL pipelines and data migration tasks
- Willingness and ability to engage in discussions around data governance and change data capture techniques
- Good communication skills with ability to discuss past projects in an interview setting
- US citizenship required due to clearance requirements
- Experience with Tableau, especially in a legacy or transitional capacity
- Familiarity with AI/ML pipelines (e.g., ML Flow) is a bonus but not mandatory
- Exposure to data governance frameworks or compliance standards
Company Overview