[Remote] Databricks Engineer (Databricks / Qlik / Python) | Active Secret Clearance Required
Note: The job is a remote job and is open to candidates in USA. Loch Harbour Group is seeking a Senior Databricks Engineer to support a high-visibility, mission-critical environment within the Navy. This role involves leading the end-to-end solution lifecycle, translating ambiguous requirements into fully deployed solutions, and collaborating with government stakeholders and technical teams in a fast-paced Agile environment.
Responsibilities
- Lead the end-to-end solution lifecycle:
- Facilitate requirements definition in ambiguous environments
- Translate business needs into technical designs
- Develop, test, deploy, and validate solutions with end users
- Serve as the primary bridge between stakeholders and technical teams, ensuring alignment between customer needs and delivered capabilities
- Design and implement data-driven solutions leveraging Databricks, Qlik, Python, and SQL
- Perform data validation, integrity assessment, and troubleshooting, particularly within replicated environments (e.g., Navy ERP data in Jupiter)
- Develop and maintain data pipelines, data models, and analytics solutions across data lakes and data cubes
- Conduct risk assessments and mitigation planning for data, systems, and solution delivery
- Work in a rapid Agile delivery model, supporting mission-critical needs with tight timelines
- Collaborate with:
- Jira/Atlassian administrators
- Data scientists and visualization teams
- Government stakeholders and functional users
- Support front-end solution development using Qlik, enabling downstream dashboarding and analytics
- Ensure delivered solutions meet performance, usability, and mission requirement
Skills
- 10+ years of experience in data engineering, software development, or solution architecture
- Active Secret Clearance
- Demonstrated experience leading end-to-end solution delivery from requirements through deployment
- Expert-level proficiency (non-negotiable): Databricks
- Expert-level proficiency (non-negotiable): Qlik (Qlik Sense / QlikView)
- Expert-level proficiency (non-negotiable): Python
- Expert-level proficiency (non-negotiable): SQL
- Strong experience with: Data lakes and/or data cubes
- Strong experience with: Data modeling and transformation
- Strong experience with: Data validation and integrity analysis
- Strong experience with: Power BI
- Strong experience with: PowerShell
- Proven ability to: Operate in highly ambiguous environments
- Proven ability to: Define requirements where none are clearly stated
- Proven ability to: Work independently with minimal oversight
- Proven ability to: Lead technical efforts without formal authority
- Strong analytical and troubleshooting skills, particularly with complex or conflicting data
- Excellent communication skills, with the ability to interface directly with government stakeholders
- Experience working in Agile / rapid development environments
- Experience with: Navy ERP or similar financial systems
- Experience with: Replicated or synthetic data environments (e.g., Jupiter or similar)
- Experience integrating with: Jira / Atlassian ecosystems
- Familiarity with: Federal or DoD environments
- Familiarity with: Data governance and compliance standards
- Relevant certifications (preferred, not required): Databricks certification
- Relevant certifications (preferred, not required): Agile /Scrum certifications
- Relevant certifications (preferred, not required): Data engineering or cloud certifications
Benefits
- Competitive salaries
- Paid time off
- Health, dental and vision insurance
- Company paid short/long term disability
- Company paid Life and Accidental Death & Dismemberment insurance
- 401(k) (up to 5% matching)
- Flexible Spending Accounts (FSA)
- Other company perks
- Government-furnished equipment provided
Company Overview