Senior Data Engineer (Azure/Databricks)

Hybrid | Fully Onsite for First Two Weeks; Then, Ability to Work Onsite at Rosslyn, VA or Foggy Bottom, DC for 5-8 Days a Month

Active Secret Clearance Required

Summary

Our client is an employee and Service-Disabled, Veteran-owned Small Business focused on providing niche technical services. They are a team of experienced cybersecurity professionals with a track record of success in the Federal, Commercial, and Academic workspaces. Additionally, our client designs, builds, operates, and secures scalable cloud and IT infrastructures to meet their customers’ near-term needs and fulfill their long-term requirements.

Responsibilities

Our client is seeking a Senior Data Engineer to join their team! In this role, you will lead the migration of SQL databases to the Azure cloud, defining data architecture, and collaborating closely with stakeholders to implement efficient data workflows. The ideal candidate will have deep experience with Python, SQL, Azure Data Factory, and Databricks, with a strong ability to communicate technical vision and support junior team members.

• Lead the migration of SQL Server databases to the Azure cloud environment, defining data and metadata architecture
• Collaborate with stakeholders and partners to design, develop, and implement cloud data architecture using Azure Data Factory
• Support end-to-end data integration and analysis, utilizing tools such as Python, SQL, Databricks, and Power BI
• Create and maintain Standard Operating Procedures (SOPs) and technical documentation for cloud workflows
• Provide technical mentorship to junior team members and assist with the execution of data tasks as needed
• Serve as the point of contact for project updates, managing communication and progress with stakeholders
• Develop and present technical presentations to stakeholders, translating complex technical details into accessible information
• Ensure compliance with data governance and security protocols, especially in alignment with federal requirements

Requirements

• 8+ years of total hands-on experience in data analysis, cloud architecture, and/or SQL Server database management
• 5+ years of experience in cloud migration, specifically with Azure Data Factory and Databricks
• Experience in the private sector with cloud migrations
• Experience defining cloud architecture requirements and gathering user stories for analytic product outputs
• Experience managing cloud migrations and setting milestones and timelines.
• Experience in end-to-end design, develop and implement of cloud data architecture
• Stakeholder management in a low-data maturity environment
• Experience with data governance, data security and compliance
• Providing technical mentorship to junior team members
• Developing and managing data stacks and dataflow layer using metadata
• Creating SOPs and process documentation
• Ability to work onsite at Rosslyn, VA or Foggy Bottom, DC for 5-8 days a month

Preferred Requirements

• Experience with State Department, DoD, or related security assistance data
• Knowledge of government financial data (e.g., appropriations, obligations)
• Familiarity with political-military terminology or experience in the armed forces/reserves
• Experience supporting a Chief Data Officer or Chief Analytics Officer
• Background in developing data inventories and data catalogs
• Working knowledge of AWS

Education/Certification Requirements

• A Bachelor's degree and cloud certification (e.g., AWS, Databricks) are both required

Clearance Requirements

• Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; an active Secret clearance is required. Please be aware that onboarding can take 4-6 weeks for this position.