Overview
LMI is seeking a skilled Data Engineer to design, develop, test, and enhance data pipelines and database architectures. This role will also involve implementing a robust test and evaluation (T&E) strategy to support a comprehensive supply chain risk management program for the Department of Defense.
Responsibilities
- Set up segmented databases to control access to various datasets and data products
- Build data pipelines in PySpark using data engineering best practices for testing, validation, automation, and version control
- Coordinate closely with SMEs and front-end developers to generate data tables required for UI execution
- Build code to execute pulls from APIs, allowing access to external data to be pulled into the client environment
- Interact with partners and data providers to understand their data holdings, methods for moving data into the CDAO-Advana platform, and data usage agreements
- Self-starter, and eager to learn and work in a team environment
- Implement a test and evaluation framework for both front end and back end components of an enterprise solution including data products, modeling products and UI
- Implement a test harness to systematically assess and validate the functionality and performance of solution components
- Collaborate with stakeholders to refine testing protocols, ensuring they align with operational requirements and customer priorities for supply chain risk management
- Identify practical test and training data sets for each evaluation
- Document test findings and provide actionable insights to improve the system's reliability and effectiveness in real-time operational settings
- Spearhead the integration of T&E methodologies into the ongoing development lifecycle to continuously adapt and enhance enterprise solution capabilities
- Collaborate closely with data engineers, UI developers, and domain experts to refine and integrate data science methodologies into an adaptive software ecosystem
- Operate proficiently within a Databricks environment, managing code development, testing, and deployment through notebooks
Qualifications
- Bachelor’s degree in Computer Science or related field and/or equivalent work experience
- 3-10 years of experience as a data engineer
- Experience with:
- Agile-based development
- Python, Spark, notebooks
- Data Bricks or similar environment
- Effective analytical, conceptual, and problem-solving skills
- Active DoD Secret clearance
- Fully remote capability acceptable
Desired Qualifications
- Active DoD Top Secret clearance
- Part-time onsite client support in the Washington, DC metro area
The salary range for this position is- $80,000 - $120,000
The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances.