Data Engineer and Developer

Data Engineer & Developer

We are hiring a Data Engineer & Developer to build and maintain cloud infrastructure, data pipelines, and software integrations that power scientific computing capabilities. In this role, you will own AWS architecture and operations and develop integrations between ELN/LIMS platforms, laboratory instruments, and downstream data systems to enable seamless data flow from bench to warehouse to decision-ready dashboards.

You will design, deploy, and maintain AWS infrastructure supporting QC instrument pipelines, data warehousing, and analytical workloads. You will develop and maintain API integrations that automate data capture from lab workflows and enable bi-directional data exchange with enterprise systems. You will build and optimize ETL/ELT pipelines for lot release assays, quality metrics, and operational dashboards, and implement event-driven architectures that propagate data automatically to downstream consumers.

You will contribute as a dependable teammate in a fast-paced, cross-functional environment, collaborating with internal teams to translate workflow requirements into robust, validated data pipelines. You will monitor infrastructure health, troubleshoot pipeline failures, and establish alerting for proactive issue detection. Success in this role requires strong organization, clear communication with stakeholders, and thorough documentation.

Responsibilities

Cloud Infrastructure, Pipelines, and Integrations:

• Design, deploy, and maintain AWS infrastructure supporting QC instrument pipelines, data warehousing, and analytical workloads
• Build and optimize ETL/ELT pipelines for lot release assays, quality metrics, and operational dashboards
• Implement event-driven architectures that propagate data automatically to downstream consumers (warehouses, dashboards, reporting systems)
• Develop and maintain API integrations, automating data capture from lab workflows and enabling bi-directional data exchange with enterprise systems

Collaboration, Operations, and Documentation:

• Collaborate with internal teams to translate workflow requirements into robust, validated data pipelines
• Monitor infrastructure health, troubleshoot pipeline failures, and establish alerting for proactive issue detection
• Contribute to data integrity and audit trail requirements for regulated systems; support validation activities as needed
• Document architecture decisions, integration patterns, and operational runbooks

Qualifications & Requirements

Education and Experience:

• Hands-on experience with AWS services (Lambda, Step Functions, RDS/Aurora, S3, EventBridge, IAM)
• Proficiency in Python; experience building REST API integrations and working with third-party APIs
• Strong SQL skills and experience with data warehousing concepts (star schemas, dimensional modeling)
• Familiarity with infrastructure-as-code (Terraform, CloudFormation) and CI/CD practices
• Experience with ELN/LIMS platforms or similar systems and their APIs
• Background in regulated industries (e.g., biotech, pharma) or familiarity with data integrity standards (e.g., 21 CFR Part 11 / ALCOA+)
• Experience with dashboard/BI tools (e.g., Metabase, Tableau, or similar)
• Familiarity with PostgreSQL, data lake architectures, or streaming pipelines
• Exposure to laboratory instrument data formats and scientific data workflows

Skills and Attributes:

• Clear communicator who can translate technical concepts for non-technical stakeholders
• Strong attention to detail and organizational skills
• Self-starter with the ability to adapt and contribute effectively in a fast-changing environment
• High level of integrity, ethics, and commitment to quality and timely delivery