All roles

ETL Pipeline Developer & Data Engineer

Remote · USA Full-time New today

Description: eSimplicity is a modern digital services company that partners with government agencies to improve the lives and protect the well-being of all Americans, from veterans and service members to children, families, and seniors. Our engineers, designers, and strategists cut through complexity to create intuitive products and services that equip federal agencies with solutions to courageously transform today for a better tomorrow. Purpose and Scope: You will work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for the data and analytics platform that allows users to access data catalogs, request compute resources, and manage data access controls for an enterprise data and analytics platform. Responsibilities:

  • Create and maintain new and existing data pipelines, Extract, Transform, and Load (ETL) processes, and ETL features using Azure cloud services.
  • Build, expand, and optimize data and data pipeline architectures. Optimize data flow and collection for cross functional teams of database architects, data analysts, and data scientists.
  • Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality.
  • Assemble large, complex sets of data that meet non-functional and functional business requirements
  • Implement large dataset engineering: data augmentation, data quality analysis, data analytics (anomalies and trends), data profiling, data algorithms, and (measure/develop) data maturity models and develop data strategy recommendations.
  • Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Develop and document standard operating procedures (SOPs) for new and existing data pipelines
  • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.
  • Work with stakeholders including data, design, product, and government stakeholders and assisting them with data-related technical issues
  • Write unit and integration tests for all data processing code.
  • Read data specifications and translate them into code and design documents.
  • Perform other duties as assigned.

Requirements: Required Qualifications: All candidates must pass public trust clearance through the U.S. Federal Government. This requires candidates to either be U.S. citizens or pass clearance through the Foreign National Government System which will require that candidates have lived within the United States for at least 3 out of the previous 5 years, have a valid and non-expired passport from their country of birth and appropriate VISA/work permit documentation.

  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Statistics, or related technical field.
  • 8+ years of experience in software/data engineering, including data pipelines, data modeling, data integration, and data management.
  • Expertise in data lakes, data warehouses, data meshes, data modeling and data schemas (star, snowflake…).
  • Extensive experience with Azure cloud-native data services, including Synapse, Data Factory, DevOps, KeyVault, etc.
  • Expertise in SQL, T-SQL, and Python with applied experience in Apache Spark and large-scale processing using PySpark.
  • Proficiency with data formats: parquet, distributed snappy parquet, and .csv.
  • Understanding of common connection protocols, such as SFTP.
  • Proven ability to work with incomplete or ambiguous data infrastructure and design integration strategies.
  • Excellent analytical, organizational, and problem-solving skills
  • Strong communication skills, with the ability to translate complex concepts across technical and business teams.
  • Proven experience working with petabyte-level data systems.

Preferred Qualifications:

  • Experience working with Personally Identifiable Information (PII) and Sensitive Information (SI).
  • Demonstrated success providing support within a Federal agency system environment, ensuring alignment with organizational goals and technical standards.
  • Familiarity with data governance, metadata management, and data quality practices.

Working Environment: eSimplicity supports a remote (or hybrid depending on the role and program) work environment operating within the Eastern time zone so we can work with and respond to our government clients. Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional travel for training and project meetings. It is estimated to be less than 5% per year. Benefits: We offer a highly competitive salary and full healthcare benefits. Equal Employment Opportunity: eSimplicity is an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender, age, status as a protected veteran, sexual orientation, gender identity, or status as a qualified individual with a disability. Apply tot his job Apply To this Job

Related roles

Sales Operations Analyst, Remote

Remote · USA Full-time

Managing Consultant - Data Migration

Remote · USA Full-time

Lead Data Modeler - BI Data Modernization

Remote · USA Full-time

Security Engineer, Data Protection - Associate

Remote · USA Full-time

Senior Data Platform Engineer; SnowFlake Specialist - Mortgage Lending - LATAM

Remote · USA Full-time

Privacy and Compliance Specialist

Remote · USA Full-time

Ads Privacy Engineer (L6)

Remote · USA Full-time

Sr Corporate Counsel, Privacy & Regulatory

Remote · USA Full-time

Privacy and Data Protection Manager

Remote · USA Full-time

Product Manager, Core Data Systems

Remote · USA Full-time

Entry-Level Email and Chat Support Associate – Join blithequark's Dynamic Team

Remote · USA Full-time

Retail Customer Service Expert - Remote- BYOD

Remote · USA Full-time

Healthcare Operations Manager - Contract Hub

Remote · USA Full-time

Operations Development Program

Remote · USA Full-time

Library Associate IV - Library Equal Access Program job at City of Seattle, Washington in Seattle, WA

Remote · USA Full-time

Experienced Data Entry Specialist – Entry-Level Opportunity at arenaflex

Remote · USA Full-time

Work From Home Data Entry Part Time - Customer Service Representative

Remote · USA Full-time

Experienced Customer Development Manager – Driving Revenue Growth and Customer Relationships at arenaflex

Remote · USA Full-time

Business Support Analyst - Talent, Performance & Learning

Remote · USA Full-time

Director, Research & Strategic Advisory Services (Professional and Adult Education)

Remote · USA Full-time