Data Engineer

Key Responsibilities

Core Data & AI Pipeline Development

• Build, maintain, and optimize batch and streaming data pipelines to support analytics and AI workloads.
• Ingest structured, semi structured, and unstructured datasets from APIs, databases, SaaS systems, streaming feeds, and file based sources.
• Transform, clean, enrich, and standardize data using Dataflow (Apache Beam), Dataproc (Spark), BigQuery SQL, and Python.
• Deliver high quality curated datasets into BigQuery for analytics, reporting, and machine learning training.
• Build and maintain ML ready feature pipelines supporting Data Scientists and ML Engineers.

Data Quality, Governance & Operations

• Implement data quality checks, schema validation, and automated testing within pipelines.
• Monitor pipeline health and apply observability best practices using Cloud Monitoring and Cloud Logging.
• Apply governance, security, and compliance standards including IAM roles, encryption, data masking, and auditing.
• Enforce schema evolution policies, metadata management, and lineage tracking using Dataplex/Data Catalog.
• Maintain documentation for datasets, transformations, pipeline logic, and operational procedures.

Engineering & Collaboration

• Write efficient, maintainable Python, SQL, Beam, and Spark code.
• Manage ingestion flows using Pub/Sub, GCS, APIs, Datastream, and database connectors.
• Optimize BigQuery tables, partitions, clustering, materialized views, and query performance.
• Implement and maintain DAGs with Cloud Composer (Airflow).
• Troubleshoot pipeline failures, latency issues, and data quality gaps.
• Participate in code reviews, architectural discussions, and agile sprint ceremonies.
• Collaborate with Data Architects, Data Scientists, ML Engineers, and business stakeholders.
• Develop and maintain Infrastructure as Code using Terraform and CI/CD deployment pipelines.

Required Qualifications

• Must be a U.S. Citizen with ability to obtain a Public Trust clearance.
• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Data Engineering, or related technical field.
• 3–6+ years of hands on experience in data engineering or a similar technical field.
• Minimum three years of experience leading technical teams to achieve outcomes.
• Experience developing and implementing technical standards for cloud and on prem environments.
• Proven experience building production data pipelines on cloud platforms, preferably GCP.
• Hands on experience with BigQuery, GCS, Dataflow (Apache Beam), Dataproc (Spark), and Pub/Sub.
• Experience preparing ML ready datasets for model training.
• Strong background in SQL, Python, distributed data processing, and data modeling.
• Experience with governance, security, and compliance frameworks including IAM, encryption, data masking, and auditing.
• Familiarity with the following tool categories (VAEC Operational Tools):
• Google Cloud Security tools
• Google Cloud Monitoring & Logging tools
• Google Cloud Networking
• Google Storage services

Preferred Experience

• Master’s degree in a technical field.
• Previous experience in Federal Government environments.
• Knowledge of regulated environments such as FedRAMP, HIPAA, PCI, NIST 800 53, and CIS benchmarks.
• Security certifications such as CISSP or CCSP.
• Experience with Vertex AI workflows or comparable ML platforms.
• Familiarity with Dataplex, data governance frameworks, and metadata management.
• Experience with Apache Kafka or other streaming technologies.
• Experience with Datastream for change data capture (CDC).
• Knowledge of regulated industries such as public sector, healthcare, or finance.
• Strong communication skills and the ability to convey complex data concepts clearly.
• Experience with BI tools such as Looker or Looker Studio.
• Experience with third party tools such as Armis, BigFix, CrowdStrike, Tenable Nessus, Turbot, ServiceNow, Dynatrace, Splunk, and more.
• Hands on experience with DevOps tools and methodologies, including Ansible, GitHub, Jira, Terraform, CI/CD, and cloud migration tools.
• Knowledge in ML enablement, feature stores, and ML pipeline patterns.
• Experience with data quality and testing frameworks such as Great Expectations or dbt tests.

As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Connecticut, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Ohio, Vermont, Virginia, Washington, and the District of Columbia. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience.

The pay range for the states of California, Colorado, Connecticut, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Ohio, Vermont, Virginia, Washington, and the District of Columbia is:

$103,200—$196,400 USD

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

Other Employment Statements

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.

The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company's legal duty to furnish information.

California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please click here for additional important information.