Data Engineer

Data Engineer

Posted Today by 1759915954

Negotiable
Outside
Remote
USA

Summary: The Data Engineer role involves implementing data ingestion and pipeline processes on Google Cloud Platform, adhering to best practices and technical specifications. The position requires designing, developing, and troubleshooting these processes based on business needs. The engineer will work both independently and collaboratively, ensuring effective communication with project teams. This contract position is based in Freeport, Maine, with the possibility of remote work.

Key Responsibilities:

  • Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
  • Works independently and collaboratively with team; keeping the project team and leaders in the loop.
  • Prepares detailed specifications from which data ingestion and pipeline processes are developed.
  • Develops and implements technical solutions by code development and tool configuration.
  • Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects/bugs.
  • Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
  • Participates in project planning and development or assumes responsibility for a project of limited scope.
  • Provides options for and estimates of possible coding.
  • May be responsible for the completion of a phase of a project or small projects depending on complexity.
  • Estimates and tracks time required to complete work, for project budgeting and financial tracking.
  • Conducts and participates in reviews of solution designs, configurations and code.
  • Provides technical expertise for project and baseline support teams.
  • Adheres to security standards to comply in the handling/processing/storing of sensitive data.
  • Adheres to development standards and provides development standards.

Key Skills:

  • Google Pub/Sub
  • BigQuery
  • Google Dataform
  • Data ingestion to Big Query experience
  • Google Cloud Storage
  • Cloud Composer
  • GitHub
  • SQL
  • Cloud Data fusion (Good to have)
  • DBMS connectivity and interaction experience (SQL Server, DB2, Oracle) (Good to have)
  • Experience calling RESTful API's and SOAP Webservices (Good to have)
  • Experience integrating with other Google resources, databases, and services (Good to have)
  • Jira (Good to have)
  • Confluence (Good to have)

Salary (Rate): £62 per hour

City: Freeport

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Engineer

Position Purpose: Implements simple to complex data ingestion and pipeline processes on Google Cloud Platform using industry-standard best practices. Designs, develops, configures, tests, debugs, and documents these processes based on business requirements and technical architecture specifications. Supports and troubleshoots existing ingestion and pipeline processes and data.

location: Freeport, Maine

job type: Contract

salary: $60 - 62 per hour

work hours: 8am to 5pm

education: Bachelors

responsibilities:

Responsibilities:

  • Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
  • Works independently and collaboratively with team; keeping the project team and leaders in the loop.
  • Prepares detailed specifications from which data ingestion and pipeline processes are developed.
  • Develops and implements technical solutions by code development and tool configuration.
  • Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects/bugs.
  • Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
  • Participates in project planning and development or assumes responsibility for a project of limited scope.
  • Provides options for and estimates of possible coding.
  • May be responsible for the completion of a phase of a project or small projects depending on complexity.
  • Estimates and tracks time required to complete work, for project budgeting and financial tracking.
  • Conducts and participates in reviews of solution designs, configurations and code.
  • Provides technical expertise for project and baseline support teams.
  • Adheres to security standards to comply in the handling/processing/storing of sensitive data.
  • Adheres to development standards and provides development standards

Technical Skills and Qualifications:

Must have:

Google Pub/Sub

BigQuery

Google Dataform

Data ingestion to Big Query experience

Google Cloud Storage

Cloud Composer

GitHub

SQL

Good to have:

Cloud Data fusion

DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)

Experience calling RESTful API's and SOAP Webservices

Experience integrating with other Google resources, databases, and services

Jira

Confluence

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.