coverPhoto
Global Software Resources4.0
Data Engineer
United States
Apply Now
Rating Highlights
Compensation & Benefits: 3.6
Culture & Values: 3.8
Career Opportunities: 3.8
Work/Life Balance: 3.7
Job & Company Insights
Job Type: Full-time
Job Function: data engineer
Industry: Information Technology
Size: 201 to 500 Employees
Job

Job Title: Data Engineer
Duration: 6 months with possible extensions
Location: SFO; but remote for now.
Type: W2 Contractor

NOTE: No vendors please this is a W2 contract position, we can not work on a Corp to Corp basis.

Our client’s team is responsible for designing, implementing and maintaining data pipelines. They are also responsible for using human computed labels at scale and in a fully automated manner for measurement. The team closely partners with many teams in the organization to understand and serve the growing data measurement needs. They work on some of the world’s most highly-scaled distributed systems, handling large amounts of data on a daily basis making machine learning powered decisions each day. This team is foundational to making the most out of our client’s data.

Job Responsibilities:

  • Directly contribute to the design and code of data pipelines operating on production data
  • Improve approaches to efficiently handle ever-increasing volume of data
  • Lead end-to-end design and implementation of common components that accelerate and improve our ability to write efficient and reliable data pipelines
  • Maintain efficiency and reliability of production of the critical datasets
  • Evaluate and propose the best tooling and processes for data access and analysis
  • Provide design and review support to the engineering teams working on data processing
  • Continuously evaluate team’s processes to maintain a positive and efficient engineering culture
  • Languages and tools: Scala, Scalding, Python, Airflow

    Experience Required

  • You have experience working in an environment that supports data analysis, experimentation, and Machine Learning modeling or its integration into a product.
  • You possess a proven understanding of backend and distributed systems and strong experience working with MapReduce-based architectures.
  • You have a broad knowledge of the data infrastructure ecosystem and experience in working with large scale data
  • You are familiar with standard software engineering methodology, e.g. unit testing, code reviews, design documentation.
  • You enjoy working in a collaborative environment and interact effectively with others
  • You ground your decisions with data and reasoning and can adapt to new information to make informed choices.
  • You bring thoughtful perspectives, empathy, creativity, and a positive attitude to solve problems at scale.
  • You are willing to be mentored and to mentor others.
Show more
Get alerts to jobs like this, to your inbox.

Suggested Searches