NewYorkRecruiter Since 2001
the smart solution for New York jobs

Staff Data Engineer

Company: DoubleVerify
Location: New York
Posted on: May 24, 2020

Job Description:

Staff Data Engineer

New York, NY

Who we are

DoubleVerify is the leading independent provider of marketing measurement software, data and analytics that authenticates the quality and effectiveness of digital media for the world's largest brands and media platforms. DV provides media transparency and accountability to deliver the highest level of impression quality for maximum advertising performance. Since 2008, DV has helped hundreds of Fortune 500 companies gain the most from their media spend by delivering best in class solutions across the digital ecosystem, helping to build a better industry. Learn more at www.doubleverify.com.


The Role

As a Staff Data Engineer, you own new initiatives, designs and build world-class platforms in order to measure and optimize ad performance. You ensure industry-leading scalability and reliability of mission-critical systems processing billions of real-time transactions a day. You apply state of the art technologies, frameworks, and strategies to address complex challenges with Big-Data processing and analytics.

What you'll do


  • Architect, design and build big data processing platforms handling tens of TBs/Day, serves thousands of clients and supports advanced analytic workloads
  • Mentor a great team of motivated engineers by constantly reviewing code, looking for design breaches, providing meaningful and relevant feedback to developers and stay up-to-date with system changes
  • Explore the technological landscape for new ways of producing, processing, and analyzing data in order to gain insights into both our users and our product features
  • Design, develop, and test data-driven products, features, and APIs that scale
  • Continuously improve the quality of deliverables and SDLC processes
  • Operate production environments, investigate issues, assess their impact, and come up with feasible solutions.
  • Understand business needs and work with product owners to establish priorities

  • Bridge the gap between Business / Product requirements and technical details
  • Work in multi-functional agile teams with end-to-end responsibility for product development and delivery

    Who you are


    • Lead by example - design, develop and deliver quality solutions.
    • Love what you do and are passionate about crafting clean code and have a steady foundation with 8+ years of programming experience in coding, object-oriented design and/or functional programming
    • Deep understanding of distributed system technologies, standards, protocols, and have 3+ years of experience working in distributed systems like Hadoop, Big Query, Spark, Kafka Eco System ( Kafka Connect, Kafka Streams), and building data pipelines at scale.
    • Hands-on experience building low latency, high-throughput APIs, and are comfortable using external APIs from platforms.
    • Excellent SQL query writing abilities and data understanding
    • Care about agile software processes, data-driven development, reliability, and responsible experimentation

    • Genuine desire to automate decision making, processes, and workflows
    • Experience working with dependency management tools such as Luigi/Airflow
    • Experience with DevOps domain - working with build servers, docker and containers clusters (kubernetes)
    • Experience in Mentoring and growing a diverse team of talented data engineers
    • B.S./M.S. in Computer Science or a related field
    • Excellent communication skills and a team player
    • Vertica or other columnar data stores
    • Google BigQuery
    • Spark Streaming or other live stream processing technology
    • Cloud environment, Google Cloud Platform

    • Container technologies - Docker / Kubernetes
    • Ad serving technologies and standards

    • Experience with Avro, Parquet, or ORC
    • Akka

Keywords: DoubleVerify, New York , Staff Data Engineer, Engineering , New York, New York

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


DevOps Engineer
Description: Description:Are you ready to create world-class software that keeps our critical space assets safe Do you want to work in a fast-paced agile environment that can get a little rowdy at times Do you research (more...)
Company: Lockheed Martin
Location: Norwood
Posted on: 05/30/2020

Dev/Ops Engineer
Description: COMPANY OVERVIEW br br Founded in 2016, Suuchi Inc. is reinventing the fashion supply chain and is the answer to one of the last multi-trillion dollar problems yet to be solved. br Our proprietary (more...)
Company: Suuchi
Location: Carlstadt
Posted on: 05/31/2020

DevOps Engineer
Description: Company OverviewAt Memorial Sloan Kettering MSK , we're not only changing the way we treat cancer, but also the way the world thinks about it. By working together and pushing forward with innovation (more...)
Company: Memorial Sloan-Kettering
Location: New York
Posted on: 05/30/2020


Sr DevOps Engineer I, remote within Canada or US
Description: EBSCO Information Services EIS provides a complete and optimized research solution comprised of e-journals, e-books, and research databases - all combined with the most powerful discovery service to (more...)
Company: EBSCO Information Services
Location: Philadelphia
Posted on: 05/31/2020

ASE Master Automotive Mechanic
Description: Company Description br Lehigh Fleet Services is a family owned and locally operated shop that offers comprehensive mechanical repairs for your domestic and foreign vehicles. We take pride in providing (more...)
Company: NAPA AutoCare Center
Location: Bethlehem
Posted on: 05/30/2020

MES Automation Engineer - BioPharmaceuticals
Description: An MES Automation Engineer is needed in the Philadelphia, PA area to p rovide engineering and technical support for manufacturing execution systems and digital systems in a Bio-pharmaceutical Operations (more...)
Company: Automationtechies
Location: Philadelphia
Posted on: 05/31/2020

Lead Data Engineer (VP level) - Global Investments - Hadoop
Description: Our client is a globally recognized leader in the finance sector. Prior experience in this realm is a requirement. br br They offer exceptional compensation typically in the top 2 , benefits, relocation (more...)
Company: Job Juncture
Location: New York
Posted on: 05/31/2020

Automotive Technician
Description: Automotive Technician br br Open Road Cadillac: Morristown, NJ br br www.morristowncadillac.com br br Summary: br br Responsible for identifying necessary vehicle service and performing (more...)
Company: Open Road Auto Group
Location: Florham Park
Posted on: 05/31/2020

Project Engineer
Description: The OpportunityWe're looking for a Project Engineer, working in the Capital Projects Infrastructure industry in Yonkers, New York. br ul br li Managing submittals and RFI's li Preparing weekly (more...)
Company: PSG Global Solutions
Location: Yonkers
Posted on: 05/31/2020

DevOps Engineer
Description: Description:Are you ready to create world-class software that keeps our critical space assets safe Do you want to work in a fast-paced agile environment that can get a little rowdy at times Do you research (more...)
Company: Lockheed Martin
Location: Norwood
Posted on: 05/31/2020

Log In or Create An Account

Get the latest New York jobs by following @recnetNY on Twitter!

New York RSS job feeds