Senior Data Engineer, Python / Spark

Company: The Cypress Group
Location: New York
Posted on: September 21, 2023

Job Description:

My client is an innovative leader in the cybersecurity industry. Their systems consume and process huge volumes (multi-terabytes) of data from a variety of sources every day. They utilize a home-grown Spark based big data analytics platform to execute analytics and data mining on the data sets. They are currently looking for a talented Data Engineer to work in their Data Team building and scaling the next generation data analytics platform. As a member of the team you will work in an intimate, collaborative environment along with other Engineers to create systems that organize, analyze, and maintain the data. The required skills for the position include the following:

• Python -experience (Scala or Java are okay too)
• Spark, Hive, MapReduce, NoSQL and related technologies (exposure okay)
• SQL, -ETL
• Amazon AWS or Google Cloud -(could architecture experience with a major cloud provider)
• Any additional experience with distributed data storeage systems that use parallel process or columnar data stores (Snowflake, Redshift, Cassandra, Druid, HBase, etc.) are all plusses. The team is looking for the right combination of technical skills, intelligence, curiosity, drive and grit. They are an innovative startup-like environment that thrives on creative and elegant solutions to complex technical problems. You have experience improving performance, scalability and availabitity of large systems and have proven industry experience. You communicate effectively and enjoy collaboration. This position features a competitive compensation package complete with equity and comprehensive benefits. If you are qualified and interested, please send a resume to nyjobs@cypressg.com for immediate consideration. This position is conveniently located in midtown and features competitive compensation and a comprehensive benefits package. Please send a copy of your resume to nyjobs@cypressg.com for immediate consideration. Local candidates only, please.
  #J-18808-Ljbffr

Keywords: The Cypress Group, New York , Senior Data Engineer, Python / Spark, IT / Software / Systems , New York, New York