Senior Data Engineer-GCP
Company: Perennial Resources International
Location: Parsippany
Posted on: May 16, 2022
|
|
Job Description:
Job DescriptionSeeking a Senior Data Engineer GCP to join our
team as we embark on an exciting new journey into the Google Cloud
Platform. We are looking to revitalize our Data & Analytics program
by consolidating our legacy data platforms onto GCP through
re-design, and we will be enabling a suite of leading capabilities
to support the spectrum of business needs with key cloud and big
data technologies, including AI/Client, streaming data analytics,
data lake and data warehouse, as well as self-service and delivered
reporting. This senior role will help shape the inception of our
GCP architecture, roadmap, and integration strategy, as well as
play a key role in the build of these capabilities on an aggressive
schedule. As a successful candidate, you will demonstrate a robust
track record of leading data engineering projects and enhancement
efforts on a Google Cloud Platform. You will be a subject matter
expert on GCP services, tools, and best practices. You will help
drive our key initiatives and high value projects, including the
migration of our existing data warehouse platforms (iSeries-based
and AWS-based) onto GCP, as well as integrating with operational
systems located within AWS, Azure, and on-prem using the best fit
integration technologies and methodologies. You will work with an
internal project team augmented by third-party project resources
who will be onshore and offshore. Responsibilities: Technical
subject matter expert in GCP, providing input into architecture,
platforms, and development strategies and methodologies - includes
mentorship of engineering team via design reviews, code reviews,
etc. Shape strategy and implementation for migration of key data
and functionality from existing data warehouse platforms onto GCP.
Drive the necessary changes and recommending appropriate technology
choices working collaboratively with expert input into GCP-related
and other project decisions. Interface with key business functions,
as well as IT Business Analysis teams to assess business functional
requirements and translate them into data and integration
requirements. Collaborate with and guide technical resources from
consulting partners, communicate architecture standards and best
practices, establish a high impact development process. Support the
shift towards a DevOps mentality for the Data & Analytics delivery
function, emphasizing continuous integration, release management
and automated testing to maximize development agility and improve
time to market. Qualifications: BS in Computer Science or related
field or equivalent experience. 3 years of experience in Data &
Analytics field. 2 years of experience in GCP-specific
architecture, development, or support capacity. 3 years of
experience and knowledge of SDLC & ITIL. 2 years of experience
designing and building data storage capabilities, such as data
warehouse or data lake. An understanding of large-scale computing
solutions, including software design and development, and database
architectures. Knowledge of GCP cloud security, orchestration,
management, data management. Strong knowledge of ETL, ELT, CDC,
messaging, streaming, and all forms of data ingestion techniques
applicable to cloud-based Data & Analytics. Strong skills in SQL;
no-SQL; relational & non-relational platforms; multiple file
formats, including Parquet, AVRO, JSON, XML, CSV, etc. Preferred:
Strong Java, Python development. Experience with AWS environment.
Experience with data science platforms, such as Dataiku. Experience
designing and building API interfaces for efficient data
extraction. Experience working in Global Retail Industry.
Keywords: Perennial Resources International, New York , Senior Data Engineer-GCP, Engineering , Parsippany, New York
Click
here to apply!
|