Sr. Data Engineer

Company: Experis
Location: New York
Posted on: March 20, 2023

Job Description:

Remote Sr Data Engineer Must be willing to work ET or MT hours. Summary: As a Sr/Ld Data Engineer you will partner with Data Science and IT teams to support the expansion of an application. In this capacity the Data Engineer will built out the necessary data pipelines to support Data Science models and enable efficient access to multiple data sources. In addition, this role will also support packaging and deploying models to production, and creating infrastructure needed for model training. Day-to-Day Responsibilities:

• Partner with the Data Scientist assigned to the project to support model construction, training, and deployment
• Create new data pipelines or improve efficiency in data pipelines needed to support the project
• Package up and deploy new models or updated models to production
• Create the necessary infrastructure to support model training
• Build data pipelines that enable automated data processing and efficient change
• Work with the Data Scientist and Application team to ensure the design if fit for requirement Required skills:
  • Experience working w/Python and AWS (S3, EC2), Unix/Shell scripting
  • Experience with a variety of relational and non-relational databases and data sources
  • Experience with parallel computing tool (Ray, Prefect, or multiprocessing package)
  • Knowledge of at least one good tool for effective and performant tabular data manipulation (e.g. Pandas, Dask, Spark, or SQL)Preferred skills and experiences:
    • Pytorch
    • Parallel computing tool e.g. ray, dask, prefect or multiprocessing package
    • Prefect Orchestration
    • CI/CD automation, e.g. Jenkins or ADO
    • Experience with analytical databases, snowflake
    • Terraform
    • Docker EDUCATION AND/OR EXPERIENCE REQUIRED:
      • Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of two years of work experience designing, programming, and supporting software programs or applications.
      • In lieu of degree, minimum of four years related work experience designing, programming, and supporting software programs or applications may be accepted.

Keywords: Experis, New York , Sr. Data Engineer, Engineering , New York, New York