Job D5392 Description Click to apply: Please attach resume to mail | |
SOFT's client, located in NYC, needs a Data Engineer for a long term contract assignment. This is a hybrid position and candidates must be commutable to NYC. Qualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required. Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plus Expert-level experience in data architecture, data types/formats, optimizing code and ETL jobs, data architecture, data modeling, data contracts – a key requirement for successful collaboration with data architects and visualization developers. Expert-level professional hands-on experience in extensible data pipeline development using Databricks, Alteryx, AWS Glue and Lambda functions. Expert-level professional hands-on experience with RDBMS, ETL scripting tools and IDEs, data pipeline development, and management using orchestration/monitoring tools. Expert-level knowledge and experience in implementing software engineering security best practices and contributing to design/engineering for DevSecOps. Expert-level experience with master data management strategies, rules-based engines, and tools for multi-stage data correlation on large data sets. Must have experience managing deployment and leading the release of code to production. Expert-level understanding of data visualization tools and requirements for business customers. Expert-level experience working in agile setting or being an agile best-practice mentor. Expert-level experience working in Jira, confluence, and contributing to engineering team documentation/playbooks. Proven experience influencing and partnering with product management, Product Owners in translating business requirements into data and engineering specifications. Responsibilities: • Work on migrating applications from an on-premises location to the cloud service providers. • Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation. • Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline. • Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology. • Perform problem analysis, data analysis, reporting, and communication. • Work with peers across the system to define and implement best practices and standards. • Assess applications and help determine the appropriate application infrastructure patterns. • Use best practices and knowledge of internal or external drivers to improve products or services. |