Open Jobs

  • Share this Job

Sr. Big Data Engineer

Location : Allen park , Michigan
Job Type : Temp/Contract
Reference Code : IBM

Job Description :
 
Required Qualifications :

Title : Senior Data Engineer


Location : Onsite in Allen Park, MI


End Client : confidential


 


 


The Senior Data Engineer role is responsible for supporting the Sustainable Finance Disclosure Regulations (SFDR) program, through working with stakeholders including Architects, technical teams, Business and data producers, to understand the target state requirements including upstream and downstream use cases. With the responsibility of building the data platform, be able to conceptualise the design convert the physical architecture. The role is to leverage appropriate industry-reference-architectures and relevant Environmental Social & Governance (ESG) and SFDR assets. As a senior member of the Data Engineer team, be accountable for end-to-end architecture, design and development process, including providing technical and architecture advisory support to the implementation team and the wider client stakeholders.


Key requirements:


• Strong hands-on experience working in Hadoop Ecosystem, Big data technologies and AWS Cloud and Cloudera


• Must be hands-on with writing Python or Scala Scripts development


• Well versed with Spark development (SQL and/or Spark)


• Hands on experience designing of orchestration using Airflow


• Hands on experience in AWS Service EC2, S3, SNS, SQS, Lambda, Hue, Presto, Spark , Glue, Kinesis, EMR, ECS, EKS


• Sound knowledge in Hive, Redshift, AWS RDS, My SQL and in any NoSQL database e.g., Cassandra, MongoDB


• Experience in architecting and designing batch or real time data streaming


• Ability to dynamically adapt to conventional big data frameworks and opensource tools if project demands


• Knowledge of design strategies for developing scalable, resilient, always-on data lake


• Strong development and automation skills


• Good understanding in data architecture principles, including data access patterns, data modelling and strong in Data base concepts


• Previous experience in ESG related reporting in a financial services organization is an advantage


Powered by AkkenCloud

Akken Copyrights 1999- All Rights Reserved