EY

Big Data Engineer (Financial Services) Consultant/Senior Consultant, Technology Consulting

EY
BusinessSG, 048583Full-time2 weeks ago

About the role

AI summarised

This is a Senior Consultant role in Technology Consulting at a global consulting firm, focusing on Big Data Engineering for financial services clients. The role involves designing and implementing big data solutions, leading technical teams, and advising clients on data strategy and architecture.

BusinessFull-timeGeneral

Key Responsibilities

  • Design and implement scalable big data solutions using Hadoop, Spark, Kafka, and related technologies.
  • Lead the development of data pipelines and ETL processes to ingest, process, and store large volumes of structured and unstructured data.
  • Collaborate with clients to understand their business requirements and translate them into technical solutions.
  • Provide technical leadership and mentorship to junior team members.
  • Conduct code reviews and ensure adherence to best practices and coding standards.
  • Manage and optimize data storage and processing systems for performance and cost.
  • Develop and maintain documentation for data architectures and processes.
  • Participate in pre-sales activities, including proposal development and client presentations.
  • Stay current with emerging technologies and industry trends to drive innovation.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, Engineering, Mathematics, or a related field.
  • 3-8 years of experience in big data engineering or a related role.
  • Strong proficiency in Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, Flume, Sqoop, Oozie).
  • Experience with real-time data processing frameworks such as Spark Streaming or Kafka Streams.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their big data services.
  • Experience with containerization and orchestration tools (Docker, Kubernetes).
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and stakeholder management skills.
  • Ability to travel occasionally to client sites.
  • Preferred: Relevant cloud certifications (AWS Certified Big Data - Specialty, Google Professional Data Engineer, Azure Data Engineer Associate).