Big Data Engineer.
- Permanent Opportunity to be a part of leading brand name
- High visibility and strong career progression
Job Responsibilities
- Responsible in creating and maintaining optimal data pipeline architecture
- Lead in assembling large, complex data sets that meet functional and non-functional business needs
- To identify, design and implement internal process improvements, which includes automating manual processes, optimizing data delivery and collaborating with infra team to re-design infrastructure for greater scalability and stability
- To collaborate with internal stakeholders to provide infrastructures that are required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and 'big data' technologies
- Responsible in ensuring data are separated and secured across national boundaries through multiple data centre and regions
- To create data tools for analytics and data scientist team members to assist them in building and optimize models
- Liaise with data analytics experts to strive for greater functionality in our data systems
- To develop tools which will utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
- Responsible in preparing the daily, weekly, monthly, yearly and ad hoc report and analysis for ecommerce team
- To utilize data and share the insights with ecommerce team
- Perform any ad-hoc duties or responsibilities assigned
Requirement
- Strong Knowledge in SQL, query authoring (SQL) and RDBMS and HDFS (Hadoop File System)
- Knowledge in building and optimizing 'big data' data pipelines, architectures, data sets AWS cloud services such as EC2, EMR, Data Proc, Data Bricks, Kenesis, Firehose and workflow management tools such as Luigi, Airflow
- Working knowledge of Google Analytics
- Knowledge with object-oriented, object function scripting languages such as Python and/or Java, C++, Scala is essential
- Knowledge with big data tools such as Hadoop, Spark, Kafka, NiFi, Sqoop and stream-processing systems: Storm, spark-streaming is essential
- Technical knowledge of relational SQL and NoSQL databases, Qlikview and Qliksense will be a plus
- Strong analytical skills with the foresight to anticipate and plan for industry changes
- Able to multi- task with Excellent organizational skills and meticulous in work assigned
- Able to work well under pressure with minimal supervision & Team Player with positive learning attitude
- Preferably with 5 years' experience as a software engineer in related fields
Please send your resume in WORD format by clicking the apply button below or contact Preetika Bhatia on +65 6701 1523 for a confidential discussion. Please note that only short-listed candidates will be contacted. CEI Reg. Number R1767372 (Bhatia Preetika).
