Associate Lead Engineer – BI Jobs At Dialog Axiata in Colombo Sri Lanka

Job Overview

Description

Implementation and configuration / new developments of Enterprise Big Data solutions as per Business Requirement while leading the smooth operationalization of platform. Also, to be able to architect the most optimized/suited big data solution for the business.

The Job

Installation, configuration, and upgrading of Big Data solutions while leading the team for smooth operationalization

Benchmark systems, analyze system bottlenecks, and propose solutions to eliminate them

Provide deep subject matter expertise, advice for the program delivery while establishing architectural principles and patterns

Conduct technical and design reviews while understanding system integration concepts and patterns

Review the business requirements captured and assess gaps

Innovation role on Digital Data with latest technologies and identify customer expectations and competitor movements fast and accurate and same time coordination among organizational units to enhance operational backbone

Carrying out R&Ds to select best suited Big Data technologies

Design ETL flow using technologies such as Sqoop / Flume / Kafka / Hive / Oozie / PIG / AWS Glue / Airflow

Responsible for performing monthly / quarterly performance analysis to identify the application bottlenecks, issues and new resources requirements while defining the process and continuous improvement

Troubleshooting on system issues, attending to faults, analysis of issues, applying corrective action / workarounds, proving RCAs

Periodically update relevant patches on Big Data platforms while assessment of the Big Data platform to identify gaps for patch and make long-term and short-term plans to bridge the gaps

Perform Unix / Linux administrative tasks while planning and execution of performance improvement activities essential to Maintain smooth operational environment

Implementing and managing OS level security and patch upgrades while maintaining minimum baseline security of servers (Periodic VA Scans / Recommending patches)

Maintaining up to date documentation, connectivity diagrams, and related information for all the application liaised within the responsibility of this position

Career path development and create Learning opportunities for subordinates

Entry Requirements

The Person

5+ years’ experience in a relevant position at similar field

Bachelors’ degree in IT/Computer science from a recognized university

Having Scalable Machine Learning certification, certified on Data warehousing with MSSQL Server, certified on Cloudera Developer for Apache Hadoop & Spark, certified on Cloudera Designing and Building Applications and AWS solution architect is advantageous

Strong Knowledge Big Data related technologies (Hadoop, MapReduce, Pig, Hive, HBase, Oozie, Flume, ZooKeeper, Kafka, Spark, Solr, Impala, Hue)

Knowledge on RDBMS (MySQL, Oracle), PLSQL, Shell Scripting, MySQL Clustering, Impala Load Balancing, NoSQL / column-oriented Databases (Preferred Snowflake / ClickHouse)

Strong Programming skills with Scala / Python/ Java

Apply Now