Application deadline date has been passed for this Job.
Exploreture
Job Overview
Data Engineer
The Job
- Design, develop, and deploy efficient data pipelines for collecting and organizing data
- Maintain and optimize existing data structures
- Analyze data and identify patterns
- Work with teams of engineers and business professionals to set up the required pipelines.
- Create reports and visualizations to support data-driven decisions
- Develop automated processes for data collection, transformation, and analysis
- Stay up-to-date with new technologies and best practices.
The Person
- 1 -3 years of hands-on experience in designing and developing big data solutions with excellent coding skills (Python, Java or Scala)
- Strong conceptual understanding of Big Data architecture patterns and knowledge on Big Data technologies (such as Hadoop, Spark, Kafka, Cassandra, Hive/Pig, and Java/MapReduce), tuning, troubleshooting and scaling.
- Fundamental understanding of data warehouses & data pipelines. Knowledge on SQL Database and NoSQL databases, such as Snowfalke, CouchDB, MongoDB, Cassandra, HBase, DynamoDB.
- Experience with open source big data technologies such as Hadoop, Hive, Kafka and Spark.
- Familiarity with one of more cloud-based big data platforms such as Azure HDInsight, Google Dataproc or Amazon EMR.
- Experience working with orchestration tools such as Apache Airflow, Azkaban, Apache Oozie etc.
- Exposure in building real-time processing pipelines using Spark-streaming, kafka, or Flink.
- Prior experience working in an Agile environment would be an added advantage.
Job Detail
-
Offered SalaryNot Specified
-
Career LevelNot Specified
-
Experience1 Year
-
GenderBoth
-
INDUSTRYTelecommunication
-
QualificationNot Specified