Data Engineer

Kualifikasi umum

• Minimum S1

• Minimum 5 tahun pengalaman sebagai Data Engineer, ETL Engineer, Big Data Engineer, atau Data Platform Support.

• Berpengalaman menangani production support dan troubleshooting pada lingkungan Big Data.

Technical Skills

• Strong understanding of ETL/ELT concepts and data pipeline architecture.

• Strong experience with Apache Spark (batch processing, Spark SQL, job troubleshooting).

• Good understanding of Tencent WeData atau platform ETL sejenis (Airflow, Informatica, Talend, Ab Initio, AWS Glue, DataWorks, dsb.).

• Advanced SQL untuk troubleshooting dan data validation.

• Familiar dengan Hadoop ecosystem (Hive, HDFS, YARN menjadi nilai tambah).

• ⁠Basic Linux command dan shell scripting.

• Memahami monitoring log, execution log, dependency, scheduler, dan job recovery.

Responsibilities

• Monitor seluruh pipeline WeData.

• ⁠Troubleshoot failed ETL/Spark jobs.

• Root Cause Analysis (RCA).

• ⁠Handle complex production incident.

• Melakukan rerun, recovery, tuning, dan workaround.

• ⁠Menjadi escalation point untuk Junior Data Engineer. •

• Berkoordinasi dengan L3 Platform Engineer/Tencent Cloud.