-負(fù)責(zé)大型數(shù)據(jù)生態(tài)系統(tǒng)的需求收集，設(shè)計(jì)，開發(fā)和測試，包括數(shù)據(jù)管理，治理以及結(jié)構(gòu)化和非結(jié)構(gòu)化數(shù)據(jù)的集成
-定義并建立大規(guī)模的流數(shù)據(jù)處理管道。
-研究數(shù)據(jù)，識別模式并將其轉(zhuǎn)換為算法
-與團(tuán)隊(duì)成員和業(yè)務(wù)部門有效合作，并根據(jù)需要擔(dān)任SME和指導(dǎo)者
-在混合了陸上和海上資源的敏捷環(huán)境中工作
Key?Objective?of?the?role:
-?Responsible?for?requirement?gathering,?design,?development,?and?testing?of?large-scale?data?ecosystem?including?data?management,?governance?and?the?integration?of?structured?and?unstructured?data?
-?Define?and?build?large-scale?streaming?data?processing?pipelines.
-?Study?data,?identify?patterns,?and?convert?it?to?algorithms
-?Effectively?collaborates?with?team?members?and?business?units?and?acts?as?a?SME?and?mentor?as?needed
-?Works?in?an?Agile?environment?with?a?mix?of?onshore?and?offshore?resources
要求：
-計(jì)算機(jī)科學(xué)，信息系統(tǒng)，信息管理，商業(yè)統(tǒng)計(jì)學(xué)位或同等學(xué)歷；
-在數(shù)據(jù)管理項(xiàng)目（包括Informatica?PowerCenter，Informatica?DEI等工具）方面具有至少4年的豐富實(shí)踐經(jīng)驗(yàn)。
-2年使用大數(shù)據(jù)生態(tài)系統(tǒng)的經(jīng)驗(yàn)，包括Hadoop，Spark，HBase，Hive和Kafka等工具
-精通Python，Scala或類似語言
-數(shù)據(jù)湖，數(shù)據(jù)集線器實(shí)施方面的經(jīng)驗(yàn)
-具有AWS或Azure平臺知識者優(yōu)先
-出色的數(shù)據(jù)集成方案分析和問題解決能力，可以快速識別，隔離和解決技術(shù)問題
-良好的分析和溝通能力
-經(jīng)驗(yàn)較少的候選人也將被考慮
Requirement:
-?Degree?in?Computer?Science,?Information?Systems,?Information?Management,?Business?Statistics?or?equivalent;
-?At?least?4?years?of?strong?hands-on?experience?in?data?management?project?including?tools?such?as?Informatica?PowerCenter,?Informatica?DEI.
-?2?years’?experience?working?with?Big?Data?ecosystem?including?tools?such?as?Hadoop,?Spark,?HBase,?Hive?and?Kafka
-?Proficiency?in?Python,?Scala?or?similar?languages
-?Experience?on?data?lakes,?datahub?implementation
-?Knowledge?on?AWS?or?Azure?platforms?is?a?plus
-?Excellent?analytical?and?problem-solving?skills?to?data?integration?scenarios?and?quickly?recognize,?isolate,?and?resolve?technical?problems
-?Good?analytical?and?communication?skills
-?Candidate?with?less?experience?will?also?be?considered
