Big Data Consultant – Engagement, Solutions & Delivery 95 views

Job Expired

Big Data Consultant – Engagement, Solutions & Delivery

Ability to define, develop, maintain, test and evaluate Framework as part of big data solutions within organisations
To delivers a robust, re-usable, feature rich Data Ingestion, Transformation and Egression Engine
Understand technical changes and contribute in problem solving discussion to drive and deliver robust solutions
Involved in the Framework end to end design, knowledge in Big Data and Hadoop based technologies
Banking Domain knowledge and work experience in Big Data programs and platform
Strong experience in building robust, Modular, flexible, scalable and industry support framework components and features
Develop, Drive and deliver framework feature with envision and end to end platform objective
Knowledge and experience in HDFS, Hive, HBASE, Spark in building large-scale data processing framework and systems.
To implementing complex big data projects with a focus on collecting, parsing, managing, analysing and visualizing large sets of data to turn information into insights
To be able to work with cloud computing environments
Ability to communicate efficiently and effectively and be able to understand, interpret and relate an organisation’s strategy and vision to the big data team
To be able to assist in documenting requirements as well as resolve conflicts or ambiguities
To have strong co-ordination and project management skills to handle complex projects by working closely with Program Product owner, Platform and Solution management teams
Proficient in designing efficient and robust ETL workflows
To be flexible in a changing environment and to be able to explain changes correctly to the big data team members
Able to instil trust in the big data team members as well as to help them grow in their role.
Possessing Bachelor’s or Master’s degree in computer science or software engineering
Minimum 15 years of work experience with strong experience and exposure in Big data Initiatives and delivery

Principle BigData Architect
Proficient understanding of distributed & streaming computing principles
Solid experience is designing and implementing Cloud-based Big data solutions
Good understanding on Microservices and Event-Driven architecture
Experience with building stream-processing systems
Additional knowledge on Azure, AKS / AWS native services
Programming knowledge on Scala, Java, Python
Experience with Spark, , Spark structured streaming, Flink, Beam
Experience with integration of data from multiple data sources
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, Graph DB
Knowledge of various ETL techniques and frameworks, such as Flume
Knowledge on Akka is appreciated
Experience on Kubernetes, Docker preferable
Knowledge on Drools, Scala Rules is not mandatory but appreciated
Experience with various messaging systems such as Kafka or RabbitMQ
Experience with Big Data ML toolkits, such as R, Mahout, SparkML, or H2O
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Experience with Cloudera/Hortonworks

More Information

  • This job has expired!
Share this job
Connect with us
Contact Us

CONTACT US

Raffles Boulevard, Marina Square,

#03-308, Singapore 039594

Tel: +65 65898400

info@experdex.net

www.experdex.com

Close Bitnami banner
Bitnami