Azure Data Engineering Specialist 121 views1 application

Job Expired

Join Experdex Singapore and drive digital and analytical transformation across leading organisations and communities. The quality, innovative accelerators and capabilities we build and support our clientele, offers you unparalleled opportunities to learn, advance and grow. Choose Experdex, and deliver innovation every day as part of your job and make it an extraordinary career.

The Azure Data Engineering Specialist is responsible for building, implementing and supporting Microsoft Azure PaaS solutions to meet client requirements. They apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity.

We are currently looking for experienced software engineers who have good technical expertise with the Microsoft Azure Pass offerings (Event Hub/kafka, ALDS2, Databricks, Data Factory, SQL Data warehouse, Akka, Flink, Java9+, Scala, Spark, Python). Other key skills are experience with Reactive programming skills, streaming and stream processing are of advantage. Additional skills like Power BI reporting is welcome. As part of a collaborative team, he/she will be responsible for designing and developing software products to implement new solutions.

Key Skills / Experience:

Proficient understanding of distributed & streaming computing principles

Solid experience in designing and implementing Cloud-based Big data solutions

Good understanding of Microservices and Event-Driven architecture

Experience with building stream-processing systems

Additional knowledge on Azure, AKS / AWS native services

Programming knowledge on Scala, Java, Python

Experience with Spark, Spark structured streaming, Flink, Beam

Experience with integration of data from multiple data sources

Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, Graph DB

Knowledge of various ETL techniques and frameworks, such as Flume

Knowledge on Akka is appreciated

Experience on Kubernetes, Docker preferable

Knowledge on Drools, Scala Rules is not mandatory but appreciated

Experience with various messaging systems such as Kafka or RabbitMQ

Experience with Big Data ML toolkits, such as R, Mahout, SparkML, or H2O

Good understanding of Lambda Architecture, along with its advantages and drawbacks

Experience with Cloudera/Hortonworks – advantage

Other Requirements:

Ability to define, develop, maintain, test and evaluate Framework as part of big data solutions within organisations

Should be well versed with Data Structures & algorithms

Understanding of software development lifecycle

Excellent analytical and problem-solving skills.

Ability to work independently as a self-starter, and within a team environment.

At least 8 years of core data and/or software engineering experience and one end-to-en implementation experience in with cloud or bigdata offerings

Good communication skills- Written and Verbal

More Information

  • This job has expired!
Share this job
Connect with us
Contact Us

CONTACT US

Raffles Boulevard, Marina Square,

#03-308, Singapore 039594

Tel: +65 65898400

info@experdex.net

www.experdex.com

Close Bitnami banner
Bitnami