Join Experdex Australia and drive digital and analytical transformation across leading organisations and communities. The quality, innovative accelerators and capabilities we build and support our clientele, offers you unparalleled opportunities to learn, advance and grow. Choose Experdex, and deliver innovation every day as part of your job and make it an extraordinary career.
The Azure Data Engineering Specialist is responsible for building, implementing and supporting Microsoft Azure PaaS solutions to meet client requirements. They apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity.
We are currently looking for experienced software engineers who have good technical expertise with the Microsoft Azure Pass offerings (Event Hub/kafka, ALDS2, Databricks, Data Factory, SQL Data warehouse, Akka, Flink, Java9+, Scala, Spark, Python). Other key skills are experience with Reactive programming skills, streaming and stream processing are of advantage. Additional skills like Power BI reporting is welcome. As part of a collaborative team, he/she will be responsible for designing and developing software products to implement new solutions.
Key Skills / Experience:
Proficient understanding of distributed & streaming computing principles
Solid experience in designing and implementing Cloud-based Big data solutions
Good understanding of Microservices and Event-Driven architecture
Experience with building stream-processing systems
Additional knowledge on Azure, AKS / AWS native services
Programming knowledge on Scala, Java, Python
Experience with Spark, Spark structured streaming, Flink, Beam
Experience with integration of data from multiple data sources
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, Graph DB
Knowledge of various ETL techniques and frameworks, such as Flume
Knowledge on Akka is appreciated
Experience on Kubernetes, Docker preferable
Knowledge on Drools, Scala Rules is not mandatory but appreciated
Experience with various messaging systems such as Kafka or RabbitMQ
Experience with Big Data ML toolkits, such as R, Mahout, SparkML, or H2O
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Experience with Cloudera/Hortonworks – advantage
Other Requirements:
Ability to define, develop, maintain, test and evaluate Framework as part of big data solutions within organisations
Should be well versed with Data Structures & algorithms
Understanding of software development lifecycle
Excellent analytical and problem-solving skills.
Ability to work independently as a self-starter, and within a team environment.
At least 8 years of core data and/or software engineering experience and one end-to-en implementation experience in with cloud or bigdata offerings
Good communication skills- Written and Verbal
More Information
- Address Sydney NSW, Australia
- Salary Offer AUD 100,000 to AUD 120,000
- Industry Information Technology
- Qualification Degree in information technology
- Experience 5 - 10 Years
