Data Engineer(Cloud)
CAPE TOWN
Salary Negotiable | 12 month contract
Job Description:
• The Cloud Data Engineer will be involved in design and development of the Cloud environment, processes, programs, and scripts.
• The data engineer would need Kafka and Cassandra experience with previous experience with CI/CD.
• This individual must enjoy working on a high-intensity, fast-paced team but can be a strong individual contributor as well.
• You use your excellent written and verbal communication skills to help your team achieve its goals.
• You are a motivated professional with a passion for technology that wants to work for a leading edge enterprise.
Job Requirements:
• As a key member of the Cloud Platform Development Team you will be responsible for designing and developing major database components of our next generation cloud platform.
• Build highly scalable data abstractions and infrastructure
• Design large graph infrastructure and query/search interfaces
• Collect and process data streams at scale (including stream-processing and batch ETL)
• Work closely with engineering teams to help build and maintain systems that support advanced analytics
• Work with platform architects on software and system optimizations, helping to identify and remove potential performance bottlenecks
• Stay up to date on relevant technologies, plug into user groups, understand trends and opportunities that ensure we are using the best techniques and tools
• The ideal candidate has strong data system development experience and has worked with cloud deployment models and test-driven development in a fast-paced agile environment.
• Experience in creating architecture, building and maintaining (commercial or open source) software platforms and large-scale data infrastructures
• A strong team player, able to quickly triage and troubleshoot complex problems
• Experience with cloud resource platforms such as Amazon AWS, Microsoft Azure
• Experience building big data solutions using technologies such as Cassandra and Kafka
• Strong knowledge of data technologies including SQL, Map/Reduce
• Familiar operating in UNIX/Linux environments

Skills Category:
• Proven understanding and experience with Kafka
• Proven understanding and experience with Cassandra
• Knowledge of workflow/schedulers
• Good aptitude in multi-threading and concurrency concepts
• Understanding of metadata concepts
• High-speed querying
• Agile
• 1 -3 years Data Engineering Skills
• Knowledge in programming, specifically R, python, java, JS,
• Ability to write MapReduce jobs
• Good knowledge of database structures, theories, principles, and practices
• Loading from various data Sources
Job Related Experience Required:
• Software programming using Java, JavaScript Spring, SQL 1 – 3 years
• Knowledge of components such as Kafka
• Knowledge of the DB component such as Cassandra
Competencies:
• Adaptability
• Building Customer Loyalty
• Building a successful team
• Building strategic working relationships
• Coaching
• Communication
• Continuous Learning
• Contributing to team success
• Customer Focus
• Decision Making
• Strong Team player