Big Data Consultant - Sandton

PBT Group has a requirement for a Big Data Consultant to interpret requirements provided by business and produce effective Big Data solutions. Programming exposure for code transformations and integrating the big data solution with existing systems. Develop information solutions from a variety of sources for both structured and unstructured data. Technical ownership of Big Data solutions for structured and unstructured data. Experience in the Financial/Banking industry would be an advantage.

- Develop and implement big data models and solutions
- Design and implement ETL methodologies and technologies and the integration with big data
- Conduct root cause analysis on production issues
- Technical leadership of entire information management process of both structured and unstructured data
- Provide ongoing support and enhancement to ETL system
- Optimization and the information solutions
- Implementing machine learning algorithms
- Configuration of the Hadoop infrastructure and environment for optimal performance
- Integrate with statistical and actuarial analysts to build models
- Producing relevant technical documentation and specifications
- Estimate time and resource requirements for business requirement
- Integration of big data solutions with existing reporting and analytical solutions
- Develop data processing functions (DPF’s) using Java and Python


- Systems Development Life Cycle (SDLC) (Intermediate)
- Data Security and Protection Policies (Intermediate)
- Big Data using Hadoop (Advanced)
- Data Warehouse principles and practises (Intermediate)
- Kimball Methodology (Intermediate)
- ETL development (Intermediate)

Technical Skills:
- SQL (Advanced)
- Python (Advanced),
- Java (Advanced),
- Scala (Advanced),
- HIVE SQL (Advanced),
- MS Excel (Advanced)
- Data Mining (Advanced)

Behavioural Skills:
- Applying Expertise and Technology
- Delivering Results and Meeting Customer Expectations
- Creating and Innovating
- Analysing
- Coping with Pressure and Setbacks
- Relating and Networking
- Adapting and Responding to Change
- Learning and Researching

- Matric Essential
- National Diploma in IT (BTech) Essential
- Bachelor of Science (Information Systems, Computer Science, Mathematics) Advantageous

The biggest job-related Twitter account in the world Best Business Blog Winner / SA Blog Awards 2013