ETL and Big Data Developer
Overview:
Presight is looking for a passionate ETL & Big Data Developer to join our team and help take our customer-focused services to higher levels. As an ideal candidate, you have a proven experience to design, develop, and deliver complex ETL solutions using a wide variety of tools and technologies including big data. You will also play a critical role in driving the adoption of big data to solve business problems
The opportunity
To play a critical role in the development of high-performance data solutions & information products at Presight —an AI-driven, rapidly growing, high-visibility Business that delivers cutting edge, next-gen products for the international market.
Presight, an ADX-listed public company limited by shares whose majority shareholder is Abu Dhabi company G42, is the region’s leading big data analytics company powered by Artificial Intelligence (“AI”). It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive societal impact. With its world-class computer vision, AI and omni-analytics platform as its engine, Presight excels at all-source data interpretation to support insight-driven decision making that shapes policy and creates safer, healthier, happier, and more sustainable societies.
Responsibilities:
Reporting to the Data Team Manager, your key responsibilities are as follows-
Functional
Hands-on in building robust end-to-end ETL data pipelines for processing big data using Spark
Handling Ad hoc technical issues
Involving in code reviews
Debugging and solving issues found related to functionality, performance during testing or in production
Designing and developing ETL jobs using a variety of sources and targets
Converting complex business transformations into effective and efficient ETL solutions
Building ETL jobs for structured/semi-structured and unstructured data
Handling Ad hoc technical issues
Involving in code reviews
Debugging and solving issues found related to functionality, performance during testing or in production
Designing and developing ETL jobs using a variety of sources and targets
Converting complex business transformations into effective and efficient ETL solutions
Building ETL jobs for structured/semi-structured and unstructured data
Skills and attributes for success
The yardsticks of your performance would include cost savings achieved, quantum of customer reported defects, adherence to policies, procedures & quality standards, number of daily tests executed, and customer NPS.
Qualifications:
To qualify, you must have
- University degree in Computer Science, Engineering or equivalent preferred
- 5 to 8 years of proven experience in implementing ETL and big data solutions
- Excellent communication skills in English
- Experience working in an Agile environment
- Experience in ETL tool datastage is required. Working knowledge of Informatica is desirable
- Experience in programming languages such as Java, Scala or Python
- Experience working in big data technologies such as Apache Spark, Spark Streaming, Spark SQL and Hadoop
- Good understanding of various frameworks and services related to Spark for achieving different goals
- Proficiency in Oracle SQL and PL/SQL is desirable. Knowledge in other RDBMS and Non-RDBMS databases is appreciated. Strong in UNIX shell scripting and jobs automation
- Knowledge in data warehousing concepts and data modelling
- Knowledge of administration tasks like Installation, upgrade, maintenance, and troubleshooting is a plus.
- Have the willingness and ability to learn new technologies
What we look for:
If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the G42 community.
What working at Presight offers:
Culture: An open, diverse and inclusive environment with a global vision that encourages personal growth and focuses on ground-breaking, industry-first innovations.
Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high-tech projects.
Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits and more.