Key Responsibilities:
• Participate in the design, development, and testing of an open architecture, open source based, and cloud native data analytics platform product
• Explore and evaluate modern data management and MLOps components for continuous improvement of data analytics platform product
• Contribute to the design and integration of data management & data governance capabilities for the product
• Establish best practices and guidelines to be followed by engineers working on data pipelines
• Assist in the setup and maintenance of big data, machine learning and Kubernetes clusters
• Work with Data Scientists, Data Analysts, and other internal stakeholders to assist with datarelated technical issues and support their data pipeline infrastructure and data preparation needs Job
Requirements:
• Bachelor or Master’s degree computer science, software engineering, information systems or related field.
• The candidate should have at least 8 years of technical experience in Information Technology with at least 4 years, preferably 6 years in Big Data, Data Warehousing or Business Intelligence technology with knowledge of analytics and AI technologies
• Broad knowledge of various aspects of Big Data with good understanding and hands-on experience in Hadoop based technologies such as HDFS, Hive, Spark, Kafka etc.
• Deep understanding of relational, NoSQL, NewSQL database technologies such as PostgreSQL, Oracle DB, CitusDB, SingleStore, Cassandra, MongoDB, Neo4J etc.
• Good knowledge in programming languages such as Java, Python or Scala on Linux/Windows platforms.
• Experience in Kubernetes and Kubeflow is a plus point
• Experience in Big Data visualization and reporting software.
• Experience in designing ETL/BI solutions.
• Experience in DevOps and DataOps
• Familiar with Linux/UNIX system administration
• Experience in operational support in delivering Big Data solutions.
• Effective oral and written communication with strong analytical, problem solving, multitasking and project management skills are essential on the job.