Data Engineer - GenAI

Role- Data Engineer - GenAI

Skills Required- LLM, Langchain, Asynchronous Processing. API Integration, Pyspark, Scala spark, Hive, Kafka, Big Data modeling and architecture, Python/Scala programming and SQL

Location-Pan India

Year of Experience-10 to 18 years

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

• GenAI and LLMs expertise
• Strong programming skills in Python; familiarity with PyTorch, TensorFlow, Scikit-learn, LangChain, HuggingFace
• Experience with ML frameworks
• Designing, developing, and deploying GenAI models
• Prompt engineering and LLM tools/orchestration
• Retrieval-Augmented Generation (RAG)
• Hands-on cloud experience (Azure Databricks, other platforms)
• DevOps knowledge
• Experience building APIs and deploying models with FastAPI
• Knowledge of GenAI frameworks

Good-to-Have

• Understanding of AI governance principles (compliance, security, explainability, monitoring)
• Solid foundation in MLOps practices (CI/CD, versioning, monitoring, automation)
• Experience with LLMOps
• Understanding of GIT and similar tools
• Knowledge of data engineering concepts