Data Engineer

Blackstraw.ai logo

Blackstraw.ai

View Salaries, Reviews, and more  

Job Description

Data EngineerCompany Name: Blackstraw.aiOffice Location: Delhi (Work from Office)Job Type: Full-timeExperience: 4+ Years

Job Description

We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods.

Job Requirements :

  • Participate in the customer’s system design meetings and collect the functional/technical requirements.
  • Build up data pipelines for consumption by the data science team.
  • Skillful in ETL process and tools.
  • Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.
  • Experience in writing Python programs and SQL queries.
  • Experience in SQL Query tuning.
  • Experienced in Shell Scripting(Unix/Linux).
  • Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.
  • Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.
  • Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka
  • Suggest and implement best practices in data integration.
  • Guide the QA team in defining system integration tests as needed.
  • Split the planned deliverables into tasks and assign them to the team.
  • Needs to Maintain/Deploy the ETL code and follow the Agile methodology
  • Needs to work on optimization wherever applicable.
  • Good oral, written and presentation skills.

Preferred Qualifications :

  • Degree in Computer Science, IT, or similar field; a Master’s is a plus.
  • Hands-on experience with Python and Pyspark Or
  • Hands-on experience with Spark and SCALA.
  • Great numerical and analytical skills.
  • Working knowledge of cloud platforms such as MS Azure, AWS, etc...
  • Technical expertise with data models, data mining, and segmentation techniques

Key traits :

  • Should have excellent communication skills.
  • Should be self motivated and willing to work as part of a team.
  • Should be able to collaborate and coordinate in a remote environment.
  • Be a problem solver and be proactive to solve the challenges that come his way.

Company Profile:Conceptualized as far back as 2015, and commencing full-time operations in 2018, Blackstraw technologies Pvt Ltd. is a software products and services company specializing in Artificial Intelligence (AI) and Machine Learning solutions for various industries. We support businesses around the world, including North America, Europe and Asia, working to simplify AI implementation through our platform that expedites data labeling, AI model-training, and cloud or on-premise deployments. With more than 1000 years of combined work-experience, the 250+-strong Blackstraw Team comprises various experts in the AI value chain. We are a fast-moving team that prides ourselves in rapidly identifying different use-cases and fine-tuning our products to suit specific business needs. We are focused on providing solutions related to computer vision, natural language processing, Data annotation tools for deep learning models, etc. To stay competitive in business, it is key for organizations to adopt and implement smart AI solutions and service offerings. However, most companies are unable to implement AI rapidly due to the complexity of existing solutions, inadequate data and cost implications. Our mission is to enable enterprises to adopt AI in an easier, cost-effective and time-efficient manner with a plug-and-play approach to their data. Blackstraw operations are based out of Canada, USA & India. Our head office is based in Florida, USA

Interview Questions of Data Engineer at Blackstraw.ai

Currently, there aren't any interview questions for this role at Blackstraw.ai shared by other job seekers.
View more interview questions of similar roles from other companies →
banner icon
Prepare For Your Interview in 1 Week?
Equip yourself with possible questions that interviewers might ask you, based on your work experience and job description.
Get Started!

Salary Insights of Data Engineer at Blackstraw.ai

Currently, there aren't any salaries for this role at Blackstraw.ai shared by other job seekers.

View more salaries from Blackstraw.ai →

Achieve your dream job with our top-notch tools!

Resume Checker Illustration

Resume Checker

Our free resume checker analyzes the job description and identifies important keywords and skills missing from your resume in just a minute!

Check Now
Interview Preparation Illustration

AI InterviewPrep

Utilizing advanced AI, our tool generates tailored interview questions based on your industry, role, and experience. Practice and receive feedback on your answers in real time!

Check Now
Resume Builder Illustration

Resume Builder

Let us show you the differences between a bad, good, and great resume, and guide you in building a resume that helps you stand out to employers, ensuring you land your next position faster!

Check Now