company_logo

Data Engineer

SparkCognition

Updated on: 03 August 2024

Additional Details

Work Location

Bengaluru, India

location

Job Type

FTE

job_type

Batch

Experience

batch

Stream Required

With desired skills

stream

Salary

12 LPA (Expected)

salary

Job Description

Position Summary:

SparkCognition’s Renewable Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our platform works across multiple asset types such as wind, solar, storage and DC coupled assets to offer insights to our customers across their fleets. As a Data Engineer you will be working closely with team members across domains with deep technical skills and passion for clean energy.

Join us in:

  • Bringing large volumes of data from wind, solar, storage sites to cloud
  • Architecting scalable data ETL and MLOps pipelines and workflows 
  • Work on engineering projects to design, construct, install, test and maintain highly scalable data management systems

You’ll have:

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 
  • Experience with Python
  • 2+ years of experience building and optimizing ‘big data’ data pipelines, architectures 
    and data sets. Startup experience a plus
  • Experience building ETL pipelines from large disconnected datasets. 
  • Experience with big data tools: Hadoop, Spark, Kafka, etc. 
  • Experience with relational databases such as Postgres
  • Experience with Elasticsearch a plus

It would be great if you had: 

  • Experience in renewable energy or IoT time series data
  • Experience in workflow orchestration technologies like Airflow or Prefect
  • Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift or experience with GCP

Disclaimer: The Job Company is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.

Important: If an employer asks you to pay any kind of fee, please notify us immediately. The Job company does not charge any fee from the applicants and we do not post any jobs where companies ask candidates to pay.

Click on the Apply Now button to apply for SparkCognition

Jobs you might like

Research Internship

IIT, Bombay

Mumbai, India

23 August

Software Engineer Intern

Enterpret

Bengaluru, India

23 August

Intern - Administration & Operations, TA, HR, Finance and Project Management

Data Axle

Pune, India

23 August

Java Springboot Developer Intern

Webknot Technologies

Bengaluru, India

23 August

Software Engineer

Makoons Play School

Delhi, India

23 August

Developer Intern - Big Data and Cyber Security

Arctic Wolf

Bengaluru, India

23 August

SDE Frontend Intern

Upstox

Bengaluru, Mumbai

22 August

SDE Intern

Upstox

Bengaluru, Mumbai

22 August

Backend Intern

FRND

Bengaluru, India

22 August

Trainee Software Engineer

Avasoft

Chennai, India

22 August

Intern Btech/Mtech

Philips [Last Date - 25 August 2025, 11:59 PM]

Pune, India

22 August

Apprentice 2025 program

Philips [Last Date - 24 August 2025, 11:59 PM]

Pune, India

22 August

Application Support Engineer

Accenture

Bengaluru, India

22 August

Software Engineer

HCL Tech

Hyderabad, India

22 August

Intern - Software Engineer

MRI Software

Baroda, India

21 August

Software Engineer Intern

Payoneer

Gurgaon, India

21 August

Intern – Agentic AI & Emerging Tools

Air India SATS (AISATS)

Delhi, Hyderabad, Bengaluru

21 August

Software Engineer Internship

Cloudzies

Work-from-home/Remote

21 August

Graduate Engineer Trainee

Rockwell Automation

Bengaluru, India

21 August

Graduate Virtual Career Fair - Multiple-Roles

Superset Varsity

Bangalore, Chennai, Coimbatore, Hyderabad, Kochi, Kolkata, Pune, Mumbai

21 August

IC Validator Engineering Apprenticeship

Synopsys

Hyderabad, India

21 August