| Job Description | Details |
|---|---|
| Company Name | SparkCognition |
| Post Name | Data Engineer |
| Employment Type | Full time |
| Job Location | Bengaluru, Karnataka, India |
| Expected CTC | 5.1 LPA |
| Vacancy | Not specified |
| Starting Date of Online Application | Not specified |
| Last Date of Online Application | Not specified |
Job Summary:
SparkCognition, Inc. delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We partner with the world’s industry leaders to analyze, optimize, and learn from data. We augment human intelligence, drive profitable growth, and achieve operational excellence. SparkCognition’s Renewable Suite is the world’s leading AI-enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever-growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise.
Position Summary:
As a Data Engineer, you will be working closely with team members across domains with deep technical skills and passion for clean energy. You will be responsible for bringing large volumes of data from wind, solar, and storage sites to the cloud, architecting scalable data ETL and MLOps pipelines and workflows, and working on engineering projects to design, construct, install, test, and maintain highly scalable data management systems.
Responsibilities:
- Bring large volumes of data from wind, solar, and storage sites to the cloud.
- Architect scalable data ETL and MLOps pipelines and workflows.
- Work on engineering projects to design, construct, install, test, and maintain highly scalable data management systems.
Required knowledge, skills, and abilities:
- Graduate with a degree in computer science, statistics, informatics, information systems, or another quantitative field.
- Experience with Python.
- 2+ years of experience building and optimizing ‘big data’ data pipelines, architectures, and data sets. Startup experience is a plus.
- Experience building ETL pipelines from large disconnected datasets.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational databases such as Postgres.
- Experience with Elasticsearch is a plus.
Desired Skills:
- Experience in renewable energy or IoT time series data.
- Experience in workflow orchestration technologies like Airflow or Prefect.
- Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift, or experience with GCP.
About SparkCognition:
SparkCognition is an equal opportunity employer, dedicated to diversity, equality, and inclusion, and provides equal employment opportunities to all employees and applicants for employment. SparkCognition prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. SparkCognition is committed to providing reasonable accommodations throughout the recruiting process.
This table and information should provide a clear overview of the data engineer position at SparkCognition in Bengaluru, Karnataka, India.
Important Notice and Disclaimer:- CareerBoostZone platform is a free Job Sharing platform for all the Job seekers. We don’t charge any cost and service fee for any job which is posted on our website, neither we have authorized anyone to do the same. Most of the jobs posted over Seekajob are taken from the career pages of the organizations. Jobseekers/Applicants are advised to check all the details when they apply for the job to avoid any inconvenience.
