Data Engineer jobs in India

We are looking for an Engineer II to join our growing team of data experts. This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics.

Data Engineer (Infomatica, Data warehouse - ETL, AWS) and Technical Account Manager roles.

As a BAU Data Engineer, this position will be responsible for managing and organising data, making it accessible for business operations within the insurance industry.

This is a 12 months agency contract role - renewable/extendable contract.

Location - Hyderabad, India.

Job Description-

For a Data Engineer with skills in Informatica, Data Warehouse - ETL, and AWS, the required skill set typically includes the following:Exp- 8+ years
Location- Mumbai (Andheri East)

1. Informatica

• Proficiency in Informatica PowerCenter, Informatica Cloud, or other relevant Informatica tools.
• Ability to develop and maintain ETL mappings, sessions, and workflows using Informatica.
• Experience in data transformation, cleansing, and validation processes.
• Understanding of Informatica performance tuning techniques to optimize load performance.
• Knowledge of metadata management and data quality tools within the Informatica ecosystem.

2. Data Warehouse & ETL

• Strong understanding of data warehousing concepts like star schema, snowflake schema, dimension tables, and fact tables.
• Proficiency in designing and developing ETL pipelines for data integration.
• Experience with SQL and PL/SQL for querying and managing relational databases.
• Knowledge of data modeling, including dimensional modeling and normalization techniques.
• Ability to manage large-scale data migration projects.

3. AWS (Amazon Web Services)

• Experience with AWS Data Services, including:
  • Amazon Redshift for data warehousing.
  • AWS Glue for ETL jobs.
  • Amazon S3 for data storage and integration.
  • Amazon RDS and Aurora for relational database services.
• Proficiency in AWS Lambda for serverless computing, particularly for data processing.
• Knowledge of IAM (Identity and Access Management) for managing AWS permissions.
• Familiarity with CloudFormation or Terraform for automating infrastructure deployment.
• Experience with monitoring and logging on AWS using CloudWatch or other third-party tools.

4. General Data Engineering Skills

• Strong problem-solving skills and ability to troubleshoot data pipeline issues.
• Knowledge of big data tools like Apache Spark, Hadoop, or Kafka is a plus.
• Familiarity with version control systems like Git.
• Experience with Agile or Scrum development methodologies.
• Understanding of DevOps principles, particularly for CI/CD pipelines involving data engineering processes.

Additional Skills (Optional but Beneficial)

• Python or Java for scripting and automation in data workflows.
• Experience with Docker or Kubernetes for containerizing data applications.
• Knowledge of data governance and data security best practices.

This skill set makes you highly competitive in roles that involve designing and building robust data pipelines, optimizing data warehousing solutions, and integrating AWS cloud services.

As a Software Engineer, you'll be a key part of a team improving a discrete set of tools and processes into a repeatable, automated, and audited pipeline to better onboard and process data for clinical trials. You will be working with clinical counterparts to improve their work pipeline as well as automating system validation and documentation efforts for a low-friction rigorous product.

Seeking a highly skilled and motivated Data Engineer The ideal candidate will have strong expertise in Python, Apache Spark, Apache Flink, BigQuery, Google Cloud Dataproc/ Databricks, and Confluent Kafka. Will be responsible for designing, developing, and optimizing large-scale data processing systems, enabling real-time and batch data workflows to support business intelligence and advanced analytics.

As a Data Engineer you will be developing and maintaining data infrastructure and writing, deploying, and maintaining software to build, integrate, manage, maintain, and quality-assure data

The Data Integration Engineer will lead initiatives to integrate, validate, and optimize data pipelines for clinical research using real-world data, ensuring high data quality and compliance. The role involves working with internal teams and external partners, leveraging technologies like AWS, SQL, and Python, to support healthcare research and improve medical outcomes.

You will build and mentor a team of data scientists and machine learning engineers, collaborating closely with cross-functional teams to integrate AI models and analytics tools into our ecosystem. This role involves driving innovation in how we use AI and machine learning to automate and optimize the organisation's strategies.

As a Product Champion, you'll leverage your creativity, analytical abilities, and leadership from day one. Collaborate with skilled product managers, designers, and data engineers to create world-class analytics products that tackle major customer challenges and transform teamwork. This is an exciting chance to lead the analytics domain as a PM, shaping how companies engage with and connect their employees across the platform.