Data Engineer jobs in India

We are looking for an Engineer II to join our growing team of data experts. This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics.

Data Engineer (Infomatica, Data warehouse - ETL, AWS) and Technical Account Manager roles.

As a BAU Data Engineer, this position will be responsible for managing and organising data, making it accessible for business operations within the insurance industry.

This is a 12 months agency contract role - renewable/extendable contract.

Location - Hyderabad, India.

Job Description-

For a Data Engineer with skills in Informatica, Data Warehouse - ETL, and AWS, the required skill set typically includes the following:Exp- 8+ years
Location- Mumbai (Andheri East)

1. Informatica

• Proficiency in Informatica PowerCenter, Informatica Cloud, or other relevant Informatica tools.
• Ability to develop and maintain ETL mappings, sessions, and workflows using Informatica.
• Experience in data transformation, cleansing, and validation processes.
• Understanding of Informatica performance tuning techniques to optimize load performance.
• Knowledge of metadata management and data quality tools within the Informatica ecosystem.

2. Data Warehouse & ETL

• Strong understanding of data warehousing concepts like star schema, snowflake schema, dimension tables, and fact tables.
• Proficiency in designing and developing ETL pipelines for data integration.
• Experience with SQL and PL/SQL for querying and managing relational databases.
• Knowledge of data modeling, including dimensional modeling and normalization techniques.
• Ability to manage large-scale data migration projects.

3. AWS (Amazon Web Services)

• Experience with AWS Data Services, including:
  • Amazon Redshift for data warehousing.
  • AWS Glue for ETL jobs.
  • Amazon S3 for data storage and integration.
  • Amazon RDS and Aurora for relational database services.
• Proficiency in AWS Lambda for serverless computing, particularly for data processing.
• Knowledge of IAM (Identity and Access Management) for managing AWS permissions.
• Familiarity with CloudFormation or Terraform for automating infrastructure deployment.
• Experience with monitoring and logging on AWS using CloudWatch or other third-party tools.

4. General Data Engineering Skills

• Strong problem-solving skills and ability to troubleshoot data pipeline issues.
• Knowledge of big data tools like Apache Spark, Hadoop, or Kafka is a plus.
• Familiarity with version control systems like Git.
• Experience with Agile or Scrum development methodologies.
• Understanding of DevOps principles, particularly for CI/CD pipelines involving data engineering processes.

Additional Skills (Optional but Beneficial)

• Python or Java for scripting and automation in data workflows.
• Experience with Docker or Kubernetes for containerizing data applications.
• Knowledge of data governance and data security best practices.

This skill set makes you highly competitive in roles that involve designing and building robust data pipelines, optimizing data warehousing solutions, and integrating AWS cloud services.

As a Software Engineer, you'll be a key part of a team improving a discrete set of tools and processes into a repeatable, automated, and audited pipeline to better onboard and process data for clinical trials. You will be working with clinical counterparts to improve their work pipeline as well as automating system validation and documentation efforts for a low-friction rigorous product.

As a Data Engineer you will be developing and maintaining data infrastructure and writing, deploying, and maintaining software to build, integrate, manage, maintain, and quality-assure data

As a Product Champion, you'll leverage your creativity, analytical abilities, and leadership from day one. Collaborate with skilled product managers, designers, and data engineers to create world-class analytics products that tackle major customer challenges and transform teamwork. This is an exciting chance to lead the analytics domain as a PM, shaping how companies engage with and connect their employees across the platform.

As Manager, you will play a key leadership role in the strategy and execution of automated evidence-generating studies.

You will lead a team of clinical data analytics engineers through the design and implementation of data pipelines to acquire, process, and review complex clinical data from sites participating in clinical studies.

Job Summary:We are seeking a highly skilled and experienced Data Analyst/Scientist to join our team. The ideal candidate will have a strong background in data analysis and programming, with expertise in both Python and SAS. This role involves analyzing complex data sets, developing predictive models, and providing actionable insights to drive business decisions.

Key Responsibilities:

• 
  
  Data Analysis:
  • Collect, clean, and preprocess large datasets from various sources.
  • Perform exploratory data analysis (EDA) to uncover trends, patterns, and insights.
  • Apply statistical techniques and advanced analytical methods to solve business problems.
• 
  
  Programming:
  • Develop and maintain scripts and programs in Python and SAS.
  • Automate data processing and analysis workflows using Python and SAS.
  • Implement and optimize predictive models using machine learning techniques.
• 
  
  Reporting and Visualization:
  • Create interactive dashboards and reports using tools such as Tableau, Power BI, or similar.
  • Present findings and insights to stakeholders through clear and concise visualizations.
• 
  
  Collaboration:
  • Work closely with cross-functional teams, including business analysts, data engineers, and other stakeholders.
  • Provide technical guidance and mentorship to junior team members.
• 
  
  Continuous Improvement:
  • Stay up-to-date with the latest trends and technologies in data science and analytics.
  • Propose and implement improvements to existing processes and methodologies.

Qualifications:

• 
  
  Education:
  • Bachelor's or Master's degree in Computer Science, Statistics, Mathematics, Data Science, or a related field.
• 
  
  Experience:
  • Proven experience in data analysis, statistical modeling, and programming.
  • Strong proficiency in Python and SAS.
  • Experience with data visualization tools and techniques.
  • Familiarity with machine learning frameworks and libraries (e.g., scikit-learn, TensorFlow, etc.).
• 
  
  Skills:
  • Excellent problem-solving and analytical skills.
  • Strong attention to detail and accuracy.
  • Ability to communicate complex technical concepts to non-technical stakeholders.
  • Strong organizational and project management skills.

Preferred Qualifications:

• Experience in the [insert relevant industry, e.g., finance, healthcare, marketing, etc.] industry.
• Knowledge of big data technologies (e.g., Hadoop, Spark).
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).

Location - Pune, Mumbai