• PySpark Lead Developer

Location Karnataka Bangalore
Experience Range 10 - 12 Years
Not active

Skills ETL pipelines and proficiency in PySpark, PySpark and SQL
Job Description
About Us
EVRY India and EVRY USA are wholly owned subsidiaries of TietoEVRY, a leading digital services and software company headquartered in Finland with annual revenues of around USD 3.3 billion. TietoEVRY employs around 24,000 experts globally and is recognized as the #1 IT services and #1 financial services company in the Nordics. TietoEVRY serves thousands of enterprises and public sector customers in more than 90 countries. We foster a culture of continuous learning and focus on helping our customers in accelerating their digital journey to scale business advantage. Be it talent, speed to market, innovation, or cross-pollination of ideas across markets, TietoEVRY leverages USA and India operations to compete locally as well as globally.
About EVRY USA
EVRY USA delivers IT services to a wide range of customers in the USA through its global delivery centers and India offices (EVRY India) in Bangalore & Chandigarh, India. We offer a comprehensive IT services portfolio and drive digital transformation across Banking & Financial Services, Insurance, Healthcare, Retail & Logistics, and Energy, Utilities & Manufacturing sectors. EVRY India's process and project maturity is very high — the two offshore development centers in India are appraised at CMMI DEV Maturity Level 5 & CMMI SVC Maturity Level 5 and certified under ISO 9001:2015 & ISO/IEC 27001:2013
Roles and Responsibility

Lead ETL Developer

 

Job Description:

We are looking for a Lead ETL Developer to join our C3 Data team based in Bangalore. This role offers a unique opportunity to work on Clarivate Customer Cloud (C3) and make rich content available across the Clarivate platform to all customers. As the Lead ETL Developer, you will support the data team by loading new content to Clarivate Customer Cloud, and you will have the chance to work with modern, cutting-edge big data technologies. Our team has expertise in Python, Spark, Databricks, EMR, PySpark, Airflow, AWS, and we would love to speak with you if you have experience in Spark, Databricks, or PySpark.

About You:

         5+ years of experience in building ETL pipelines and proficiency in PySpark.

         Strong SQL and non-SQL database skills.

         Proficient in Python3 and experience with Apache Spark and/or Databricks.

         Passionate about code and software architecture.

         Strong communication skills at all levels and excellent interpersonal skills.

         Self-motivated and confident in working on projects independently or as part of a team.

         Enthusiastic about expanding knowledge and learning new skills.

         Committed to quality work and attention to detail.

It would be a plus if you have experience in:

         Docker

         AWS services: EC2, ECS, RDS, EMR, S3

         ElasticSearch, Presto, Snowflake

         Oracle, PostgreSQL

         Trifacta

Key Responsibilities:

         Providing technical leadership and guidance, evaluating various technologies to balance business needs and cost-effectiveness.

         Collaborating with business and IT teams to design and implement a data lake platform.

         Maintaining the overall solution architecture for the data lake platform.

         Establishing technical best practices for big data management and solutions, from technology selection to architecture and implementation.

         Ensuring all components of the data lake platform meet SLAs.

         Leading technical investigations, POCs, and hands-on coding to make technical recommendations.

         Mentoring and coaching team members to enhance their technical and professional skills.

 

Recruiter Name Sonal Palam
Recruiter Email Id sonal.palam@tietoevry.com
A+| A| A-