PySpark Engineer Job at Tata Consultancy Services, Owings Mills, MD

WTJqTUQ4YnNkY3ZkWjdtdG0xTnVSQXBTMUE9PQ==
  • Tata Consultancy Services
  • Owings Mills, MD

Job Description

Role: Lead PySpark Engineer

Job type: Fulltime

Location: Owings Mill, MD

Roles & Responsibilities:

10+ years of experience in big data and distributed computing.

• Very Strong hands-on experience with PySpark, Python, Airflow, DBT & DWH concepts

• Strong Hands on experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).

• Proficiency in data modeling and ETL workflows.

• Proficiency with workflow schedulers like Airflow

• Hands on experience with AWS cloud-based data platforms.

• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.

• Strong problem-solving skills and ability to lead a team

Develop, test and maintain high-quality solutions using PySpark /Python programming language.

· Participate in the entire software development lifecycle, building, testing and delivering high-quality

data pipelines.

· Collaborate with cross-functional teams to identify and solve complex problems.

· Write clean and reusable code that can be easily maintained and scaled.

· Keep up to date with emerging trends and technologies in Python development. Design and develop

business controls using AWS Glue and PySpark

· Integrate data from various sources into Amazon Redshift

· Optimize performance of data processing jobs and fine tune queries

Salary Range: $110,000 - $115,000 a Year

Job Tags

Full time,

Similar Jobs

Dallas Behavioral Healthcare Hospital

Therapist - Art, Music or Recreational Therapy Job at Dallas Behavioral Healthcare Hospital

 ...We are searching for a qualified Activity Therapist with expertise in Art, Music or Recreational therapy. Serving as a member of the interdisciplinary treatment team, the Activity Therapist will provide therapeutic recreational and activity services to adult, adolescent... 

Advantage Technical

EH&S Technician Job at Advantage Technical

EH&S Technician Position Location: Salt Lake City, UT. Position Type: Direct Hire Position Salary: $25/HR - $32/HR (Depending on Experience) Position Shift: 3:00 PM 11:30 PM, Mon Fri Responsibilities: Reporting to the EH&S Director, the...

Swoon

Business Intelligence Developer (Power BI & Snowflake) Job at Swoon

 ...closely with business stakeholders and cross-functional teams to deliver scalable Power BI solutions and actionable insights using Snowflake and modern BI tools. With a focus on enhancing the Machine S&OP process, this is a high-impact role ideal for a highly analytical... 

Kramer Davis Health

Patient Care Specialist/MA Job at Kramer Davis Health

 ...accepted, maximize their abilities, and live happy and fulfilled lives. Responsibilities...  ...for processing patient referrals. Also, assists with prior authorizations, new patient...  ...Participate in educating patients, guardians, and caregivers with respect to issues relating to proper... 

Medsurg Sales Staffing

Sales Trainer Job at Medsurg Sales Staffing

Medical manufacturer is looking for an experienced sale trainer. You will help train the sales force across the country. REQUIREMENTS:* Must have at least two years experience as a sales trainer at either a medical company OR a large business to business company...