Job Description

Position: Senior Data Engineer (PySpark + Databricks + Oracle/PostgreSQL Migration)

Location: 5800 Windward Parkway, Alpharetta, GA 3000 (Only Locals) 3 Days onsite

Job type: Contract

Exp Level: Min 9+ Years

• Expert-level proficiency in PySpark and Databricks.
• Primary Skill Focus: PySpark, Databricks (Hands-on coding test expected)

Skills Required:

1. RDBMS Expertise:

• Strong hands-on experience with Oracle and PostgreSQL databases.
• Deep understanding of database architecture, design, indexing, and performance tuning.
• Expert-level SQL skills: queries, stored procedures, functions, triggers, and views.

2. Database Migration

• Proven experience in end-to-end database migration projects (preferred: Oracle → PostgreSQL).
• Strong ability to perform data mapping, transformation, validation, and reconciliation.
• Experience using migration tools, scripts, and automation frameworks.

3. Data Engineering & Analysis

• Advanced proficiency in Databricks for large-scale data processing.
• Expert in PySpark and Python for data transformation and analytics.
• Ability to build, enhance, and optimize complex ETL/ELT data pipelines.

4. Job Scheduling & Automation

• Experience creating and maintaining Databricks jobs for scheduled reporting.
• Familiarity with workflow orchestration tools (Airflow, ADF, Step Functions, etc.).

5. Performance Optimization

• Strong background in performance tuning for Oracle and PostgreSQL.
• Experience with index strategies, query optimization, execution plan analysis, and caching.

6. Cloud Platforms

• Good understanding of AWS Cloud, including RDS, S3, EMR, Lambda, Glue, or similar services.

Job Tags

Similar Jobs