Solution Data Engineer Sr.

Must Have Skills:

English advanced

Databricks Ecosystem

o Full management of the Databricks environment

o Environment configuration and workspace administration

Governance & Storage

o Implement data governance using Unity Catalog

• o Manage structured storage with Delta Lake tables
• Development o Write and optimize data processing logic using Python, SQL, and PySpark

Version Control

o Manage code lifecycle and collaborative development using Git o Data Warehousing & Integration (Important)

Important Skills:

Snowflake o Manage data architecture, performance, and integrations within Snowflake

Adobe Data Ingestion

o Handle Adobe Data Feeds and Adobe Analytics

o Ensure correct ingestion and transformation of external marketing data

Nice to Have:

• Redshift o Oversee data warehousing operations in Amazon Redshift
• Orchestration o Use Airflow to schedule, monitor, and manage complex data pipeline workflows

Desirable:

Google Cloud Platform

• o Maintain data availability and basic operations in BigQuery
• AWS Data Services

o Manage serverless querying with Athena

o Handle metadata management with AWS Glue

Pipeline Ownership