Aidan S

Open to opportunities

Lead Data Engineer

I build cloud-scale batch and real-time data platforms for analytics, operational intelligence, and machine learning.

United StatesLead Data Engineer at CareRev

Experience

Lead Data Engineer
CareRev
Lead the architecture and evolution of large-scale cloud data platforms on AWS, processing 70+ TB of data daily for analytics, operational intelligence, and ML workloads. Modernized enterprise data pipelines by migrating 200+ legacy workflows to a standardized dbt and Apache Airflow-based ELT architecture, reducing infrastructure costs by 30% and improving pipeline reliability by 60%.
AWSDBTAirflowApache SparkPySparkKafkaSnowflakeDatabricksDelta LakePartitioningIndexingCDCQuery OptimizationMonte CarloGreat ExpectationsPrometheusGrafanaData QualityData GovernanceData LineageObservabilityTechnical Leadership

Loading profile…

Open to opportunities

Lead Data Engineer

I build cloud-scale batch and real-time data platforms for analytics, operational intelligence, and machine learning.

United StatesLead Data Engineer at CareRev

Lead Data Engineer
CareRev
Lead the architecture and evolution of large-scale cloud data platforms on AWS, processing 70+ TB of data daily for analytics, operational intelligence, and ML workloads. Modernized enterprise data pipelines by migrating 200+ legacy workflows to a standardized dbt and Apache Airflow-based ELT architecture, reducing infrastructure costs by 30% and improving pipeline reliability by 60%.
AWSDBTAirflowApache SparkPySparkKafkaSnowflakeDatabricksDelta LakePartitioningIndexingCDCQuery OptimizationMonte CarloGreat ExpectationsPrometheusGrafanaData QualityData GovernanceData LineageObservabilityTechnical Leadership