Loading profile…
Saivijitha User
Open to opportunitiesSenior Data Engineer
Experienced Senior Data Engineer specializing in ETL and cloud solutions.
United StatesSenior Data Engineer at Conifer Health Solutions
About
I am a Senior Data Engineer with over 4 years of experience in the Finance and Healthcare sectors. My expertise lies in developing robust ETL/ELT pipelines, data acquisition, and data warehousing solutions. I have a strong background in utilizing cloud services such as AWS and Azure to create scalable data processing applications. My work with Spark applications in Azure Databricks has enabled me to extract and transform data efficiently, providing valuable insights into customer usage patterns.
Throughout my career, I have successfully designed and implemented complex data models and pipelines, ensuring compliance with industry standards such as HIPAA and GDPR. I am proficient in various programming languages including Python, Scala, and Java, and have extensive experience with tools like Tableau and Power BI for data visualization. My commitment to continuous learning and improvement drives me to adopt new technologies and methodologies, enhancing the performance and reliability of data solutions.
Experience
Senior Data Engineer
Collaborated with Business Analysts and SMEs to gather business requirements, applying problem-solving and decision-making to prioritize tasks. Developed and deployed Spark applications using Scala, PySpark, Spark Core, Spark SQL, and Spark Streaming within AWS EMR clusters, ensuring scalable processing of EHR, Healthcare, and e-commerce data pipelines in PHI-compliant environments.
SparkPySparkAWS LambdaAWS GlueSnowflakeDBTKubernetesJenkinsFigmaPCI DSSHL7 FHIRHIPAA
Data Engineer
Developed highly complex Python, Scala, and Go code for banking/finance data processing and analytics. Utilized Azure Data Factory for ETL processes, focusing on data transformation, cleansing, validation, and quality assurance, complemented by complex SQL queries using Spark SQL dataframes within Azure Databricks and BigQuery.
Education
University Of Texas at Arlington
Currently pursuing a Master of Science in Data Science, focusing on advanced data analysis, machine learning, and statistical modeling. Gaining expertise in various data science methodologies and tools.