ETL Data Platform Developer Job at Cloud Analytics Technologies LLC, Redmond, WA

a1JVUTdERlo3TVZCL29BQm5IeitFT1lHUXc9PQ==
  • Cloud Analytics Technologies LLC
  • Redmond, WA

Job Description

Summary

Role : ETL Data Platform Developer

Location : Redmond, WA (Onsite )


Key Responsibilities
Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory.
Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
Ensure data quality, lineage, and governance across all ingestion and transformation processes.
Collaborate with product teams to understand data needs and deliver scalable solutions.
Optimize performance and cost across storage and compute layers.

Required Qualifications
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Strong expertise in:
Executive written and oral communication
Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
Power BI and/or other visualization tools
SQL, Python and PySpark/ Scala
Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).
Proven ability to build metadata driven architectures and reusable components.
Familiarity with agent based architectures and conversational AI integration is a plus.
Strong understanding of data modeling, data governance, and security best practices.

Job Tags

Similar Jobs

Unified Government of Wyandotte CountyKansas City, KS

Planner (Planning & Permit Review)- Urban Planning Job at Unified Government of Wyandotte CountyKansas City, KS

 ...identity and employment eligibility. Job Description: The Planner performs entry-level professional planning support within the Department of Planning and Urban Development. The role is responsible for assisting with development review, zoning compliance, and... 

La Familia Insurance

Fiesta Bilingual Call Center Agent Job at La Familia Insurance

 ...Manage large amounts of inbound and outbound calls in a timely manner Identify customers'...  ...records of all conversations in our call center database in a comprehensible way...  ...Shift: ~8 hour shift ~ Day shift ~ Evening shift Work setting: ~ In-person... 

NavitsPartners

Equal Employment Opportunity (EEO) Investigator - EEOI 26-06297 Job at NavitsPartners

 ...Job Title: Equal Employment Opportunity (EEO) Investigator Location: New York, NY Duration: 13 Weeks Schedule: Full...  ...investigative processes. Collaborate with Human Resources, Legal, Compliance, and operational leadership teams as needed.... 

OptiMindHealth

Licensed Mental Health Professional (LPC/LMFT/LCSW) - Lakewood, OH (REMOTE) Job at OptiMindHealth

 ...Licensed Mental Health Professional (LCSW/LMFT/LPC) $60 K-$85K/yr Position Requirement: Remote Full-Time and Part-time Positions Available FLSA Status: Exempt Location: Lakewood, OH Salary:60K - 85K+ Work from Home! Competitive, negotiable salary!... 

Confidential

Electrician I Job at Confidential

 ...What You Can Expect As our Electrician I at Ohio State University, you will install, operate, troubleshoot, maintain, and repair utility low, medium, and high voltage electric utility plant, generation, and distribution systems under the general supervision of higher...