Lead Data Engineer Job at Openkyber, Georgia

bHhZVzZqRlM0Y0ZBL1lBS25uei9GK0FLVEE9PQ==
  • Openkyber
  • Georgia

Job Description

Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines Build and maintain APIs to expose data to downstream applications Develop real-time streaming data pipelines Tech stack includes Airflow, Spark, Databricks, Delta Lake, and Snowflake Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and more Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)

Qualifications:

  • You could be a great fit if you have: 5+ years of data engineering experience developing large data pipelines
  • Proficiency in at least one major programming language (e.g. Python, Java, Scala)
  • Hands-on production environment experience with distributed processing systems such as Spark
  • Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Databricks, Big Query)
  • Experience in developing APIs with GraphQL
  • Advanced understanding of OLTP vs OLAP environments
  • Strong background in at least one of the following: distributed data processing or software engineering of data services, or data modeling

For applications and inquiries, contact: [email protected]

Job Tags

Similar Jobs

Dynamics ATS

Warehouse Worker Job at Dynamics ATS

 ...Clinical Engineering Standards, before delivering to Clinical Engineering. Returns equipment that is not broken to the unit or to the Delta Equipment Storage area. Restocks equipment room with supplies accurately in appropriate bin locations, when necessary. Handles... 

Solano-Napa Habitat for Humanity

Development/Fundraising Coordinator Job at Solano-Napa Habitat for Humanity

 ...Are you passionate about using data to achieve outcomes, building relationships, and fundraising? Join Solano-Napa Habitat for Humanity , a nonprofit organization whose vision is to provide access to decent, affordable housing for hard-working families. We are seeking... 

Domino's Franchise

Delivery Driver - 432 N. Circle Drive Job at Domino's Franchise

 ...Job Description Earn Money while having fun. NEVER GO HUNGRY! Delivery drivers can earn up to $15 hourly. Cash paid daily! Opportunity for advancement to management positions. Delivery drivers must be at least 18yrs old. Have a reliable car/truck with current registration... 

CRH

Seasonal Loader Operator Job at CRH

 ...Job ID: 523997 Oldcastle, a CRH company, is reinventing what's possible in building solutions. We are the leading provider of innovative outdoor living products and utility infrastructure solutions for the water, energy, and communications markets throughout North... 

Confidential

Job Opportunity: Adams Kitchen Cook - Wappinger Job at Confidential

 ...develop our staff! Adams offerspaid vacation time, paid personal/sick leave and paid holidays, allowing you to spend Thanksgiving, Christmas, New Years, Easter & more with your loved ones. Job responsibilities as a Prepared Food Cookincludes cooking food from scratch...