Own the end-to-end architecture, deployment, and lifecycle management of the Databricks platform on AWS
Optimize platform performance, scalability, cost-efficiency, and security
Partner with DevOps and cloud infrastructure teams to uphold reliability and compliance standards
Design and architect Unity Catalog integration with enterprise metadata solutions like Atlan
Configure platform integrations with AWS-native services, data science platforms (e.g., POSIT), and multiple notebook environments
Establish and codify development best practices for data engineering, notebooks, and secure data sharing
Collaborate across engineering, governance, and business teams to align technical strategy with stakeholder needs
Lead architectural planning and delivery coordination alongside security, governance, and analytics teams
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
8+ years of experience in data platform engineering, including 4+ years managing Databricks environments
Deep familiarity with data catalog tools (Atlan or similar)
Proficient in Spark, Python, SQL , and AWS services such as S3, IAM, CloudWatch
Strong understanding of data security and governance frameworks
Excellent communication skills and stakeholder management abilities
Thanks
Jay
628-215-2224
jay.s@brillius.com
...Mathematics - Adjunct (Pool) Hartwick College is accepting applications on a continuing basis for instructors who are qualified to teach Statistics. Qualifications include a PhD in Mathematics, with a preference for candidates with experience teaching students at...
Seeking a Registered Nurse (RN) Maternal-Newborn for a night shift in El Paso, Texas. Provide direct nursing care in the Mother Baby Nursery following established policies and procedures. Collaborate with patients, families, and healthcare team to assess, plan, implement...
...Licensed Marriage and Family Therapist (LMFT) $75 K-85K/yr Position Requirement: Full-Time and Part-time Positions Available If you are looking for a new opportunity to grow with a clinician founded and clinician led organization, look no further! As an authentic...
...We are hiring immediately for a part time AMBULATORY SERVICES HOUSEKEEPER position. Location : UPMC - 2 Jennifer Court, Carlisle, PA 17015 Note: online applications accepted only . Schedule : Part time schedule. Monday - Friday, 6:00 pm - 8:00 pm. More...
...for Progress Charter School (Pennsylvania) Spur, a digital staffing agency , seeks dedicated and punctual Paraprofessionals to... ...app. # Pass a background check and complete the required online training. # Begin your assignment. Perks & Benefits...