Own the end-to-end architecture, deployment, and lifecycle management of the Databricks platform on AWS
Optimize platform performance, scalability, cost-efficiency, and security
Partner with DevOps and cloud infrastructure teams to uphold reliability and compliance standards
Design and architect Unity Catalog integration with enterprise metadata solutions like Atlan
Configure platform integrations with AWS-native services, data science platforms (e.g., POSIT), and multiple notebook environments
Establish and codify development best practices for data engineering, notebooks, and secure data sharing
Collaborate across engineering, governance, and business teams to align technical strategy with stakeholder needs
Lead architectural planning and delivery coordination alongside security, governance, and analytics teams
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
8+ years of experience in data platform engineering, including 4+ years managing Databricks environments
Deep familiarity with data catalog tools (Atlan or similar)
Proficient in Spark, Python, SQL , and AWS services such as S3, IAM, CloudWatch
Strong understanding of data security and governance frameworks
Excellent communication skills and stakeholder management abilities
Thanks
Jay
628-215-2224
jay.s@brillius.com
...Work from Home Data Entry & Office Administration Flexible Online Role About the Job Were currently hiring... ...and typing skills Independent time management Effective written communication... ...work from home Flexible hours, part-time or full-time Paid online...
...Clinical Assistant Professor in Pittsburgh, PA The Department of Ophthalmology at the University of Pittsburgh is seeking a dedicated optometrist to join our team in a high-volume, academically affiliated clinical setting. While the core of this role involves providing...
The Food Scientist II Technical Service position plays a key role within the MycoTechnology Food Applications Team. The primary responsibility... ...fit-for-purpose solutions. Monitor market trends and share industry intelligence to inform solution development. Take a hands-on...
...Boston University Academy is seeking a full-time history teacher to begin in July 2026as a one-year leave replacement. Primary responsibilities include teaching three to foursections of history. Course placements are still being developed for next year, and wehave some...
...Westinghouse's mission to provide clean energy solutions? At WECTEC Staffing Services, a wholly-owned subsidiary of Westinghouse Electric Company LLC, we recognize that our employees are our most valuable asset and we seek to identify, attract and recruit the most...