Databricks Cloud Data Engineer Job at Open Systems Technologies, Inc., Richmond, VA

RkxHZkR3ZUhKMmtWeTIvenhvdTZlSEZsRFE9PQ==
  • Open Systems Technologies, Inc.
  • Richmond, VA

Job Description

A financial firm is looking for a Databricks Cloud Data Engineer to join their team in Richmond, VA or Remote. 

Pay: $85-90/hr

Responsibilities:
  • Understand technology vision and strategic direction of business needs
  • Understand our current data model and infrastructure, proactively identify gaps, areas for improvement, and prescribe architectural recommendations with a focus on performance and accessibility.
  • Partner across engineering teams to design, build, and support the next generation of our analytics systems.
  • Partner with business and analytics teams to understand specific requirements for data systems to support both development and deployment of data workloads ranging from Tableau reports to ad hoc analyses.
  • Own and develop architecture supporting the translation of analytical questions into effective reports that drive business action.
  • Automate and optimize existing data processing workloads by recognizing patterns of data and technology usage and implementing solutions.
  • Solid grasp of the intersection between analytics and engineering while maintaining a proactive approach to assure solutions demonstrate high levels of performance, privacy, security, scalability, and reliability upon deployment.
  • Provide guidance to partners on effective use of the database management systems (DBMS) platform through collaboration, documentation, and associated standard methodologies.
  • Design and build end to end automation to support and maintain software currency
  • Create automation services for builds using Terraform, Python, and OS shell scripts.
  • Develop validation and certification process through automation tools
  • Design integrated solutions in alignment with design patterns, blueprints, guidelines, and standard methodologies for products
  • Participate in developing solutions by incorporating cloud native and 3rd party vendor products
  • Participate in research and perform POCs (proofs of concept) with emerging technologies and adopt industry best practices in the data space for advancing the cloud data platform.
  • Develop data streaming, migration and replication solutions
  • Demonstrate leadership, collaboration, exceptional communication, negotiation, strategic and influencing skills to gain consensus and produce the best solutions.
  • Engage with Senior leadership, business leaders at Client and the Board to share the business value.
Qualifications:
  • Demonstrates mutual respect, embraces diversity, and acts with authenticity
  • Bachelor's degree in Computer Science, Management Information Systems, Computer Engineering, or related field or equivalent work experience; advance degree preferred
  • Seven or more years of experience in designing and building large-scale solutions in an enterprise setting in both
  • Three years in designing and building solutions in the cloud
  • Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures
  • Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures
  • Expertise in Cloud Data Warehouses in Redshift, BigQuery or analogous architectures a plus
  • Deep SQL expertise, data modeling, and experience with data governance in relational databases Experience with the practical application of data warehousing concepts, methodologies, and frameworks using traditional (Vertica, Teradata, etc.) and current (SparkSQL, Hadoop, Kafka) distributed technologies
  • Refined skills using one or more scripting languages (e.g., Python, bash, etc.)
  • Experience using ETL/ELT tools and technologies such as Talend, Informatica a plus
  • Embrace data platform thinking, design and develop data pipelines keeping security, scale, uptime and reliability in mind
  • Expertise in relational and dimensional data modeling UNIX admin and general server administration experience required
  • Presto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience a plus
  • Experience using Spark, Kafka, Hadoop, or similar distributed data technologies a plus
  • Able to expertly express the benefits and constraints of technology solutions to technology partners, business partners, and team members
  • Experience with leveraging CI/CD pipelines
  • Experience with Agile methodologies and able to work in an Agile manner is preferred
  • One or more cloud certifications

23-06256

#LI-JS1

Job Tags

Work experience placement, Remote job,

Similar Jobs

Labor Rocket, LLC.

Picker Packer Job at Labor Rocket, LLC.

 ...partnered with a largecompany that is looking for entry-level production line staff to make and package their product. As a packer...  ...**Machine Operating, Machine Operator, Production Associate, Warehouse Worker, Assembly Line, Assembly Line Worker, Automotive Industry... 

Jiminy Peak Mountain Resort LLC

2025/2026 Bell Staff Job at Jiminy Peak Mountain Resort LLC

 ...Shift Information: This position combines both 1st and 2nd shifts . Availability is required on Friday nights (2nd shift, until 11:00 PM) , Sundays (1st shift) , and holiday weeks (...  ...Friday nights (2nd shift until 11 PM) , weekends , and holiday periods . Able to... 

FHR

MO416-QA Tester 5087 Job at FHR

 ...and willingness to work in-office up to five days per week asbusiness needs necessitate Our direct client has an opening for a QA Tester5087 Thisposition is up to 12 months, with the option of extension, and is located inPhoenix, AZ. W2 only.... 

Central Bark

Canine Enrichment Attendant / Dog Handler Job at Central Bark

 ..., and common spaces. Observe and document behavior, noting any changes, incidents, or concerns to be reported to management. Assist with enrichment services, including training exercises, bathing, and one-on-one interaction sessions. Follow all company policies... 

Domino's Franchise

Delivery Driver - 13857 Queens Blvd Job at Domino's Franchise

 ...Pizza - from fresh out of the oven to the customer's door - our drivers make it happen. Money!Our delivery experts are paid cash daily from earned tips and mileage reimbursement. That is money in your pocket every night! Delivery Experts will earn a basehourly wage...