Databricks Engineer Job at AI Talent Flow, New York, NY

RTdLY0NnS0dJR2NYem1YM3lJNjhmWEZoRGc9PQ==
  • AI Talent Flow
  • New York, NY

Job Description

AI TalentFlow: Databricks Engineer

About AI TalentFlow:

AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power those organizations. Our success is intertwined with your success, and we are committed to fueling the innovative spirit of our clients with top-tier talent in AI, Data, Analytics, Product, and Agile.

About the Role:

Are you a passionate data engineer with deep experience in the financial services industry? Do you thrive in a fast-paced environment and possess a strong understanding of data pipelines, machine learning, and cloud platforms? If so, this role might be the perfect fit for you!

In this exciting opportunity, you will play a critical role in leveraging data to drive innovation within the financial services sector. You will collaborate with business stakeholders, data scientists, and software engineers to design, develop, and implement efficient and scalable data pipelines on Databricks. You will also be responsible for identifying and building valuable use cases for data within the financial services domain (e.g., trading, broker-dealer, asset management, investment management). This role offers the chance to make a real impact by contributing to the development of robust and repeatable data-driven solutions that deliver tangible business value.

Responsibilities:

  • Partner with business stakeholders to understand their data needs and identify high-impact use cases for data within the financial services industry.
  • Design, develop, and implement efficient and scalable data pipelines using Apache Spark on Databricks.
  • Develop and maintain data pipelines for various financial services domains, such as trading, risk management, portfolio analysis, and regulatory compliance.
  • Perform data cleaning and transformation tasks to ensure data quality and consistency.
  • Build robust and reusable data pipelines that adhere to best practices and coding standards.
  • Collaborate with data scientists to prepare data for machine learning models.
  • Develop and integrate Python scripts and SQL queries for data manipulation and analysis.
  • Leverage cloud platforms like AWS and Snowflake for data storage and integration.
  • Monitor and maintain data pipelines to ensure smooth operation and identify potential issues.
  • Stay up-to-date on the latest advancements in data engineering technologies and financial services trends.
  • Document data pipelines and processes for clear communication and knowledge sharing.

Qualifications:

  • 3+ years of experience as a Data Engineer or related role.
  • Strong understanding of data warehousing concepts and data modeling principles.
  • Extensive experience with Apache Spark and Databricks (or similar data processing frameworks).
  • Proficiency in Python and SQL, with experience in data manipulation and analysis libraries.
  • Experience building data pipelines for the financial services industry (e.g., trading, broker-dealer, asset management, investment management) is a strong plus.
  • Familiarity with cloud platforms like AWS and Snowflake for data storage and integration.
  • Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
  • A passion for learning and staying up-to-date on the latest advancements in data engineering technologies.

Ready to join a dynamic team and leverage your expertise to shape the future of financial services? We encourage you to apply!

Job Tags

Contract work,

Similar Jobs

Signature HealthCARE of Roanoke Rapids

Social Services Assistant Job at Signature HealthCARE of Roanoke Rapids

 ...across the continuum of care: skilled nursing, rehabilitation, assisted living, memory care, home health, cognitive care, and telemedicine...  ...Modern Healthcares "Best Places to Work!" Overview : As a Social Service Staff you will assist the Social Services Director/... 

Liberty Burger @ Forest Lane

Cashier / Food Runners Job at Liberty Burger @ Forest Lane

 ...the business~Maintain a clean and tidy work area~Accurately take orders and enter them in the POS System~Accurately process all cash and credit payments~Provide exceptional customer service, alwaysQualifications~Basic mathematical skills~People skills~... 

Penn State Health

Psychology Intern - Psychiatry Administration Job at Penn State Health

 ...and psychiatric disorders. MINIMUM QUALIFICATION(S): Current enrollment in or completion of all requirements for a Clinical Psychology Doctoral Program required. Two (2) years of prior practice or externship experience required. Graduate level experience in... 

Harbin Ford

Automotive Service Pickup and Delivery Driver-Part Time Job at Harbin Ford

 ...a career in the industry, apply today!Responsibilities* Pick up and deliver service customers vehicles daily* Works collaboratively...  ...transportation to and from work every single day* Valid driver's license and clean driving record We are an equal opportunity... 

Catholic Funeral & Cemetery Services

Customer Service Funeral Assistant Part Time Job at Catholic Funeral & Cemetery Services

 ...Immediate Hire PART TIME 20-30 Hours per week $17.50/hr Queen of Heaven Cemetery Lafayette You will be work closely with the Funeral Director in assisting...  ...FLEXIBILTY TO WORK ALL SHIFTS: DAYS, EVENINGS AND OCCASIONAL SATURDAY MUST HAVE EXCELLENT...