Sr. Data Engineer - Databricks Job at Brooksource, Chicago, IL

RkxHZUN3Q0FMV2tUeVdUd3g0bTRmWEZqQ2c9PQ==
  • Brooksource
  • Chicago, IL

Job Description

Sr. Data Engineer

Contract to Hire

100% Remote

 

About the role:

The Lead Data Engineer will support the design, development, and maintenance of data sourcing, ingestion, and transformation solutions that will be utilized in reporting & analytics, data science, and other consuming applications. This position will collaborate with IT team members and business stakeholders to identify required data sourcing to serve the business needs. You will support the ingestion and transformation pipelines in addition to contribute to the design of the data warehouse. This role is customer-focused and fast-paced, with a goal to empower the business users with a state-of-the-art platform to rapidly gain insights through data.

 

Primary Directives:

· Develop technical data solutions for long-term growth.

· Collaborate with software engineers to design and develop solutions that meet the business requirements.

· Design, develop, implement, test, deploy, monitor, and maintain the delivery of data in a systematic method.

· Ensure successful delivery of data and information in support of the organization’s reporting & analytics.

· Create data migrations, processes, and designs that support data analysis and reporting.

· Control high-volume production environments while maintaining compliant databases and application servers.

· Perform data analysis and profiling of raw data sources.

· Provide guidance and direction to support/development resources.

· Communicate with other BI and IT team members to support and coordinate activities.

· Assist with project identification and effort estimates for ETL development of new data sources.

· Provide guidance, direction, and requirements to develop a platform that will render a blueprint, template, and guardrails to engineers and data analytics teams to get started quickly.

· Design automation of pipelines and other data projects to establish a mechanism for proactive fault detection and mitigation.

· Evaluate new tools, new techniques, and strategies for delivering high quality data to users.

· Initiate documentation, knowledge-sharing, and creating of operating procedures.

· Assist with training end users on acquiring necessary data.

Skillset Required:

·5+ years of experience in the design and development of data pipelines, data marts, and data warehouses.

· Excellent analytical and problem-solving ability with strong attention to detail and accuracy.

· Excellent understanding of data warehousing concepts and dimensional data modeling.

· Hands-on experience with troubleshooting performance issues and fine-tuning queries.

· Strong ability to handle multiple tasks and adapt to evolving business and technical environments.

· Self-starter with the ability to work independently, take initiative, and learn new skills.

· Excellent written and oral communication skills, with the ability to articulate complex processes to individuals of varying technical abilities.

· Firm knowledge of data engineering tools including version control systems using Git, Bitbucket, SVN, or Team Foundation.

· Proficient in the programming languages: Python or PySpark, and SQL. Expect to write code.

· Experience in Microsoft SQL Server, SSIS, AWS Data Pipeline, DBT and Databricks.

· Bachelor’s Degree in computer science or equivalent experience required.

Sr. Data Engineer - Databricks Chicago, IL

For over 16 years, Brooksource has established and maintained relationships that are designed to meet your IT staffing needs. Whether it’s contract, contract-to-hire, or permanent placement work, we customise our search based upon your company’s unique initiatives, culture and technologies. With our national team of recruiters placed at 21 major hubs around the nation Brooksource finds the people best-suited for your business. When you work with us, we work with you. That’s the Brooksource promise.

Brooksource is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth, lactation and related medical conditions), gender identity or gender expression, sexual orientation, marital status, military service and veteran status, physical or mental disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances.

Benefits & Perks:

Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.

Pay Disclaimer:

The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

JO-2404-145738

Job Tags

Contract work, Local area, Remote job,

Similar Jobs

Headhunter Insider

Senior Food Scientist Job at Headhunter Insider

 ...Senior Food Scientist We are seeking a highly experienced and innovative Senior Food Scientist to lead technical support and product development initiatives within a dynamic food manufacturing environment. This role serves as a critical liaison between cross-functional... 

Capital One

Director, Enterprise Know Your Customer (KYC) Compliance Program Job at Capital One

 ...Overview Director, Enterprise Know Your Customer (KYC) Compliance Program The Director, Anti-Money Laundering (AML) Leader for Capital Ones Enterprise Know Your Customer (KYC) program performs a key risk management leadership role in ensuring compliance with KYC... 

Giant Noise Partners, LLC

Art Director Job at Giant Noise Partners, LLC

 ...Department: Creative Reports to: Senior Creative Director About the Role Giant Noise is looking for an Art Director who can bring big ideas to life while guiding a growing team of creative talent. This role is perfect for someone who thrives in a fast-moving... 

The Laurels of Pender Careers

Assistant Director of Nursing (ADON) Job at The Laurels of Pender Careers

 ...exception.Position SummaryAs an Assistant Director of Nursing, you will assist the Director of Nursing in planning, coordinating, and managing the nursing department. You may alsoprovide infection prevention management. This leadership role is ideal for an RN who is... 

Axiom Professional Solutions

Auto Parts Delivery Driver Job at Axiom Professional Solutions

 ...Currently looking for Delivery Drivers with their own Cargo van (high roofs preferred) in the Greater Houston area market to make local auto parts deliveries. Paid Weekly!! Apply by going to link - Vehicles required Cargo Vans ( Extended High Roofs Preferred)...