Sr. Data Engineer - Databricks Job at Brooksource, Chicago, IL

RkxHZUN3Q0FMV2tUeVdUd3g0bTRmWEZqQ2c9PQ==
  • Brooksource
  • Chicago, IL

Job Description

Sr. Data Engineer

Contract to Hire

100% Remote

 

About the role:

The Lead Data Engineer will support the design, development, and maintenance of data sourcing, ingestion, and transformation solutions that will be utilized in reporting & analytics, data science, and other consuming applications. This position will collaborate with IT team members and business stakeholders to identify required data sourcing to serve the business needs. You will support the ingestion and transformation pipelines in addition to contribute to the design of the data warehouse. This role is customer-focused and fast-paced, with a goal to empower the business users with a state-of-the-art platform to rapidly gain insights through data.

 

Primary Directives:

· Develop technical data solutions for long-term growth.

· Collaborate with software engineers to design and develop solutions that meet the business requirements.

· Design, develop, implement, test, deploy, monitor, and maintain the delivery of data in a systematic method.

· Ensure successful delivery of data and information in support of the organization’s reporting & analytics.

· Create data migrations, processes, and designs that support data analysis and reporting.

· Control high-volume production environments while maintaining compliant databases and application servers.

· Perform data analysis and profiling of raw data sources.

· Provide guidance and direction to support/development resources.

· Communicate with other BI and IT team members to support and coordinate activities.

· Assist with project identification and effort estimates for ETL development of new data sources.

· Provide guidance, direction, and requirements to develop a platform that will render a blueprint, template, and guardrails to engineers and data analytics teams to get started quickly.

· Design automation of pipelines and other data projects to establish a mechanism for proactive fault detection and mitigation.

· Evaluate new tools, new techniques, and strategies for delivering high quality data to users.

· Initiate documentation, knowledge-sharing, and creating of operating procedures.

· Assist with training end users on acquiring necessary data.

Skillset Required:

·5+ years of experience in the design and development of data pipelines, data marts, and data warehouses.

· Excellent analytical and problem-solving ability with strong attention to detail and accuracy.

· Excellent understanding of data warehousing concepts and dimensional data modeling.

· Hands-on experience with troubleshooting performance issues and fine-tuning queries.

· Strong ability to handle multiple tasks and adapt to evolving business and technical environments.

· Self-starter with the ability to work independently, take initiative, and learn new skills.

· Excellent written and oral communication skills, with the ability to articulate complex processes to individuals of varying technical abilities.

· Firm knowledge of data engineering tools including version control systems using Git, Bitbucket, SVN, or Team Foundation.

· Proficient in the programming languages: Python or PySpark, and SQL. Expect to write code.

· Experience in Microsoft SQL Server, SSIS, AWS Data Pipeline, DBT and Databricks.

· Bachelor’s Degree in computer science or equivalent experience required.

Sr. Data Engineer - Databricks Chicago, IL

For over 16 years, Brooksource has established and maintained relationships that are designed to meet your IT staffing needs. Whether it’s contract, contract-to-hire, or permanent placement work, we customise our search based upon your company’s unique initiatives, culture and technologies. With our national team of recruiters placed at 21 major hubs around the nation Brooksource finds the people best-suited for your business. When you work with us, we work with you. That’s the Brooksource promise.

Brooksource is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth, lactation and related medical conditions), gender identity or gender expression, sexual orientation, marital status, military service and veteran status, physical or mental disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances.

Benefits & Perks:

Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.

Pay Disclaimer:

The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

JO-2404-145738

Job Tags

Contract work, Local area, Remote job,

Similar Jobs

Talent Strategy

Mechanical Assembler Job at Talent Strategy

 ...Job Title: Mechanical Assembler Employee Type: Full-Time Shift: 1st Shift 5:00am-3:30pm, Monday through Thursday. 5:00am-1:30am on Friday. Location: Coopersville, MI 49404 Pay: Up to $24.00/hr. (pay issued based on experience) Job Tasks for an Assembler:... 

Huron Regional Medical Center

Clinical Pharmacist Job at Huron Regional Medical Center

 ...Director of Pharmacy, following all policies and regulations, the pharmacist will be responsible for accurately interpreting orders,...  ...hospital and departmental safety policies and procedures, and state/federal regulations including USP 795 Non-sterile compounding, USP 797... 

TLC Healthforce

Travel Registered Nurse Pediatrics Job Job at TLC Healthforce

Embark on a transformative travel nursing journey as a Pediatric Registered Nurse in Canton, Massachusetts, where your expertise can illuminate the path to healthier lives for every child you serve. This is more than a placementit's an opportunity to enrich your professional... 

American Red Cross

Technician I, Biomedical Equipment Job at American Red Cross

 ...Please use Google Chrome or Mozilla Firefox when accessing Candidate Home. By joining the American Red Cross you will touch millions of lives every year and experience the greatness of the human spirit at its best. Are you ready to be part of the world's largest humanitarian... 

Domino's Franchise

Delivery Driver - 12330 NC Hwy 210 suite Job at Domino's Franchise

 ...environment with a team focus on customer service Duties include delivery, learning to take phone orders and assistance with cleaning Advancement within the company to other positions if desired Cash tips paid daily with hourly averages wages at $12 to $14 per hour...