Senior Cloud Data Software Engineer

Now hiring! Senior Cloud Data Software Engineer

Mississauga, ON (Hybrid, 2 days in Office)

We are looking for a Senior Cloud Data Software Engineer to join our Digital Solutions (GD) team in Mississauga, ON.

Come create chemistry with us!

We as Global Digital Services enable BASF's digitalization and adoption of artificial intelligence. In agile teams, we develop innovative solutions for BASF and its customers, create new exciting customer experiences and business growth, and drive efficiencies in processes. We provide IT that works and offer know-how and access to latest technologies.

We are seeking a highly motivated and detail-oriented Senior Cloud Data Software Engineer who will be responsible for the Data Distribution with Databricks Unity Catalog and maintaining/developing CI/CD pipelines and processes in an ambitious team.

As a Senior Cloud Data Software Engineer, you create chemistry by...

• Designing, implementing and maintaining data distribution strategies using Unity Catalog with Azure Databricks and Azure Data Factory.
• Developing processes on PySpark to distribute information from the storage account using software design patterns.
• Maintaining and monitoring data distribution across various platforms and systems with Azure Data Factory.
• Developing, extending and optimizing our data distribution pipeline.
• Implementing quality control measures to ensure accuracy and consistency of data.
• Collaborating with the data science team to understand their data needs and provide suitable solutions.
• Troubleshooting data-related issues and optimize data distribution for performance and scalability.
• Developing and maintaining technical documentation related to data distribution processes.
• Testing new features and improvements in Databricks and Azure ecosystem and suggesting their implementation if beneficial.

If you have...

• A Bachelor´s degree in computer science, Information Technology, Engineering, Business, or related fields.
• Minimum 3-4 years related working experience as DataOps Engineer using Azure, Python, Azure Data Factory and Databricks.
• Very strong Python development skills.
• Experience in Agile way of working with a DevOps mindset.
• Strong knowledge in automation & scripting with tools like Azure DevOps pipelines, Azure Data Factory, etc.
• In-depth know how with Big Data concepts and Databricks.
• Strong software engineering and development skills to maintain and extend our Data Distribution Pipeline.
• Knowledge on Unity Catalog for Data Distribution through Databricks.
• Experience with event streaming, message brokers and other event driven architectures (Kafka, RabbitMQ, etc.) and familiarity with Big Data concepts.
• Managing and operating solutions via command line utilities and working to improve automation and enlist modern practices (DevOps, CI/CD, Terraform ,etc.).
• Integration knowledge between Data Catalog Collibra and Big Data Platforms.
• Vendor certifications (e.g. Microsoft, Linux).
• Strong interpersonal, written, and verbal communication skills to effectively collaborate and convey technical information.

Create your own chemistry with you@BASF

Adding value to our customers begins with adding value to you. you@BASF is the suite of benefits, perks, programs and unique opportunities we offer to support you - the whole you - in all stages of your life and career. With you@BASF, you create your own chemistry.

The total rewards that you receive as a BASF employee go way beyond a paycheck. From competitive health and insurance plans to robust retirement benefits that include company-matching contributions, to making sure you never stop learning, we believe investing in you is investing in our success. Working for a large, global organization, you'll have a chance to grow professionally and personally, expand your network and build a rewarding and dynamic career. We also provide engaging learning and development opportunities to help you make the most of your talents and your role.

About us

As the world's leading chemical company, we have been finding solutions for your everyday needs and addressing the most complex economic, environmental, and sustainability challenges for more than 150 years!

We constantly strive to become an even better workplace. As a result of our commitment to our employees, BASF has earned various awards, including being recognized by Mediacorp in 2024 as one of Canada's Top Employers for tenth consecutive year, one of the Greater Toronto Area's Top Employers for the eleventh year in a row, and twice being named one of Canada's Top Employers for Young People and Best Diversity Employers.

We provide a fulfilling work environment with a strong emphasis on the physical and psychological safety of our employees and the communities we operate in. We are always working to form the best team with an emphasis on diversity, equity, and inclusion and through lifelong learning and development.

Belong to Something Bigger. #belongatBASF

Privacy Statement

BASF takes security & data privacy very seriously. We will never request personal or financial information of any kind via either text message or direct message on any social media platform or job board. Furthermore, we will never offer a candidate a position and request a cheque for equipment or any other type of payment during the job application process. If you have experienced any of the above, please contact myhr@basf.com to report fraud.

Inclusion and Equal Opportunity Employment

BASF is dedicated to creating a diverse and inclusive workplace where our employees can be their authentic selves. We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, age, citizenship, place of origin, ethnic origin, colour, religion/creed, sex/pregnancy, marital status, family status, disability status, sexual orientation, gender identity or expression, or any other characteristic protected by law.

We seek to make our recruitment process accessible for applicants with disabilities. If you require accommodations or support throughout the recruitment process, please contact ta-canada@basf.com with the subject line "Recruitment Accommodation Request".