Data Engineer

We are seeking a Data Engineer to join our solution engineering team.

Practising a hybrid model, the role will combine opportunities for both remote and on-site work. The role will expose you to working with global clients and cutting-edge data technologies. If you're passionate about data, thrive in solving complex challenges, and have experience managing workloads, we want to hear from you!

About the Role

We are looking for a Data Engineer, who is curious about technology and suited to using a variety of tools and frameworks to solve data related problems. The ideal candidate would have 2 years of experience in a similar role. The person should have a problem-solving mindset with a strong hands-on attitude who is looking to execute day to day tasks to support the different clients and project. The candidate would like to work in a creative and varied environment, focusing on performance, using the latest technologies.

Key Responsibilities

• Configure and customise Redslim tools to meet specific client requirements, developing reusable components and ensuring seamless integration with existing systems.

• Design, implement, and maintain data integration code based on Python and PySpark, actively engaging in feedback loop with core product team and contributing to maintenance and evolution of Redslim tools.

• Develop and implement automated workflows using Artificial Intelligence and conventional software logic.

• Optimise and manage job tasks, Unity Catalog tables and other Databricks services.

• Develop and execute unit and integration tests to ensure data quality and pipeline reliability.

• Research, suggest, and implement best practices and usage of any relevant technology / tool in line with modern industry standards.

• Oversee data governance and security, including implementing data access controls, ensuring data privacy, and adhering to company policies.

What We’re Looking For:

Technical Skills:

o Proficient in Python and PySpark with at least 2 years of experience developing and optimizing data pipelines. Demonstrated ability to write clean, efficient, and well-documented code with experience in library-oriented development, creating reusable functions and modules.

o Strong SQL skills for data querying and transformation.

o Experience with Azure cloud services.

o Experience with Databricks, including Delta Lake, Spark SQL, and Unity Catalog. Ability to optimize Spark jobs for performance and scalability.

o Experience with Azure DevOps for CI/CD.

o Knowledge of data modeling and data warehousing principles.

o Experience with other data processing technologies (e.g., Snowflake, DuckDB).

Desired:

o Experience developing and implementing tools using AI (e.g. with Microsoft’s Agent Framework).

o Familiarity with data visualization tools (e.g., Power BI, Tableau).

Mindset:

• Passion for continuous learning and adopting new technologies.

• Exceptional communication skills and ability to collaborate across teams.

• Thrives in a fast-paced, flexible environment.

• Ready to occasionally travel for client and team meetings.

• English is our working language. Spanish and or French would be an advantage.

Why Join Us?

• Fresh, Agile, Entrepreneur environment with direct and full exposure to corporate initiatives.

• Full on-boarding training and on-boarding plan.

• Flexible work environment within a cohesive and collaborative team.

• Competitive package commensurate with experience.

• Exposure to global clients and cross-functional teams.

About Redslim

We started in 2013, when our customers’ data journeys were at a turning point. Redslim came to life to help CPG organizations maximizing the usage of the full scope of their data assets with customized analytical tools. Offering a replicable yet flexible approach to data synchronization, our founding partners created a new space in the world of market intelligence. We’re a virtual company to offer a lean experience around remodelling data assets. Ours is a people-first culture that encourages everyone to drive change on the customer’s behalf. Not being a typical corporation, we can challenge our status quo. We succeed every day with a collaborative attitude, a quality driven approach, and transparent relationships with our partners.

Find out more about us at https://redslim.net/!

If you're ready to take the next step in your data engineering career, apply today and join our team of experts!