Senior PySpark Developer

City of London
3 weeks ago
Create job alert

Senior PySpark Developer
Location: Canary Wharf, London 3 days onsite
Contract to Perm (inside IR35 via umbrella)

Are you a skilled PySpark Developer looking to make an impact in the fast-paced world of investment banking? We are seeking a talented individual to join our dynamic team based in the heart of Canary Wharf, just a short 4-minute walk from the train station. This is an exciting opportunity to enhance your career and contribute to innovative projects in a collaborative environment.

Key Responsibilities:

Develop and maintain scalable data pipelines using PySpark to support our data processing needs.
Collaborate with cross-functional teams to gather requirements and design efficient ETL processes.
Optimise existing data workflows and troubleshoot issues to ensure high performance and reliability.
Implement data processing algorithms and integrate with various data sources, including databases and cloud storage.
Work closely with stakeholders to understand business needs and translate them into technical solutions.
Document processes, best practises, and maintain clear communication with team members.
Required Skills and Qualifications:

Proven experience as a PySpark Developer or in a similar role, within the investment banking sector.
Strong proficiency in PySpark and experience with data manipulation and analysis.
Familiarity with big data technologies and frameworks.
Solid understanding of data warehousing concepts and ETL processes.
Ability to work with SQL and NoSQL databases.
Strong analytical and problem-solving skills.
Excellent communication skills, both verbal and written.
A proactive attitude and the ability to work independently or as part of a team.
Why Join Us?
Hybrid Working Model: Enjoy the flexibility of a hybrid work environment, allowing you to balance your personal and professional life.
Convenient Location: Our office is just a quick 4-minute walk from Canary Wharf train station, making your daily commute easier.
Competitive day rate/salary: We offer an attractive salary package commensurate with your experience and skills.
Career Development: Take advantage of ongoing training and development opportunities to advance your career in the investment banking sector.
Collaborative Environment: Be part of a supportive team that values creativity, innovation, and collaboration.
Social Events: Participate in regular team-building activities and social events to foster a positive work culture.

If you are ready to take the next step in your career and make a significant contribution to our team, we want to hear from you! Apply now with your CV and a brief cover letter detailing your relevant experience and why you are the right fit for this role. please note, due to high volumes, only shortlisted candidates will be contacted.

Adecco is a disability-confident employer. It is important to us that we run an inclusive and accessible recruitment process to support candidates of all backgrounds and all abilities to apply. Adecco is committed to building a supportive environment for you to explore the next steps in your career. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you

Related Jobs

View all jobs

Senior Software Developer

Senior Data Architect

Senior Software Engineer

Senior Kafka (Real-Time) Architect/Engineer

Senior BA/PM

Senior Data Insights Analyst, SQL Server, PowerBI, Azure Mainly Remote

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Engineering Apprenticeships: Your In-Depth Guide to a High-Growth Tech Career

Data sits at the heart of modern business. From predictive analytics in finance to personalised recommendations in e-commerce, virtually every sector relies on data to make informed decisions, optimise operations, and drive innovation. Yet, as data volumes grow exponentially, so does the complexity of managing and utilising it effectively. In this evolving environment, data engineering has emerged as a critical discipline—responsible for designing, building, and maintaining the pipelines that transform raw information into actionable insights. If you’re looking to break into this vibrant and future-oriented field, data engineering apprenticeships offer a hands-on, cost-effective route. Designed to fast-track your skills, apprenticeships combine formal training with practical, on-the-job learning. Whether you’re a school leaver or a professional seeking a career change, this guide will walk you through everything you need to know about data engineering apprenticeships in the UK—from the roles you might undertake, to the skills you’ll master, and the exciting career paths that await.

Tips for Staying Inspired: How Data Engineering Pros Fuel Creativity and Innovation

Data engineering stands at the core of modern business intelligence, analytics, and machine learning initiatives. As more organisations become data-driven, the demands on data engineers—everything from building robust pipelines and optimising data warehouses to cleaning and transforming petabytes of raw information—only intensify. Yet, remaining innovative and creative in this rapidly evolving space can be challenging when faced with routine maintenance, endless transformations, and the pressure of meeting tight deadlines. So, how do data engineers stay inspired and consistently generate new ideas? Below are ten actionable strategies to help data pipeline experts, ETL developers, and cloud data architects maintain an inventive outlook, even when operations are complex and the stakes are high. If you’re looking to expand your skills, tackle challenges from fresh angles, and reinvigorate your passion for data engineering, these tips can guide you toward a more fulfilling and impactful career.

Top 10 Data Engineering Career Myths Debunked: Key Facts for Aspiring Professionals

Data is the lifeblood of modern businesses. Whether it’s guiding strategic decisions, powering advanced analytics, or fuelling machine learning models, the role of data has evolved from a back-office function to a primary driver of innovation. In this ecosystem, data engineers serve as architects and builders, designing the infrastructure and pipelines that allow organisations to collect, transform, and mobilise data efficiently. Despite the importance and rapid growth of this field, plenty of myths and misconceptions continue to cloud the realm of data engineering. Are data engineers merely “ETL developers”? Does the role only exist in big tech companies? Must you be a Python guru with a master’s degree in computer science? At DataEngineeringJobs.co.uk, we see firsthand how these myths can deter aspiring professionals from stepping into one of the most dynamic fields in data. This article aims to dispel the top 10 misconceptions about data engineering careers—shedding light on the real opportunities, necessary skills, and diverse pathways that define this vital profession. Whether you’re a student considering data engineering as your future vocation or a seasoned professional seeking a career pivot, read on. You might discover that data engineering is more inclusive and wide-ranging than you ever imagined.