Senior Big Data Engineer

Senior Big Data Engineer  
 
The Role     
We are looking for experienced, innovative and highly motivated engineer who is capable of working independently to design, develop and support data engineering solutions. This role requires a considerable focus on understanding our data we deal with as an organization, develop a better understanding of our data through profiling, take ownership of the solution design, work collaboratively with the wider engineering team to implement optimal solutions in a timely manner and ensure successful deployment and operation of the platform in production. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to solve complex engineering challenges and develop innovative solutions.  In daily work you will be responsible for creation and delivery of a platform loading and processing millions of electronic medical records.  
 
The Team  
The Systems Engineering team is part of the Global Technology Organisation (GTO) and remains one of the most dynamic and fast-growing groups in the organisation. We are passionate about Agile software development and are among the strongest advocates for DevOps and Test-Driven Development (TDD). Our culture promotes autonomy and collaboration, empowering individuals to thrive within self-organising teams. Our work involves processing and analysing a wide range of patient-level healthcare data, which supports solving complex healthcare challenges — from retrospective clinical studies to disease progression modelling. 
In your daily activities, you will collaborate with a team of Architects who design effective solutions, and with the Quality Assurance team, which ensures the highest standards of software quality. 
 
The Data 
We process over a billion records at a time, our engineers are responsible for the data analysis and construction and optimization of data flow processes. You will build data pipeline using ETL solutions for acquiring, processing and loading medical data into the Databricks using pyspark technologies.  
 
Core Responsibilities   
Ability to oversee and guide junior and mid-level engineers, providing technical direction and mentoring to support their growth.  
Ownership for the delivery of assigned workstreams, ensuring quality, timeliness, and accountability across the team. 
Build pipelines for processing big amount of medical data 
Participate in analysis, system design, development, deployment and maintenance  
Conduct peer code reviews 
Contribute to the definition and adoption of technical standards 
Create comprehensive automated unit and integration tests  
  
QUALIFICATIONS & SKILLS  
 
Qualifications  
Bachelor's Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or other related field  
 
Technical skills and knowledge   
 
6+ years of the following language: SQL, Python 
6+ years of experience in data engineering 
Strong understanding of Databricks platform 
Experience with Big Data Batch processing and Azure Cloud Services 
Hands-on expierience with Oracle databases 
Practical knowledge of Apache Spark ecosystem, including Delta and Parquet data formats 
Experience with complex ETL design and implementation 
Experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting 
Experience with CI/CD automation processes and tools such as Jenkins/GitLab 
 
Additional/nice to have: 
Familiarity with AI-powered productivity tools such as Copilot or Cursor, and their practical use in day-to-day software development workflows (e.g. code generation, documentation, task automation, or debugging support). 
Experience working in an Agile Prince environment  
Experience with database design and modelling (data models concepts like: Kimball, Inmon, Data Vault) 
Previous experience with healthcare or pharmaceutical data would be an advantage 
Knowledge of algorithms & design patterns and how to apply them effectively   
Experience with large data volume (TBs') processing   
 
Personal skills and behaviours :
Excellent analytical & troubleshooting skills.      
Strong collaboration, written and verbal skills.  
Familiarity with project management concepts, specifically Agile/Scrum   
Ability to present complex results in a clear language for both technical and non- technical audience.
A great team player mindset.

IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more