Data Engineering Jobs

EPAM Anywhere is looking for Data Engineering Specialists.

Enjoy transparent promotions

Land your ideal Hybris job and get a guaranteed competitive pay that grows together with you. With no limits.

Access enterprise-level perks

SAP remote specialists get a country-specific pack of corporate benefits that includes many disounts, health coverage and relocation opportunities.

Grow your expertise

Get support from a dedicated Skill Advisor, make use of a wide set of education, career growth and personal development services to hit your next career targets.

lead data engineer

Python.Data

Pandas, Python, SQL

40 hrs/week

12+ months

India

We are looking for a skilled remote Lead Data Engineer to join our team and help build data pipelines for our projects.

You will be responsible for managing and developing data pipelines, as well as overseeing a team of Data Engineers. This role requires extensive knowledge of Python and SQL, with a focus on data manipulation using Pandas.

responsibilities

Collaborate with other teams, including Data Scientists and Data Analysts, to understand business requirements and build data pipelines accordingly
Design and develop scalable data pipelines using Python and SQL
Oversee a team of Data Engineers, providing guidance and support as needed
Ensure the quality of data pipelines, including data accuracy, reliability, and efficiency
Create and maintain technical documentation for data pipelines and related systems
Implement and maintain security and compliance measures for data pipelines
Stay up-to-date with the latest trends and technologies in data engineering

requirements

Minimum of 5 years of experience in building data pipelines, with direct experience in using SQL
Proficient in Python, with specific experience in data manipulation using Pandas
Strong leadership skills, with experience in leading and managing a team (1+ year experience)
Excellent communication skills, with the ability to collaborate with other teams effectively
Fluent in English, with an Upper-Intermediate level of proficiency

senior data engineer

Data Integration

BigQuery Datasets, Cloud Composer, Google Cloud Platform

40 hrs/week

12+ months

Poland

Currently, we are looking for a remote Senior Data Engineer to join our global team

Currently, we are looking for a remote Senior Data Engineer to join our global team. The customer is a telemedicine company based in Boston that connects patients with doctors over secure video.

responsibilities

Manage, utilize, move and transform data to create reports for senior management and clients
Conduct business analysis on data requests to ensure clarity on the need and proper data usage adherent to security mandates
Build various ETL pipelines among the various tools in play to surface data for consumption by our Reporting Tool
Competing requests from internal and external stakeholders in addition to keeping the reporting infrastructure on par with new product functionality and release cycles
Become a Subject Matter Expert in data classification within the platform and utilize your expertise to identify the most efficient path to deliver data from A to B as needed
Working hand in hand with Hosting, Analytics and Product
Be accountable for the delivery of accurate and timely reporting solutions

requirements

3+ years of experience as Data Engineer
Strong knowledge of GCP Databases
Strong knowledge of Google BigQuery
Strong knowledge of SQL

senior data engineer

Data Software Engineering

Python, Amazon Web Services, Databricks

40 hrs/week

12+ months

Poland

We are searching for a skilled Senior Data Engineer to join our team.

If you are proficient in Python and AWS, and you have experience with migrating GCP BigQuery and DataFlow pipelines into Databricks hosted on AWS, we invite you to apply for this exciting opportunity.

responsibilities

Collaborate with the team on the migration of GCP BigQuery and DataFlow pipelines to Databricks hosted on AWS, ensuring a seamless transition
Design, develop, and optimize data pipelines using Python, Spark, and Databricks to meet business requirements and enhance data processing efficiency
Work closely with cross-functional teams to understand data requirements and contribute to the architecture and implementation of data solutions
Perform data modeling and transformation tasks to prepare data for analysis and reporting
Collaborate on code reviews, ensuring the quality and reliability of data pipelines
Troubleshoot and resolve issues related to data pipelines, ensuring smooth and consistent data flow

requirements

A minimum of 3 years of relevant experience as a Data Software Engineer, demonstrating your proficiency in developing and optimizing data solutions
Strong familiarity with AWS, leveraging its resources for hosting and managing data solutions
Proficiency in Python, utilizing its capabilities to build robust and efficient data pipelines
Experience with Apache Spark, enabling you to work with large-scale data processing and analysis
Expertise in Databricks, particularly in the context of migrating pipelines and working on AWS-hosted platforms
Solid command of SQL, allowing you to perform data transformations and analysis effectively
Fluent English communication skills at a B2+ level, facilitating effective collaboration with a diverse team

nice to have

Familiarity with GCP, particularly experience with BigQuery and DataFlow
Knowledge of GCP BigQuery and DataFlow, aiding in the migration process and facilitating collaboration across platforms

senior data software engineer

Data Software Engineering

Big Data, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are looking for a Senior Data Software Engineer to join our team, working with one of the largest pharmaceutical companies in the world.

We are looking for a Senior Data Software Engineer to join our remote team, working with one of the largest pharmaceutical companies in the world. Consistently ranked in the global top five, this company is committed to improving human health through innovation and research. As a Senior Data Software Engineer, you will be responsible for implementing data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality.

responsibilities

Implement data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality
Design and implement scalable and efficient data processing solutions
Contribute to the development and maintenance of data engineering best practices and standards
Collaborate with other engineers and stakeholders as required, contributing to the enhancement of user experiences and the improvement of data-driven decision-making processes
Review and ensure the quality control of data engineering deliverables to meet the highest standards
Provide assistance and support to other engineers during project discovery and ideation phases, contributing to innovative data solutions

requirements

Relevant experience is 3+ years in Data Software Engineering, with a focus on Big Data
Strong understanding of Big Data technologies, including Hadoop, Spark, and Hive
Proficiency in Python programming language, enabling you to write high-quality and efficient code
Experience working with Amazon Web Services and Databricks, allowing you to work with cloud-based Big Data solutions
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Excellent communication skills in English, with a B2 level or higher, enabling you to effectively convey feedback and insights to cross-functional teams

nice to have

Experience in Machine Learning or Data Science, showcasing your broader perspective on data and its applications
Knowledge of SQL and NoSQL databases, enabling you to work with a variety of data storage solutions

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team.

The successful candidate will be responsible for building enterprise data platforms and data products. The individual will work with a team of developers and stakeholders to design and implement high-performance solutions that meet business needs.

responsibilities

Design and develop enterprise data platforms and data products
Work with stakeholders to identify business needs and requirements
Collaborate with other developers and data engineers to design and implement solutions
Implement event-driven architecture to support real-time data processing
Develop and maintain data pipelines and ETL processes
Ensure that the data platform meets performance and scalability requirements
Monitor the performance of data platforms and address issues as they arise
Work with data scientists and analysts to deliver data-driven insights
Stay up-to-date with emerging technologies and industry trends
Communicate effectively with stakeholders and team members

requirements

At least 3 years of experience in building data platforms
Demonstrated experience in implementing big data high-performance solutions
Strong primary skills in data and experience with Databricks and Python
Experience with Microsoft Azure and its big data services
Knowledge and preferably experience with event-driven architecture
Experience with development and deployment of data products
Excellent problem-solving skills and ability to work well in a team environment
Ability to work independently, prioritize tasks and meet deadlines
Strong communication skills in English, both written and verbal (B2+ level)

nice to have

Experience with Apache Spark
Experience with Kubernetes and Docker
Experience with SQL and NoSQL databases
Experience with data visualization tools such as Tableau

senior data software engineer

Data Software Engineering

Python, Amazon Web Services, Databricks

40 hrs/week

12+ months

Poland

We are looking for a highly skilled and motivated Senior Data Software Engineer to join our dynamic team.

If you are an expert in Python and have a solid background in AWS, we invite you to take on this exciting opportunity to contribute to cutting-edge data access and reporting solutions.

responsibilities

Develop and implement the proposed data access approval, access audit, and reporting solution.
Collaborate with cross-functional teams to understand project requirements and actively participate in decision-making processes.
Utilize your analytical prowess to assess business challenges and technical landscapes, translating them into high-quality technical solutions.
Engage in thorough code reviews and diligently test solutions to ensure adherence to best practice specifications.
Perform rigorous unit testing and meticulously craft comprehensive project documentation.

requirements

Minimum of 3 years of proven experience as a Data Software Engineer, demonstrating a track record of successful project delivery
Proficiency in Python, leveraging its capabilities to build efficient and robust data solutions
Strong familiarity with the AWS Cloud Adoption Framework, harnessing cloud resources to enhance data engineering workflows
Expertise in the Alation Platform, contributing to effective data governance and management
In-depth knowledge of Databricks, enabling seamless data processing and analysis
Proficiency in Java, enhancing your ability to develop versatile software solutions
Experience with Web Service / API Test Automation Tools in Java, ensuring the reliability and efficiency of data interfaces
Sound command of SQL, enabling you to work with and manipulate complex data sets
Fluent English communication skills at a B2+ level, facilitating effective collaboration in an international team

nice to have

Familiarity with the Alation Data Governance App, further contributing to data governance excellence
Experience with BitBucket, enhancing version control and collaboration practices

senior data software engineer

Data Software Engineering

Python, Amazon Web Services, Databricks

40 hrs/week

12+ months

Poland

Are you an experienced Data Software Engineer looking for a new challenge? Join our team as a Senior Data Software Engineer and play a pivotal role in supporting Data Science teams, building efficient data solutions, and contributing to cutting-edge analytics projects.

Proficiency in Python and AWS is key to success in this role.

responsibilities

Collaborate closely with Data Science teams, providing essential support and mentorship as they work on analytical projects
Take charge of building and maintaining tables, responding to incoming support tickets, and offering guidance through minimal ticket interactions
Utilize your expertise to construct datamarts and separate data models that cater to specific analytics needs
Engage in sprint-based development, ensuring timely delivery of data solutions aligned with Data Scientists' requirements
Handle ad-hoc data requests and provide on-call support as necessary
Contribute to the development of data ingestion pipelines, enhancing the efficiency of data processing workflows
Publish comprehensive documentation to aid users in effectively utilizing the data solutions you provide
Collaborate effectively within the team and demonstrate exceptional communication and documentation skills
Embrace constructive feedback and exhibit a proactive attitude towards continuous learning and adapting to new technologies

requirements

A minimum of 3 years of relevant experience in Data Software Engineering, showcasing a strong track record of successful project delivery
Proficiency in Python, enabling you to develop robust and efficient data solutions
In-depth knowledge of Amazon Web Services, utilizing cloud resources to optimize data processing and storage
Experience with Apache Airflow, contributing to streamlined workflow orchestration
Familiarity with Apache Spark, enhancing your ability to work with large-scale data processing
Solid understanding of ETL processes, ensuring efficient data movement and transformation
Proficiency in CI/CD practices, facilitating smooth and automated software delivery
Strong command of SQL, enabling you to manipulate and query complex datasets
Experience working with REST APIs, facilitating seamless data integration with other systems
Fluent English communication skills at a B2+ level, ensuring effective collaboration within an international team

nice to have

Familiarity with DataBricks and Spark, further enhancing your ability to work with big data
Experience with Redshift, contributing to optimized data warehousing solutions

senior data software engineer

Data Software Engineering

Apache Spark, Microsoft Azure, Python

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer with ML/Data Science experience.

Join our remote team as a Senior Data Software Engineer with ML/Data Science experience within a global leader in providing cutting-edge technology solutions. We are looking for a hands-on and experienced data software engineer who has a deep understanding of Apache Spark, Microsoft Azure, and Python. The successful candidate will be responsible for developing and implementing forecasting models, as well as designing and maintaining data pipelines. The role requires a strong understanding of data analytics and machine learning principles, and the ability to work collaboratively with cross-functional teams.

responsibilities

Designing and implementing forecasting models using machine learning algorithms
Developing and maintaining data pipelines for efficient data processing and analysis
Collaborating with cross-functional teams to identify business requirements and translate them into technical solutions
Creating and maintaining technical documentation for all data engineering projects
Working with data scientists to ensure that models are production-ready
Ensuring that all data engineering solutions are of high quality, reliable, and scalable
Troubleshooting and resolving data-related issues in a timely and efficient manner
Maintaining up-to-date knowledge of emerging data engineering technologies and trends
Participating in code reviews to ensure code quality and adherence to standards

requirements

At least 3+ years of experience in Data Software Engineering with a focus on ML/Data Science
Expertise in Apache Spark, Microsoft Azure, and Python
Experience in forecasting models development and implementation
Deep understanding of data analytics and machine learning principles
Good knowledge of Git for version control
Familiarity with Databricks and MLOps for efficient model deployment and management
Experience in developing and maintaining data pipelines
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Knowledge of Panda for data manipulation and analysis
Experience with SQL and relational tables
Understanding of statistical models and their practical applications

senior data software engineer

Data Software Engineering

Apache Spark, Microsoft Azure, Python

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team in building a data integration solution.

We are seeking a Senior Data Software Engineer to join our team in building a data integration solution. The Senior Data Software Engineer will take responsibility for the development and execution of the data engineering strategy, working closely with data scientists and other stakeholders to ensure that data is transformed into valuable insights. The ideal candidate will have a strong background in data engineering, machine learning, and software development.

responsibilities

Collaborate with data scientists to build and deploy machine learning models in production
Design and develop data pipelines, data processing systems, and APIs for data integration and analysis
Optimize data pipelines for performance and scalability
Ensure data quality, accuracy, and consistency through data validation and testing
Develop and implement MLOps processes to monitor and maintain machine learning models
Work with stakeholders to understand data requirements and provide solutions to meet their needs
Design and implement data security and privacy measures to protect sensitive data
Stay up-to-date with emerging trends and technologies in data engineering and machine learning
Provide technical guidance and mentorship to junior team members

requirements

Minimum 3+ years of experience in data engineering or software development roles
Proficiency in Apache Spark, Microsoft Azure, and Databricks for data processing and management
Expertise in Python programming language and associated data science libraries such as Pandas and NumPy
Experience in building forecasting models, statistical models, and machine learning models
Strong knowledge of MLOps and deploying machine learning models in production
Experience with Git for version control and team collaboration
Good understanding of Azure concepts such as clouds, regions, and compute
Ability to work in a fast-paced environment and deliver results under tight deadlines
Excellent English communication skills, both written and verbal, for effective global collaboration (B2+)

nice to have

Experience with SQL and relational databases for data management
Familiarity with cloud-based data warehousing solutions such as Azure Data Lake Storage (ADLS)
Knowledge of other machine learning tools and platforms such as TensorFlow and PyTorch
Experience with data visualization tools such as Tableau and Power BI

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team.

The ideal candidate should have solid/hands-on experience in Azure, PySpark, Python, Python web services, Databrics, and Advanced SQL. Moreover, the candidate must possess excellent communication skills with an upper-intermediate English level.

responsibilities

Build a POC for replacement of the external vendor
Scope the setup of the required Azure services
Extract data from data lake (EDL) and process data based on application requirements and architecture
Build service layer and mimic the current existing application
Work collaboratively with the team and report technical challenges and bugs in a timely and efficient manner

requirements

Minimum of 3 years of experience in Data Software Engineering
Strong knowledge of Azure, PySpark, Python, Python web services, Databrics, and Advanced SQL
Familiarity and ability to use Azure services
Strong knowledge on how to extract data from data lakes (EDL) and process data
Excellent communication skills with an upper-intermediate English level

nice to have

Excellent organizational skills

Data Engineering Jobs

Related skills