Remote Big Data Developer Jobs

EPAM Anywhere is looking for remote Big Data Developers.

Be well paid

Do what you love in one of our Backend Developer remote jobs and get a guaranteed competitive compensation that grows together with you.

Explore corporate perks

Explore enterprise-level corporate benefits to support your comfortable journey at EPAM Anywhere.

Manage your career the way you want to

Land an ideal remote Backend Developer job and seize your chance to deepen your expertise or change your career path whenever it's comfortable for you.

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with expertise in Databricks to lead our team of data engineers and take responsibility for designing and implementing data management solutions.

The successful candidate will be familiar with cloud-based data pipeline development and have experience building optimal data infrastructure solutions.

responsibilities

Lead a team of data engineers, organize teamwork, and solve technical and non-technical challenges
Design key software components of the data platform, and build collaborative partnerships with architects and technical leads
Create and maintain optimal on-prem and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using batch & streaming methods
Assemble large, complex data sets that meet functional and technical requirements, and develop data flows that can leverage both on-premise and cloud architectures
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs

requirements

Bachelor's degree in Computer Science, Information Systems, or another applicable field is preferred
At least 3 years of experience in a Data Engineer role
Advanced working knowledge of cloud-based data pipeline development, particularly on AWS
Experience building and optimizing data pipelines for data acquisition and management
Expertise in Databricks, Python, SQL, and AWS
B2+ English level

nice to have

Understanding of message queuing, stream processing, and Change Data Capture mechanisms

senior big data engineer with python

Data Software Engineering

Databricks, Amazon Web Services, Python

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with a passion for data to develop, monitor, and operate the curated data pipeline for our project.

The ideal candidate has a strong background in Data Software Engineering and extensive experience with DSE Python AWS Databricks and SQL. In this position, you will be responsible for redeveloping legacy pipelines into new, advanced, and scalable versions, consulting with data scientists and product managers, building and improving KPIs, and maintaining our cloud-based tech stack.

responsibilities

Develop, monitor, and operate the most critical curated data pipeline in the project
Consult with data scientists and product managers to improve KPIs for business steering
Redevelop legacy pipelines into advanced, scalable versions that are easy to maintain
Leverage and improve our cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Build, monitor, and maintain Apache Airflow pipelines

requirements

Minimum of 3 years of experience in Data Software Engineering
Expertise in Apache Spark, Spark streaming, and Databricks
Fluency in Scala programming language and SQL
Experienced working with AWS landscape and Github
Ability to build Apache Airflow pipelines
B2+ English level

nice to have

Knowledge of Presto, Superset, and Starburst
Experience with Oracle & Exasol

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Big Data Engineer with expertise in Databricks to join our innovative team.

The ideal candidate should have extensive experience in Spark/Scala and AWS, as well as a solid foundation in Python. In this position, you will be responsible for designing, developing, and deploying large-scale data processing systems with Databricks. You will also be responsible for optimizing data pipelines, monitoring performance, and resolving any related issues. The successful candidate should be able to collaborate closely with other teams, evaluate technical trade-offs, and ensure high-quality solutions are delivered.

responsibilities

Design, develop and maintain high-performance data processing systems using Databricks
Optimize data pipelines and monitor their performance regularly
Identify and troubleshoot issues that occur during data processing
Collaborate with other teams to integrate data solutions into existing platforms
Evaluate technical trade-offs and provide recommendations to improve the platform's performance and scalability

requirements

Minimum 3 years of relevant experience in Data Software engineering
Expertise in DSE Python, AWS, and Databricks
Solid foundation in Spark/Scala and Elastic
Excellent communication skills and the ability to collaborate with cross-functional teams
Fluent in English with an Upper-Intermediate level (B2+)

nice to have

Experience in Apache Airflow and Python

senior data software developer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Developer to join our team.

The ideal candidate should also have experience working with Python and Azure Databricks. The successful candidate will develop reusable DataBricks components for data ingestion and data analytics, ingest data into data lake for reporting and predictive modelling, ensure security controls, integrate data governance and establish clear auditable data lineage. They will collaborate with architects, technical leads and key individuals within other functional groups. The Senior Data Software Developer will also actively participate in code review, test solutions and write project documentation.

responsibilities

Build reusable DataBricks components for data ingestion and data analytics
Ingest data via batch, streaming, replication into data lake for reporting and predictive modelling
Ensure security controls, integrate with data governance and establish clear auditable data lineage
Collaborate with architects, technical leads and key individuals within other functional groups
Participate in code review, testing solutions and writing project documentation

requirements

At least 3 years of experience in Data Software Engineering
Proficiency in Python and Azure Databricks is a must
Experience building data ingestion pipelines, Data Warehouse or Database architecture
Data modeling skills with hands-on development experience with modern Big Data components
Cloud experience in designing, deploying and administering scalable, available and fault-tolerant systems
An extensive understanding of regulatory compliance such as PI, GDPR, HIPAA
B2+ English level

nice to have

Leadership skills

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team.

The successful candidate will be responsible for building enterprise data platforms and data products. The individual will work with a team of developers and stakeholders to design and implement high-performance solutions that meet business needs.

responsibilities

Design and develop enterprise data platforms and data products
Work with stakeholders to identify business needs and requirements
Collaborate with other developers and data engineers to design and implement solutions
Implement event-driven architecture to support real-time data processing
Develop and maintain data pipelines and ETL processes
Ensure that the data platform meets performance and scalability requirements
Monitor the performance of data platforms and address issues as they arise
Work with data scientists and analysts to deliver data-driven insights
Stay up-to-date with emerging technologies and industry trends
Communicate effectively with stakeholders and team members

requirements

At least 3 years of experience in building data platforms
Demonstrated experience in implementing big data high-performance solutions
Strong primary skills in data and experience with Databricks and Python
Experience with Microsoft Azure and its big data services
Knowledge and preferably experience with event-driven architecture
Experience with development and deployment of data products
Excellent problem-solving skills and ability to work well in a team environment
Ability to work independently, prioritize tasks and meet deadlines
Strong communication skills in English, both written and verbal (B2+ level)

nice to have

Experience with Apache Spark
Experience with Kubernetes and Docker
Experience with SQL and NoSQL databases
Experience with data visualization tools such as Tableau

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Software Engineer.

We are looking for a remote Senior Data Software Engineer . You will build Enterprise Data Platform and Data Products on top. As a senior member of the team, you will be responsible for building and maintaining high-performance Big Data solutions. This role offers an opportunity to work with cutting-edge technologies and collaborate with a talented team of developers.

responsibilities

Design, develop, and implement high-performance Big Data solutions using Python and Databricks
Collaborate with cross-functional teams to define project goals and requirements
Create and maintain data pipelines and ETL processes to support data-driven applications
Develop and maintain RESTful APIs and microservices for data-driven applications
Implement and maintain Event-driven architecture for scalable and reliable systems
Deploy and manage applications using containerization technologies like Docker and Kubernetes
Participate in code reviews, ensuring code quality and adherence to standards
Provide technical input for new feature requirements, partnering with business owners and architects
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Mentor and guide less experienced team members, helping them enhance their skills and grow their careers

requirements

At least 3 years of experience in building Data Platform
Proven track record of successful implementation of Big Data high-performance solutions
Strong expertise in Python and Databricks for building Big Data solutions
In-depth knowledge of Event-driven architecture for developing scalable and reliable systems
Experience with Microsoft Azure Big Data Services for developing and deploying cloud-based applications
Strong understanding of Big Data technologies and data modeling concepts
Experience with large scale data processing technologies such as Hadoop and Spark
Expertise in developing RESTful APIs and microservices for data-driven applications
Knowledge of containerization technologies like Docker and Kubernetes for deploying and managing applications
Experience with Agile development methodologies and tools like Jira and Git
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Machine Learning and AI technologies

senior data integration developer

Data Integration

ETL/ELT Solutions, Python, SQL

40 hrs/week

12+ months

Poland

We are seeking a highly skilled remote Senior Data Integration Developer to join our team and build ETLs.

As a Senior Data Integration Developer, you will be responsible for communicating with Business analytics to get business requirements, implementing ETLs using SQL and Python, and data modelling. You will work in an Agile environment, delivering small increments out of a single product backlog. If you are passionate about data engineering and have a proven track record in implementing ETLs using SQL and Python, we invite you to be part of our team.

responsibilities

Communicate with Business analytics to get business requirements
Implement ETLs using SQL and Python
Perform data modelling to design efficient and scalable data models
Conduct unit testing to ensure high-quality deliverables
Work in an Agile environment, delivering small increments out of a single product backlog
Collaborate with cross-functional teams to ensure seamless integration of data
Provide technical guidance and support to junior developers

requirements

A minimum of 3 years of experience in Data Integration, demonstrating your expertise in ETL/ELT Solutions, Python
Proven experience in implementing ETLs using SQL and Python, showcasing your ability to deliver high-quality solutions
Hands-on experience in data modelling, enabling you to design efficient and scalable data models
Working knowledge of AWS technologies, including PySpark, Glue, Redshift, and Kinesis (good to have)
Excellent communication skills and strong critical thinking capabilities to effectively convey feedback and insights
Good organizational skills and a detail-oriented mindset, crucial for meticulous testing efforts
Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication

nice to have

Familiarity with data architecture services related to data modelling and AWS big data architecture
Experience with data delivery services based on ETL tools (PDI, BODS, Glue, Python) and data engineering based Redshift DB functionalities

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in developing enterprise data platforms and data products. We are looking for a deeply technical software engineer to collaborate closely with development peers, product leadership, and other technical staff to create innovative and impactful solutions. This role offers an opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment.

responsibilities

Design and develop enterprise data platforms and data products using the Agile development process (Scrum)
Prioritize and ensure high-quality standards at every stage of development
Guarantee reliability, availability, performance, and scalability of systems
Collaborate with Developers, Product and Program Management, and senior technical staff to deliver customer-centric solutions.
Provide technical input for new feature requirements, partnering with business owners and architects
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Drive the implementation of solutions aligned with business objectives.
Mentor and guide less experienced team members, helping them enhance their skills and grow their careers
Participate in code reviews, ensuring code quality and adherence to standards
Collaborate with cross-functional teams to achieve project goals
Actively contribute to architectural and technical discussions

requirements

At least 3+ years of experience in building data platforms and data products at big companies
Deep expertise in Databricks and Python for developing big data high-performance solutions
Experience with Microsoft Azure Big Data Services for designing and building data solutions on Azure
Knowledge and preferably experience with Event-driven architecture
Strong development experience with big data and data background
Experience in managing and optimizing data processing pipelines
Experience in designing and developing ETL solutions
Expertise in SQL and NoSQL databases for designing and managing database schema, including procedures, triggers, and views
Experience with data analysis, data modeling, and data visualization tools
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with other big data technologies such as Hadoop, Spark, and Kafka is a plus
Experience with data governance, data security, and data privacy is a plus

senior data software engineer

Data Software Engineering

Big Data, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are looking for a Senior Data Software Engineer to join our team, working with one of the largest pharmaceutical companies in the world.

We are looking for a Senior Data Software Engineer to join our remote team, working with one of the largest pharmaceutical companies in the world. Consistently ranked in the global top five, this company is committed to improving human health through innovation and research. As a Senior Data Software Engineer, you will be responsible for implementing data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality.

responsibilities

Implement data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality
Design and implement scalable and efficient data processing solutions
Contribute to the development and maintenance of data engineering best practices and standards
Collaborate with other engineers and stakeholders as required, contributing to the enhancement of user experiences and the improvement of data-driven decision-making processes
Review and ensure the quality control of data engineering deliverables to meet the highest standards
Provide assistance and support to other engineers during project discovery and ideation phases, contributing to innovative data solutions

requirements

Relevant experience is 3+ years in Data Software Engineering, with a focus on Big Data
Strong understanding of Big Data technologies, including Hadoop, Spark, and Hive
Proficiency in Python programming language, enabling you to write high-quality and efficient code
Experience working with Amazon Web Services and Databricks, allowing you to work with cloud-based Big Data solutions
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Excellent communication skills in English, with a B2 level or higher, enabling you to effectively convey feedback and insights to cross-functional teams

nice to have

Experience in Machine Learning or Data Science, showcasing your broader perspective on data and its applications
Knowledge of SQL and NoSQL databases, enabling you to work with a variety of data storage solutions

lead aws data engineer

Amazon Web Services

Terraform, Python

40 hrs/week

12+ months

Colombia

We are looking for a remote Lead AWS Data Engineer to join our team, working on a cutting-edge data project for one of our delivery teams.

As a key contributor to the project, you will be responsible for the design, architecture, and end-to-end execution of big data projects. Your expertise in Amazon Web Services and Python will be essential to the successful development. Your strong communication skills, coupled with your ability to write complex queries to address business requirements, will be crucial in presenting data insights to stakeholders.

responsibilities

Design and architecture of data products, ensuring alignment with business objectives and target market needs
Collaborate with cross-functional team members to achieve project goals, including developers, business analysts, and stakeholders
Lead and manage the team of developers
Execute end-to-end big data projects with a strong focus on delivering high-quality results
Develop ETL for AWS Glue jobs and AWS Lambda functions
Investigate and implement data streaming solutions such as AWS Kinesis, Apache Flink, and Snowflake
Write complex queries to address business requirements and present data insights to stakeholders
Implement solutions in accordance with IaC principles using tools such as Atlassian Bitbucket, AWS CodeBuild, and Terraform

requirements

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
5+ years of experience in data engineering, preferably in an AWS environment
1+ year of relevant leadership experience
In-depth understanding of the data domain, including Apache Spark, Python (PySpark), and SQL
Strong experience with AWS CLI, S3, Glue, Lambda, Athena, Step Functions, RDS
Proficiency in microservices, OpenAPI, API Gateway, RDS, and unit tests
Ability to work within an agile team environment, with a strong focus on delivering high-quality results
Excellent communication skills to effectively present data insights
B2+ English level proficiency

nice to have

Experience with IoT
CI/CD experience: Atlassian Bitbucket, AWS CodeBuild, Terraform
Data streaming knowledge: AWS Kinesis / Apache Flink / Snowflake
Experience in Spark jobs performance optimization

Big Data Developer Remote Jobs

Big data developers are universal specialists. In carrying out their duties, they work with different programming languages and create products using different methods. The goal of such a developer is to create software that can handle high volumes of data that conventional services cannot cope with. Big data specialists provide businesses with tools for optimizing work with a large data flow. The main application for the developer of this specialization is the Hadoop ecosystem.

Modern businesses require the most reliable software, especially one that makes it possible to work with data arrays. The task of the big data developer is to make sure that this data helps the business achieve its goals. The specialty is complex in that it requires knowledge of many technologies and the skill to develop an optimal solution for each of them. Today there are a lot of remote big data developer jobs, so applicants for such a vacancy need to know what to write in their resume.

Duties of a big data developer

When applying for a job at a prestigious company, a specialist must be ready to perform the following scope of work:

Create software that can process large data streams.
Conduct continuous analysis of the received data.
Set up software for the fastest possible processing, which will provide solutions to business problems.
Maintain, improve and scale the product.
Detail complex tasks.
Build and run Hadoop applications.
Develop a security system for data storage.
Work with automation settings and provide quick access to the database.

According to their qualifications, specialists are divided into several levels, and the number and complexity of tasks for big data developer remote jobs depend on this. Junior developers will have fewer than half of the above duties. They work under the supervision of more experienced colleagues and gain experience in routine tasks. The above duties are for those in higher levels. In addition to those duties, top-level specialists must supervise the work of junior team members.

Requirements of a big data developer

Each company has its own requirements, but big data developers who work from home typically must meet the following:

2+ years of experience
Full knowledge of the necessary programming languages, as well as Hadoop
Ability to work with large volumes of data
Skill in working with tools for analysis and visual presentation of data
Possession of all processes that allow modeling and structuring of data
Experience with streaming frameworks and automation tools
Bachelor’s or master's degree in a specialized field
Knowledge of ETL and Agile
Experience in developing products on open source systems

If you want to work remotely, add organization, time management, punctuality, and responsibility to the above requirements. Working from home, a specialist should not lose their connection to the team.

Remote Big Data Developer Jobs

Big Data Developer Remote Jobs

Duties of a big data developer

Requirements of a big data developer

Other skills