Big Data Engineer Jobs in Poland

EPAM Anywhere is looking for Big Data Engineers in Poland.

Competitive compensation

We back all payments and operate in compliance with country-specific labor regulations. Your annual paycheck can range from $15k to $200k.

Numerous benefits

Make use of 1,500+ online and location-specific benefits across 30+ countries that also include healthcare and sports programs for you and your family.

Limitless career growth opportunities

Get access to a large-scale ecosystem that consists of educational and career development services created for your growth. A personal skill advisor will support you on each step of this journey.

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with expertise in Databricks to lead our team of data engineers and take responsibility for designing and implementing data management solutions.

The successful candidate will be familiar with cloud-based data pipeline development and have experience building optimal data infrastructure solutions.

responsibilities

Lead a team of data engineers, organize teamwork, and solve technical and non-technical challenges
Design key software components of the data platform, and build collaborative partnerships with architects and technical leads
Create and maintain optimal on-prem and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using batch & streaming methods
Assemble large, complex data sets that meet functional and technical requirements, and develop data flows that can leverage both on-premise and cloud architectures
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs

requirements

Bachelor's degree in Computer Science, Information Systems, or another applicable field is preferred
At least 3 years of experience in a Data Engineer role
Advanced working knowledge of cloud-based data pipeline development, particularly on AWS
Experience building and optimizing data pipelines for data acquisition and management
Expertise in Databricks, Python, SQL, and AWS
B2+ English level

nice to have

Understanding of message queuing, stream processing, and Change Data Capture mechanisms

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Big Data Engineer with expertise in Databricks to join our innovative team.

The ideal candidate should have extensive experience in Spark/Scala and AWS, as well as a solid foundation in Python. In this position, you will be responsible for designing, developing, and deploying large-scale data processing systems with Databricks. You will also be responsible for optimizing data pipelines, monitoring performance, and resolving any related issues. The successful candidate should be able to collaborate closely with other teams, evaluate technical trade-offs, and ensure high-quality solutions are delivered.

responsibilities

Design, develop and maintain high-performance data processing systems using Databricks
Optimize data pipelines and monitor their performance regularly
Identify and troubleshoot issues that occur during data processing
Collaborate with other teams to integrate data solutions into existing platforms
Evaluate technical trade-offs and provide recommendations to improve the platform's performance and scalability

requirements

Minimum 3 years of relevant experience in Data Software engineering
Expertise in DSE Python, AWS, and Databricks
Solid foundation in Spark/Scala and Elastic
Excellent communication skills and the ability to collaborate with cross-functional teams
Fluent in English with an Upper-Intermediate level (B2+)

nice to have

Experience in Apache Airflow and Python

senior big data engineer with python

Data Software Engineering

Databricks, Amazon Web Services, Python

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with a passion for data to develop, monitor, and operate the curated data pipeline for our project.

The ideal candidate has a strong background in Data Software Engineering and extensive experience with DSE Python AWS Databricks and SQL. In this position, you will be responsible for redeveloping legacy pipelines into new, advanced, and scalable versions, consulting with data scientists and product managers, building and improving KPIs, and maintaining our cloud-based tech stack.

responsibilities

Develop, monitor, and operate the most critical curated data pipeline in the project
Consult with data scientists and product managers to improve KPIs for business steering
Redevelop legacy pipelines into advanced, scalable versions that are easy to maintain
Leverage and improve our cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Build, monitor, and maintain Apache Airflow pipelines

requirements

Minimum of 3 years of experience in Data Software Engineering
Expertise in Apache Spark, Spark streaming, and Databricks
Fluency in Scala programming language and SQL
Experienced working with AWS landscape and Github
Ability to build Apache Airflow pipelines
B2+ English level

nice to have

Knowledge of Presto, Superset, and Starburst
Experience with Oracle & Exasol

senior data software engineer

Data Software Engineering

Big Data, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are looking for a Senior Data Software Engineer to join our team, working with one of the largest pharmaceutical companies in the world.

We are looking for a Senior Data Software Engineer to join our remote team, working with one of the largest pharmaceutical companies in the world. Consistently ranked in the global top five, this company is committed to improving human health through innovation and research. As a Senior Data Software Engineer, you will be responsible for implementing data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality.

responsibilities

Implement data pipelines using Big Data technologies, ensuring that code is delivered on time and to a high standard of quality
Design and implement scalable and efficient data processing solutions
Contribute to the development and maintenance of data engineering best practices and standards
Collaborate with other engineers and stakeholders as required, contributing to the enhancement of user experiences and the improvement of data-driven decision-making processes
Review and ensure the quality control of data engineering deliverables to meet the highest standards
Provide assistance and support to other engineers during project discovery and ideation phases, contributing to innovative data solutions

requirements

Relevant experience is 3+ years in Data Software Engineering, with a focus on Big Data
Strong understanding of Big Data technologies, including Hadoop, Spark, and Hive
Proficiency in Python programming language, enabling you to write high-quality and efficient code
Experience working with Amazon Web Services and Databricks, allowing you to work with cloud-based Big Data solutions
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Excellent communication skills in English, with a B2 level or higher, enabling you to effectively convey feedback and insights to cross-functional teams

nice to have

Experience in Machine Learning or Data Science, showcasing your broader perspective on data and its applications
Knowledge of SQL and NoSQL databases, enabling you to work with a variety of data storage solutions

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team.

The successful candidate will be responsible for building enterprise data platforms and data products. The individual will work with a team of developers and stakeholders to design and implement high-performance solutions that meet business needs.

responsibilities

Design and develop enterprise data platforms and data products
Work with stakeholders to identify business needs and requirements
Collaborate with other developers and data engineers to design and implement solutions
Implement event-driven architecture to support real-time data processing
Develop and maintain data pipelines and ETL processes
Ensure that the data platform meets performance and scalability requirements
Monitor the performance of data platforms and address issues as they arise
Work with data scientists and analysts to deliver data-driven insights
Stay up-to-date with emerging technologies and industry trends
Communicate effectively with stakeholders and team members

requirements

At least 3 years of experience in building data platforms
Demonstrated experience in implementing big data high-performance solutions
Strong primary skills in data and experience with Databricks and Python
Experience with Microsoft Azure and its big data services
Knowledge and preferably experience with event-driven architecture
Experience with development and deployment of data products
Excellent problem-solving skills and ability to work well in a team environment
Ability to work independently, prioritize tasks and meet deadlines
Strong communication skills in English, both written and verbal (B2+ level)

nice to have

Experience with Apache Spark
Experience with Kubernetes and Docker
Experience with SQL and NoSQL databases
Experience with data visualization tools such as Tableau

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in developing enterprise data platforms and data products. We are looking for a deeply technical software engineer to collaborate closely with development peers, product leadership, and other technical staff to create innovative and impactful solutions. This role offers an opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment.

responsibilities

Design and develop enterprise data platforms and data products using the Agile development process (Scrum)
Prioritize and ensure high-quality standards at every stage of development
Guarantee reliability, availability, performance, and scalability of systems
Collaborate with Developers, Product and Program Management, and senior technical staff to deliver customer-centric solutions.
Provide technical input for new feature requirements, partnering with business owners and architects
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Drive the implementation of solutions aligned with business objectives.
Mentor and guide less experienced team members, helping them enhance their skills and grow their careers
Participate in code reviews, ensuring code quality and adherence to standards
Collaborate with cross-functional teams to achieve project goals
Actively contribute to architectural and technical discussions

requirements

At least 3+ years of experience in building data platforms and data products at big companies
Deep expertise in Databricks and Python for developing big data high-performance solutions
Experience with Microsoft Azure Big Data Services for designing and building data solutions on Azure
Knowledge and preferably experience with Event-driven architecture
Strong development experience with big data and data background
Experience in managing and optimizing data processing pipelines
Experience in designing and developing ETL solutions
Expertise in SQL and NoSQL databases for designing and managing database schema, including procedures, triggers, and views
Experience with data analysis, data modeling, and data visualization tools
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with other big data technologies such as Hadoop, Spark, and Kafka is a plus
Experience with data governance, data security, and data privacy is a plus

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Software Engineer.

We are looking for a remote Senior Data Software Engineer . You will build Enterprise Data Platform and Data Products on top. As a senior member of the team, you will be responsible for building and maintaining high-performance Big Data solutions. This role offers an opportunity to work with cutting-edge technologies and collaborate with a talented team of developers.

responsibilities

Design, develop, and implement high-performance Big Data solutions using Python and Databricks
Collaborate with cross-functional teams to define project goals and requirements
Create and maintain data pipelines and ETL processes to support data-driven applications
Develop and maintain RESTful APIs and microservices for data-driven applications
Implement and maintain Event-driven architecture for scalable and reliable systems
Deploy and manage applications using containerization technologies like Docker and Kubernetes
Participate in code reviews, ensuring code quality and adherence to standards
Provide technical input for new feature requirements, partnering with business owners and architects
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Mentor and guide less experienced team members, helping them enhance their skills and grow their careers

requirements

At least 3 years of experience in building Data Platform
Proven track record of successful implementation of Big Data high-performance solutions
Strong expertise in Python and Databricks for building Big Data solutions
In-depth knowledge of Event-driven architecture for developing scalable and reliable systems
Experience with Microsoft Azure Big Data Services for developing and deploying cloud-based applications
Strong understanding of Big Data technologies and data modeling concepts
Experience with large scale data processing technologies such as Hadoop and Spark
Expertise in developing RESTful APIs and microservices for data-driven applications
Knowledge of containerization technologies like Docker and Kubernetes for deploying and managing applications
Experience with Agile development methodologies and tools like Jira and Git
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Machine Learning and AI technologies

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in providing solutions for complex data needs. We are currently looking for an individual who can work closely with the architects, technical leads, and other key individuals within our functional groups to design, develop and implement reusable DataBricks components for data ingestion and analytics. As a Senior Data Software Engineer, you will be responsible for ensuring that data is ingested via batch, streaming, or replication into a data lake, establishing security controls, and ensuring integration with data governance. You will also be responsible for building collaborative partnerships with stakeholders to ensure that the data is available for reporting and predictive modeling.

responsibilities

Design and develop reusable DataBricks components for data ingestion and analytics
Collaborate with architects, technical leads, and other key individuals within our functional groups to deliver customer-centric solutions.
Establish security controls and ensure integration with data governance to achieve clear auditable data lineage
Participate in code review and test solutions to ensure they meet best practice specifications
Write project documentation for all phases of the software development lifecycle
Create and maintain technical documentation for the data ingestion pipelines, Data Warehouse or Database architecture
Work with stakeholders to ensure data availability for reporting and predictive modeling
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Drive the implementation of solutions aligned with business objectives.
Mentor and guide less experienced team members, helping them enhance their skills and grow their careers
Collaborate with cross-functional teams to achieve project goals

requirements

3+ years of experience in building data ingestion pipelines, Data Warehouse or Database architecture
Expertise in Python and PySpark for data processing and analysis
Experience with DataBricks for building scalable and high-performance applications
Hands-on experience with SQL Azure for designing and managing database schema, including procedures, triggers, and views
Experience with Microsoft Azure for designing, deploying and administering scalable, available and fault-tolerant systems
Familiarity with data modeling and modern Big Data components
Experience with ADLS, Power BI, Azure Synapse Analytics for cloud-based infrastructure and application management
Familiarity with compliance awareness such as PI, GDPR, HIPAA
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with other Cloud platforms such as AWS and GCP is a plus

senior data software engineer

Data Software Engineering

Python, Amazon Web Services, Databricks

40 hrs/week

12+ months

Poland

Are you an experienced Data Software Engineer looking for a new challenge? Join our team as a Senior Data Software Engineer and play a pivotal role in supporting Data Science teams, building efficient data solutions, and contributing to cutting-edge analytics projects.

Proficiency in Python and AWS is key to success in this role.

responsibilities

Collaborate closely with Data Science teams, providing essential support and mentorship as they work on analytical projects
Take charge of building and maintaining tables, responding to incoming support tickets, and offering guidance through minimal ticket interactions
Utilize your expertise to construct datamarts and separate data models that cater to specific analytics needs
Engage in sprint-based development, ensuring timely delivery of data solutions aligned with Data Scientists' requirements
Handle ad-hoc data requests and provide on-call support as necessary
Contribute to the development of data ingestion pipelines, enhancing the efficiency of data processing workflows
Publish comprehensive documentation to aid users in effectively utilizing the data solutions you provide
Collaborate effectively within the team and demonstrate exceptional communication and documentation skills
Embrace constructive feedback and exhibit a proactive attitude towards continuous learning and adapting to new technologies

requirements

A minimum of 3 years of relevant experience in Data Software Engineering, showcasing a strong track record of successful project delivery
Proficiency in Python, enabling you to develop robust and efficient data solutions
In-depth knowledge of Amazon Web Services, utilizing cloud resources to optimize data processing and storage
Experience with Apache Airflow, contributing to streamlined workflow orchestration
Familiarity with Apache Spark, enhancing your ability to work with large-scale data processing
Solid understanding of ETL processes, ensuring efficient data movement and transformation
Proficiency in CI/CD practices, facilitating smooth and automated software delivery
Strong command of SQL, enabling you to manipulate and query complex datasets
Experience working with REST APIs, facilitating seamless data integration with other systems
Fluent English communication skills at a B2+ level, ensuring effective collaboration within an international team

nice to have

Familiarity with DataBricks and Spark, further enhancing your ability to work with big data
Experience with Redshift, contributing to optimized data warehousing solutions

senior data engineer

Data Integration

BigQuery Datasets, Cloud Composer, Google Cloud Platform

40 hrs/week

12+ months

Poland

Currently, we are looking for a remote Senior Data Engineer to join our global team

Currently, we are looking for a remote Senior Data Engineer to join our global team. The customer is a telemedicine company based in Boston that connects patients with doctors over secure video.

responsibilities

Manage, utilize, move and transform data to create reports for senior management and clients
Conduct business analysis on data requests to ensure clarity on the need and proper data usage adherent to security mandates
Build various ETL pipelines among the various tools in play to surface data for consumption by our Reporting Tool
Competing requests from internal and external stakeholders in addition to keeping the reporting infrastructure on par with new product functionality and release cycles
Become a Subject Matter Expert in data classification within the platform and utilize your expertise to identify the most efficient path to deliver data from A to B as needed
Working hand in hand with Hosting, Analytics and Product
Be accountable for the delivery of accurate and timely reporting solutions

requirements

3+ years of experience as Data Engineer
Strong knowledge of GCP Databases
Strong knowledge of Google BigQuery
Strong knowledge of SQL

Big Data engineer jobs in Poland at EPAM Anywhere

A Big Data engineer is a specialist who develops technologies for working with Big Data. This may be the development of a whole software or individual elements within it. The main task of a specialist is to make each product scalable and ready for further improvements.

A Big Data engineer is responsible for creating functional, productive, and technological solutions that meet the business goals and stated requirements of the company or customer. They develop products for working with Big Data from scratch; that is, they are engaged in their planning, development, commissioning, and further support. The Big Data engineer specialty is great for working from home, as long as you have the appropriate qualities for it.

Responsibilities of a remote Big Data engineer in Poland

Each company has its own list of duties for Big Data engineer remote jobs, but most often, work from home duties include:

Conducting requirements analysis
Future product planning
Software development for Big Data
Testing at different stages of software development
Detection and elimination of errors
Records management
Report writing
Finished product support
Introduction of elements that increase the functionality of the software
Software scaling
Implementation of updates

Like all specialties in the IT field, Big Data engineers in Poland have several levels of professionalism on which the list of responsibilities and requirements for the remote job will depend. For beginners, the requirements are minimal, but not all companies are ready to hire them online. Middles will face a long list of required skills like those above. Seniors will also need to manage a team of subordinates.

Requirements of Big Data engineer remote jobs

Big Data engineer remote jobs in Poland typically have the following requirements:

Bachelor's or master's degree in computer technology or engineering
Deep knowledge of databases for working with Big Data
2+ years of experience in a similar position
Experience in remote work
Knowledge of several databases
API experience
Superficial knowledge of Java
Ability to work with tests
Knowledge of new trends in Big Data
Information analysis skills
Ability to work with reports and documentation

Even if you are looking for a remote Big Data engineer job, you will have to constantly interact with both your team and the employees of other departments.

Big Data engineer remote jobs in Poland

Companies pay attention not only to the technical skills of candidates but also to their personal qualities. For example, it is important for them to know how much a specialist is ready to commit to work. A remote worker must be able to properly manage their time. In addition, the following qualities will put you at an advantage for remote work: stress resistance, attention to detail, the desire to constantly improve your knowledge, the ability to find inaccuracies in a timely manner, and the ability to simultaneously manage several projects at once.

Big Data Engineer Jobs in Poland

Big Data engineer jobs in Poland at EPAM Anywhere

Responsibilities of a remote Big Data engineer in Poland

Requirements of Big Data engineer remote jobs

Big Data engineer remote jobs in Poland

Other regions and related skills