Databricks Developer Jobs

EPAM Anywhere is looking for Databricks Developers.

Enjoy transparent promotions

Land your ideal Hybris job and get a guaranteed competitive pay that grows together with you. With no limits.

Access enterprise-level perks

SAP remote specialists get a country-specific pack of corporate benefits that includes many disounts, health coverage and relocation opportunities.

Grow your expertise

Get support from a dedicated Skill Advisor, make use of a wide set of education, career growth and personal development services to hit your next career targets.

devops engineer with azure databricks

Data Software Engineering

Databricks, Python, SQL

40 hrs/week

12+ months

Poland

We are looking for a senior remote DevOps Engineer with expertise in Azure Databricks to join our team.

Candidate will be responsible for building and maintaining secure and compliant data processing pipelines using cloud services and Python/Scala languages.

responsibilities

Partner with SME’s and Tech Leads to ensure delivery on commitments
Design, implement and monitor data platforms to meet data pipeline needs
Responsible for data-related implementation tasks including implementing security requirements
Integrate, transform and consolidate data from various structured and unstructured data systems

requirements

At least 3 years of relevant experience in Data Platforms
Strong expertise in Azure Databricks, Azure Synapse Analytics, Data Factory, Data Lake, etc.
Proficiency in data processing languages such as SQL, JAVA, C# or Scala
Familiarity with security best practices, Azure Networking concepts and Azure DevOps
Excellent problem-solving, communication, presentation, documentation and interpersonal skills
Upper-intermediate English level (B2+)

nice to have

Agile development processes (SCRUM and Kanban)

senior data developer python (databricks)

Data Software Engineering

Python, Apache Spark, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking an experienced remote Senior Data Developer Python (Databricks) to join our team.

The ideal will be responsible for designing and implementing end-to-end data solutions, ensuring data quality and providing technical guidance to junior developers. To excel in this role, you should have strong expertise in Python, Databricks, and AWS.

responsibilities

Design, develop and maintain data pipelines using Databricks
Ensure data accuracy and consistency while developing high-quality data solutions
Provide technical expertise and guidance to junior developers
Collaborate with the team to define data architecture and best practices
Work closely with other departments in the company to discover new data sources and optimize existing ones

requirements

Minimum of 5 years of professional experience in Data Software Engineering
Expertise in Python, Databricks, and AWS
Advanced skills in Spark and ELK
Strong knowledge of data modelling and database design
Mastery in Engineering
The ability to work collaboratively as a team member and proactive in approach
English B2+ level

nice to have

Experience with DevOps (Kubernetes, Docker, CICD, etc.)

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Big Data Engineer with expertise in Databricks to join our innovative team.

The ideal candidate should have extensive experience in Spark/Scala and AWS, as well as a solid foundation in Python. In this position, you will be responsible for designing, developing, and deploying large-scale data processing systems with Databricks. You will also be responsible for optimizing data pipelines, monitoring performance, and resolving any related issues. The successful candidate should be able to collaborate closely with other teams, evaluate technical trade-offs, and ensure high-quality solutions are delivered.

responsibilities

Design, develop and maintain high-performance data processing systems using Databricks
Optimize data pipelines and monitor their performance regularly
Identify and troubleshoot issues that occur during data processing
Collaborate with other teams to integrate data solutions into existing platforms
Evaluate technical trade-offs and provide recommendations to improve the platform's performance and scalability

requirements

Minimum 3 years of relevant experience in Data Software engineering
Expertise in DSE Python, AWS, and Databricks
Solid foundation in Spark/Scala and Elastic
Excellent communication skills and the ability to collaborate with cross-functional teams
Fluent in English with an Upper-Intermediate level (B2+)

nice to have

Experience in Apache Airflow and Python

senior data quality engineer (databricks, aws)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Quality Engineer with experience in DSE Python and AWS Databricks.

The successful candidate need have someone with strong analytical skills, excellent communication skills.

responsibilities

Ensure data quality and integrity across all platforms and systems
Collaborate with cross-functional teams to design and implement data management
Develop and execute test scenarios to validate data management systems
Provide technical guidance and mentorship to junior team members
Work directly with customers to validate data requirements and manage data quality issues

requirements

3+ years of experience in Data Software Engineering
Strong working knowledge of DSE Python, AWS Databricks and Apache Spark
Familiarity with testing methods (TDD, BDT, DDT)
Experience with data ingestion pipelines, data warehousing and data lakes
Understanding of CI/CD principles and best practices in data processing
Upper-intermediate English language skills (B2+)

nice to have

Familiarity with Amazon QuickSight, Microsoft PowerBI,
Experience with Big data technologies such as Apache Hadoop and Apache Hive

senior data engineer with python (databricks, aws)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Data Engineer with Python, Databricks and AWS skills to join our team.

The right candidate enjoys working collaboratively to solve complex data engineering challenges that support our business needs.

responsibilities

Design, implement and maintain large-scale data pipelines using Python, Databricks
Work with cross-functional teams to integrate solutions that meet our data processing and analysis needs
Ensure performance, reliability, security and maintainability of data pipelines
Develop monitoring and alerting mechanisms to proactively identify and resolve issues
Continuously look for opportunities to improve data engineering processes and practices

requirements

Minimum of 3+ years with expertise in designing and maintaining large-scale data pipelines
Strong proficiency in Python and Databricks, (AWS) in production environments
Excellent understanding of Big Data technologies, primarily Spark
Strong understanding of data architecture and modelling concepts
Highly knowledgeable about data warehousing principles and practices
Upper-Intermediate level of English (B2+)

nice to have

Experience with Apache Hive

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with expertise in Databricks to lead our team of data engineers and take responsibility for designing and implementing data management solutions.

The successful candidate will be familiar with cloud-based data pipeline development and have experience building optimal data infrastructure solutions.

responsibilities

Lead a team of data engineers, organize teamwork, and solve technical and non-technical challenges
Design key software components of the data platform, and build collaborative partnerships with architects and technical leads
Create and maintain optimal on-prem and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using batch & streaming methods
Assemble large, complex data sets that meet functional and technical requirements, and develop data flows that can leverage both on-premise and cloud architectures
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs

requirements

Bachelor's degree in Computer Science, Information Systems, or another applicable field is preferred
At least 3 years of experience in a Data Engineer role
Advanced working knowledge of cloud-based data pipeline development, particularly on AWS
Experience building and optimizing data pipelines for data acquisition and management
Expertise in Databricks, Python, SQL, and AWS
B2+ English level

nice to have

Understanding of message queuing, stream processing, and Change Data Capture mechanisms

senior data software developer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Developer to join our team.

The ideal candidate should also have experience working with Python and Azure Databricks. The successful candidate will develop reusable DataBricks components for data ingestion and data analytics, ingest data into data lake for reporting and predictive modelling, ensure security controls, integrate data governance and establish clear auditable data lineage. They will collaborate with architects, technical leads and key individuals within other functional groups. The Senior Data Software Developer will also actively participate in code review, test solutions and write project documentation.

responsibilities

Build reusable DataBricks components for data ingestion and data analytics
Ingest data via batch, streaming, replication into data lake for reporting and predictive modelling
Ensure security controls, integrate with data governance and establish clear auditable data lineage
Collaborate with architects, technical leads and key individuals within other functional groups
Participate in code review, testing solutions and writing project documentation

requirements

At least 3 years of experience in Data Software Engineering
Proficiency in Python and Azure Databricks is a must
Experience building data ingestion pipelines, Data Warehouse or Database architecture
Data modeling skills with hands-on development experience with modern Big Data components
Cloud experience in designing, deploying and administering scalable, available and fault-tolerant systems
An extensive understanding of regulatory compliance such as PI, GDPR, HIPAA
B2+ English level

nice to have

Leadership skills

senior data engineer

Data Software Engineering

Python, Amazon Web Services, Databricks

40 hrs/week

12+ months

Poland

We are searching for a skilled Senior Data Engineer to join our team.

If you are proficient in Python and AWS, and you have experience with migrating GCP BigQuery and DataFlow pipelines into Databricks hosted on AWS, we invite you to apply for this exciting opportunity.

responsibilities

Collaborate with the team on the migration of GCP BigQuery and DataFlow pipelines to Databricks hosted on AWS, ensuring a seamless transition
Design, develop, and optimize data pipelines using Python, Spark, and Databricks to meet business requirements and enhance data processing efficiency
Work closely with cross-functional teams to understand data requirements and contribute to the architecture and implementation of data solutions
Perform data modeling and transformation tasks to prepare data for analysis and reporting
Collaborate on code reviews, ensuring the quality and reliability of data pipelines
Troubleshoot and resolve issues related to data pipelines, ensuring smooth and consistent data flow

requirements

A minimum of 3 years of relevant experience as a Data Software Engineer, demonstrating your proficiency in developing and optimizing data solutions
Strong familiarity with AWS, leveraging its resources for hosting and managing data solutions
Proficiency in Python, utilizing its capabilities to build robust and efficient data pipelines
Experience with Apache Spark, enabling you to work with large-scale data processing and analysis
Expertise in Databricks, particularly in the context of migrating pipelines and working on AWS-hosted platforms
Solid command of SQL, allowing you to perform data transformations and analysis effectively
Fluent English communication skills at a B2+ level, facilitating effective collaboration with a diverse team

nice to have

Familiarity with GCP, particularly experience with BigQuery and DataFlow
Knowledge of GCP BigQuery and DataFlow, aiding in the migration process and facilitating collaboration across platforms

senior data azure software engineering

Data Software Engineering

Databricks, Python, SQL

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Azure Software Engineer.

We are looking for a remote Senior Data Azure Software Engineer . The ideal candidate will be responsible for building POCs for the replacement of external vendors within Estee Lauder Azure infrastructure and must have a holistic view of the project.

responsibilities

Building POCs for the replacement of external vendors within Estee Lauder Azure infrastructure
Setting up required Azure services, extracting data from the data lake (EDL), building service layers
Mimicking the current existing application
Working independently with 3rd party vendors
Having a holistic view of the project

requirements

At least 3 years of hands-on experience in Data Software Engineering
Proficiency in Azure, DSE Python, and Azure Databricks
Strong knowledge of PySpark, Python, advanced SQL and Python web services (Django, Flask)
Experience with Databricks and Microsoft Azure
Upper-Intermediate English level (B2+)

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team.

The ideal candidate should have solid/hands-on experience in Azure, PySpark, Python, Python web services, Databrics, and Advanced SQL. Moreover, the candidate must possess excellent communication skills with an upper-intermediate English level.

responsibilities

Build a POC for replacement of the external vendor
Scope the setup of the required Azure services
Extract data from data lake (EDL) and process data based on application requirements and architecture
Build service layer and mimic the current existing application
Work collaboratively with the team and report technical challenges and bugs in a timely and efficient manner

requirements

Minimum of 3 years of experience in Data Software Engineering
Strong knowledge of Azure, PySpark, Python, Python web services, Databrics, and Advanced SQL
Familiarity and ability to use Azure services
Strong knowledge on how to extract data from data lakes (EDL) and process data
Excellent communication skills with an upper-intermediate English level

nice to have

Excellent organizational skills

Databricks Developer Jobs

Related skills