Upwork is hiring a Looking For a Senio Data Engineer - Contract to Hire

Overview:

We are seeking a skilled and experienced Senior Data Engineer to join our growing team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining the data pipelines and infrastructure that support our data analytics and machine learning initiatives. You will work closely with data scientists, analysts, and software engineers to build scalable and efficient data processing systems that enable the organization to extract insights and drive business value from large and complex datasets.

Responsibilities:

Design and implement data pipelines to ingest, process, and store large and complex datasets from a variety of sources (e.g. log files, APIs, databases, etc.)

Build and maintain data infrastructure using a combination of on-premises and cloud-based technologies (e.g. Hadoop, Spark, AWS, etc.)

Collaborate with data scientists and analysts to understand their data needs and help them access and analyze data

Develop and maintain documentation for data pipelines and infrastructure

Participate in code and design reviews to ensure the quality and maintainability of the data processing systems

Continuously improve the performance, reliability, and scalability of the data pipelines and infrastructure

Requirements:

Bachelor's degree in Computer Science, Engineering, or a related field

5+ years of experience as a Data Engineer or a similar role

Strong knowledge of SQL and experience with at least one programming language (e.g. Python, JavaScript, etc.)

Experience with big data technologies such as Hadoop, Spark, and/or AWS

Experience with data pipeline and workflow management tools (e.g. Airflow, Luigi, etc.)

Strong problem-solving and communication skills

Experience with machine learning is a plus, but not required

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.