Upwork is hiring a Professional Sport Analytics Platform

I am a GM for a professional football (soccer) team in Europe, with a 20 year background in technology strategy. We are looking for a freelance developer who has expertise in web-scrapping to populate and established RDS in AWS. The primary task is to utilize an existing GitHub repository, specifically designed for scraping data from the a target website. Requirements for the project:

1. Utilize and build upon the existing scraper package in a GitHub repository. This repository is tailored for scraping data from a single site that is a comprehensive database for professional football (soccer) information. The scraper delves into the site's hierarchy to retrieve data on competitions, games, clubs, players, and appearances, converting them into JSON format.

2. Demonstrate proficient knowledge and prior experience in working with APIs, with a specific focus on the Scrapy package for Python. Your expertise should include developing, maintaining, and optimizing web scraping tools and methodologies.

3. Deliver a comprehensive JSON file containing all the professional clubs and players data from the target website. This data should be structured and precise, ready for conversion to CSV format and storage on AWS S3.

4. Develop a mechanism for periodic updates, allowing the scraper to refresh and capture new data as it becomes available on the targe website or other source website. This feature is crucial to ensure that our database remains current and valuable.

Qualifications:

· Proven experience in Python, with a strong emphasis on web scraping techniques.

· Familiarity with Scrapy or similar web scraping frameworks.

· Experience in handling and structuring large datasets (in JSON & CSV format) and uploading to cloud storage solutions like AWS S3.

· Ability to write clean, maintainable, and efficient code.

· Excellent communication skills and the ability to work independently.

The initial scope of work will be used to demonstrate depth of skills, speed and fit, focused on the ability to adjust the existing scraping scripts to capture additional data required. The role will provide the opportunity for a permanent role and involvement in the project moving forward.

The developer will need to collaborate closely with the lead developer.