Negotiable
Undetermined
Hybrid
England, London
Summary: The Full-Stack Developer role involves collaborating with a skilled team to deliver analytical solutions and consultancy projects across various sectors. Key responsibilities include managing data harvesting processes, writing efficient regular expressions, and maintaining data pipelines. The position requires proficiency in programming languages and strong problem-solving skills. The role offers a hybrid working arrangement with two days remote work per week.
Key Responsibilities:
- Manage both scheduled and ad hoc data harvesting processes.
- Write efficient regular expressions to extract data from raw HTML, JSON, and XML.
- Clean and validate harvested data using automated processes.
- Troubleshoot and resolve complex data processing issues.
- Maintain and enhance existing data pipelines and services.
- Improve automation for data processing and delivery.
Key Skills:
- Solid understanding of HTTP protocols and request/response architecture.
- Proficiency in writing Regular Expressions for data extraction.
- Working knowledge of Python, SQL, and either C# or Java.
- Strong problem-solving and debugging skills.
- Effective communication skills for understanding project needs and working with the team.
- Experience with automated data harvesting using Python, C#, or Java (advantageous).
- Familiarity with front-end technologies (JavaScript, React) (advantageous).
- Experience with cloud platforms like AWS or GCP (especially BigQuery) (advantageous).
- Exposure to Big Data tools such as Elasticsearch (advantageous).
- Background in the travel industry (advantageous).
- Knowledge of GitHub and version control best practices (advantageous).
Salary (Rate): undetermined
City: London
Country: England
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Job description
2 days remote/Hybrid
You will be working within a talented team of analysis/consultants to help deliver analytical solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include:
* Manage both scheduled and ad hoc data harvesting processes.
* Write efficient regular expressions to extract data from raw HTML, JSON, and XML.
* Clean and validate harvested data using automated processes.
* Troubleshoot and resolve complex data processing issues.
* Maintain and enhance existing data pipelines and services.
* Improve automation for data processing and delivery.
Core Requirements:
* Solid understanding of HTTP protocols and request/response architecture.
* Proficiency in writing Regular Expressions for data extraction.
* Working knowledge of Python, SQL, and either C# or Java.
* Strong problem-solving and debugging skills.
* Effective communication skills for understanding project needs and working with the team.
Advantageous:
* Experience with automated data harvesting using Python, C#, or Java.
* Familiarity with front-end technologies (JavaScript, React).
* Experience with cloud platforms like AWS or GCP (especially BigQuery).
* Exposure to Big Data tools such as Elasticsearch.
* Background in the travel industry.
* Knowledge of GitHub and version control best practices.
Tech Stack & Tools
* Cloud: AWS, GCP (BigQuery)
* Languages: Python, Java, C#
* Data: SQL, JSON, XML, ElasticSearch
* Other: HTTP, Regular Expressions, GitHub
Please send me copies of your CV if you meet the requirements