Gigged.AI is a freelance talent marketplace specialising in the IT and technology sector. We have an opportunity live at the moment for a skilled Fullstack (Python) Developer. This is a fully remote project with an expected duration of 2-3 months at a budget of 31,500 ( 700 per day) It is outside IR35 (pending final determination). If interested then you must submit a proposal through the Gigged.AI website for this gig. You can do so here - https://app.gigged.ai/The role involves building scalable pipelines for data extraction, processing, and indexing into a search engine, leveraging both APIs and web scraping. The ideal candidate should have experience in working with large datasets, cloud services, and full-stack technologies.Core Tasks:- Develop and maintain data ingestion pipelines that gather, process, and store structured and unstructured data.- Build and optimize APIs for data retrieval and storage.Integrate data with search platforms such as Elasticsearch for querying and analysis.- Ensure robust error handling, logging, and batch processing to maintain high system reliability.Collaborate with cross-functional teams to enhance data accessibility and insights.- Perform ongoing improvements to system scalability and performance.- Work with large language models such as Groq and OpenAI.Core Skills & Technologies:- Python: Proficiency in Python, with experience using libraries like requests, json, and data extraction tools.- Web Scraping & APIs: Experience building and maintaining web scrapers and integrating with external APIs.- Search Technologies: Strong understanding of search engines like Elasticsearch, including indexing, querying, and bulk operations.- Data Processing: Experience with data transformation techniques and handling large datasets efficiently.- Cloud Services: Experience with cloud infrastructure (AWS, Azure, or GCP) for hosting and scaling the solution.Error Handling & Logging: Knowledge of robust logging practices and exception handling.- Version Control: Proficient with Git and collaborative development workflows.- Knowledge of large language models such as Groq and OpenAI essential.If you have any questions around this then please reach out to hello@gigged.ai











Show more















Show less