Data Engineer

Summary: The Data Engineer role involves preprocessing both structured and unstructured data, enhancing data collection procedures, and developing predictive systems using machine learning algorithms. The position requires analyzing large datasets to identify patterns and propose solutions to business challenges. The engineer will also be responsible for presenting results clearly and ensuring data integrity throughout the analysis process.

Key Responsibilities:

• Carrying out preprocessing of structured and unstructured data
• Enhancing data collection procedures to include all relevant information for developing analytic systems
• Processing, cleansing, and validating the integrity of data to be used for analysis
• Analyzing large amounts of information to find patterns and solutions
• Developing prediction systems and machine learning algorithms
• Presenting results in a clear manner
• Proposing solutions and strategies to tackle business challenges
• Data mining or extracting usable data from valuable data sources
• Using machine learning tools to select features, create and optimize classifiers

Key Skills:

• Expertise in statistical programming languages like Python
• Knowledge of Scala/Java is an added advantage
• Expertise in open telemetry stack with components like Virtual machines, Middleware like IIS/Apache, hypervisor, database etc.
• Understanding of open telemetry OTLP format and making it structured
• Ability to correlate streaming OLTP data with different components and convert it into actionable insights based on applied ML

Salary (Rate): undetermined

City: Sheffield

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT