Negotiable
Outside
Remote
USA
Summary: The ITSS-Azure Developer role at NTT DATA focuses on creating efficient data ingestion solutions within a cloud-based environment, specifically using Azure Databricks. The position requires designing and implementing scalable data pipelines and developing reusable frameworks for various data types. Candidates should have extensive experience with Azure Databricks and proficiency in Apache PySpark. This is a remote position based in Louisville, Kentucky, with a focus on innovation and adaptability within the organization.
Key Responsibilities:
- Designing and implementing data ingestion pipelines to efficiently bring data from various sources into Azure Databricks.
- Developing scalable and reusable frameworks for easy ingestion of different types and formats of data.
Key Skills:
- Strong expertise with 8+ years of experience in Azure Databricks.
- Proficiency in Apache PySpark for developing distributed data processing solutions.
- Familiarity with Azure Data Factory for orchestrating data workflows.
- Experience with Azure Data Lake Storage and Azure Key Vaults.
Salary (Rate): £44.00 hourly
City: Louisville
Country: United States
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
description: 335444
100% Remote
W2 or C2C
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a ITSS-Azure Developer to join our team in Louisville, Kentucky (US-KY), United States (US).
Job Description:
This position is focused on building efficient and robust data ingestion solutions within a cloud-based environment, specifically leveraging Azure Databricks. The role entails:
- Designing and implementing data ingestion pipelines:
You will be responsible for architecting and developing data pipelines that can efficiently bring in data from various sources (such as databases, flat files, APIs, or streaming data) into the organization's Azure Databricks platform. The expectation is that these pipelines will be highly performant, scalable, and reliable, meeting the demands of large-scale data processing. - Developing scalable and reusable frameworks:
The position requires you to create frameworks and tools that enable the easy ingestion of different types of data (structured, semi-structured, unstructured) and formats (CSV, JSON, Parquet, etc.). These frameworks should promote code reuse, maintainability, and adaptability to new data sources, reducing repetitive development effort and ensuring consistency across data ingestion processes.
Skills Required:
- Necessary:
- Strong expertise with 8+ years of experience in Azure Databricks:
You should have in-depth, hands-on experience with Azure Databricks, including building and orchestrating Spark-based data pipelines, managing clusters, and working with notebooks and workflows. - Apache PySpark:
Proficiency in PySpark is essential for developing distributed data processing solutions within Databricks, enabling large-scale data transformation and ingestion tasks.
- Strong expertise with 8+ years of experience in Azure Databricks:
- Nice to Have:
- Azure Data Factory:
Familiarity with Azure Data Factory is beneficial as it is often used for orchestrating and scheduling data workflows across Azure services. - ADLS (Azure Data Lake Storage) / Key Vaults:
Experience with Azure Data Lake Storage is valuable for handling large volumes of raw and processed data. Knowledge of Azure Key Vaults is advantageous for securely managing secrets and credentials required by data pipelines.
- Azure Data Factory:
About NTT DATA:
NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com
Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting pay range for this role is $52-$57.70/hour. Actual compensation will depend on several factors, including the candidate s relevant experience, technical skills, and other qualifications. This position may also be eligible for incentive compensation based on individual and/or company performance.
This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits.