Big Data Engineer (Spark / Scala / Power BI) @ USA _ Remote
Posted 1 day ago by 1763642081
Negotiable
Outside
Remote
USA
Summary: The Big Data Engineer role focuses on leveraging expertise in Apache Spark, Scala, SQL, and Power BI to design scalable data solutions and develop analytical workflows. The position requires collaboration with cross-functional teams to ensure data quality and compliance while delivering interactive reports for business decision-making. The ideal candidate will have a strong background in big data technologies and experience in creating data visualizations. This is a long-term remote position based in the USA, specifically requiring work in the PST time zone.
Key Responsibilities:
- Design, develop, and maintain scalable big data solutions using Apache Spark and Scala.
- Write and optimize complex SQL queries for data transformation and analytics.
- Develop, optimize, and maintain Power BI dashboards for reporting and visualization.
- Collaborate with cross-functional teams to integrate data pipelines and reporting solutions.
- Ensure data quality, security, and compliance across all systems.
Key Skills:
- Strong proficiency in Apache Spark with hands-on experience in Scala.
- Solid understanding of SQL for data manipulation and analysis.
- Experience in Power BI for building interactive dashboards and reports.
- Familiarity with distributed computing and big data ecosystems (Hadoop, Hive, etc.).
- Ability to work with large datasets and optimize data workflows.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Position: Big Data Engineer (Spark / Scala / Power BI)
Location: Redmond, WA (Remote)– Must work in PST time zone)
Duration: Long Term
Please share the resume at
Job Description
We are seeking an experienced Big Data Engineer with strong expertise in Apache Spark, Scala, SQL, and Power BI. The ideal candidate will be responsible for designing scalable data solutions, developing analytical workflows, and delivering interactive reports to support business decision-making.
Key Responsibilities
Design, develop, and maintain scalable big data solutions using Apache Spark and Scala.
Write and optimize complex SQL queries for data transformation and analytics.
Develop, optimize, and maintain Power BI dashboards for reporting and visualization.
Collaborate with cross-functional teams to integrate data pipelines and reporting solutions.
Ensure data quality, security, and compliance across all systems.
Required Skills & Experience
Strong proficiency in Apache Spark with hands-on experience in Scala.
Solid understanding of SQL for data manipulation and analysis.
Experience in Power BI for building interactive dashboards and reports.
Familiarity with distributed computing and big data ecosystems (Hadoop, Hive, etc.).
Ability to work with large datasets and optimize data workflows.
Highly Desirable Skills
Spark performance tuning and optimization expertise.
Knowledge of cluster resource management and resolving performance bottlenecks.
Experience with Azure big data services (Azure Data Lake, Databricks, Synapse).
Exposure to cloud platforms like AWS or Google Cloud Platform.
Experience working in financial domain or with ERP systems (SAP, Oracle ERP).
Understanding of regulatory and compliance requirements in financial data processing.
Additional Qualifications
Strong analytical and problem-solving skills.
Excellent communication and team collaboration abilities.
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.