Senior Data Engineer at Red Hat designing and optimizing 데이터 솔루션 supporting sales and forecasting. Collaborating with teams and applying modern data engineering practices to ensure data quality.
About the role
- Data Engineer II analyzing data across platforms including Disney, ESPN, and ABC. Ensuring data quality to enhance user personalization and drive content creation for millions.
Responsibilities
- Partner with development and product leads to capture and understand software specifications and test requirements.
- Evaluate software for intended functional capabilities and properties.
- Design data quality metrics with accompanying queries and reports to be run on a consistent basis.
- Effectively communicate findings with development and product teams to improve the product.
- Run tests and generate reports on a consistent basis.
- Work in an Agile environment that focuses on collaboration and teamwork
Requirements
- 3+ years designing and executing queries and reports to ensure data quality and discover anomalies
- 3+ years experience with Databricks or similar data lake
- 3+ years experience with Spark, Python, or SQL
- Advanced knowledge of debugging code and software development languages
- Ability to collate data and compile test reports
- Excellent software troubleshooting skills
- Excellent communication skills with product and development team to ensure highest test coverage possible.
- Expert level experience with various data lakes (preferred)
- Experience leading and mentoring colleagues on best practices and technical concepts of building large scale solutions (preferred)
- Extensive experience defining data quality metrics (preferred)
- Experience with real-time analytics on the level of billions of events per week (preferred)
- Experience with: Databricks, Spark, Python, JIRA, Charles, Postman (preferred)
Benefits
- A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer leading the design and implementation of data pipelines for NVIDIA’s analytics and monitoring systems. Collaborating across teams to enhance data ingestion and analysis capabilities.
Associate Data Engineer at Boeing India supporting API Development and Data migration with a focus on engineering and technology solutions. Involves working independently to gather requirements and supporting architecture for API services and data analytics.
Senior Data Engineer building and maintaining robust data pipelines for various data products at Beep Saúde. Collaborating within the team and leading data governance practices.
Software Developer in Test working on cloud - based data platform at Tecsys. Ensuring quality and reliability of data pipelines and transformations using automation frameworks.
Data Engineer responsible for designing, building, and optimizing data pipelines and architectures in a tech environment. Requires extensive experience with modern data warehousing and cloud platforms.
Lead Data Engineer role at Brillio focusing on AI & Data Engineering with expertise in Azure and MS Fabric. Collaborate within the Data Engineering team in Pune, Maharashtra, India.
Data Architect at Whiteshield designing scalable, secure data architectures for national and enterprise transformation programs. Architecting modern data platforms to support analytics, AI and operational use cases.
Data Engineer managing scalable data ecosystems for actionable business intelligence and cross - functional stakeholder collaboration. Optimizing ETL/ELT pipelines and ensuring data integrity and security.
Data Engineer specializing in data architecture and solutions for a banking environment, driving value for customers through innovative engineering practices and technologies in data management.