Data Engineer at Vidalink developing and managing data pipelines and ensuring quality across various data sources. Building connections and processes for cloud-based data environments.
Responsibilities
Design, implement and maintain the connection between different environments and data sources, ensuring secure and efficient integration.
Develop and operate processes to ingest data from transactional (production) systems into the analytical layer, ensuring quality and consistency.
Apply and promote best practices in data modeling to ensure scalability, performance and analytical usability.
Build, orchestrate and monitor data pipelines across all architecture layers (ingestion, processing and consumption).
Ensure performance, reliability and SLA compliance for data and pipelines, proactively identifying and resolving issues.
Requirements
Strong experience with SQL and Python for data processing and transformation.
Hands-on experience with relational and analytical databases (e.g., PostgreSQL, SQL Server, BigQuery).
Experience with NoSQL databases, especially MongoDB.
Experience with messaging and data streaming platforms, with a focus on Apache Kafka.
Experience building ETL/ELT pipelines, with both batch and streaming ingestion.
Knowledge and experience with Databricks (Apache Spark) for distributed data processing.
Use of data orchestration and integration tools such as Airflow, Airbyte, dbt, Glue.
Experience in cloud computing environments (Azure is a plus).
Use of Git for code versioning and basic CI/CD practices.
Benefits
Medication plan
50% coverage for general prescription medications and 100% coverage for medications related to women’s health.
360° wellness:
Totalpass
Conexa Saúde: online therapy
Personalized meal plans
Wellness check-up: assess your physical and mental health
Physical and mental wellness content
Platform with more than 3,500 video classes across various fitness modalities
Commitment to diversity
No dress code (feel free to wear shorts whenever you want!)
Bridge days for all public holidays
Birthday day off
Lots of fun (we love a party!)
Hybrid model (2 days in the office in São Caetano do Sul).
Backup Engineer responsible for managing and ensuring data protection and recovery at Qualysoft, an IT consulting firm. Focus on innovative IT solutions and compliance with business requirements.
Modern Workplace Engineer for Microsoft 365 improving infrastructure and user experience. Collaborating on projects and technical support for migration and transformation in a hybrid work environment.
V&V Intern supporting testing and validation of electronic products at Fluke Engineering. Collaborating with engineers and participating in lab activities for product reliability.
Electrical Project Engineer supporting Project Managers and collaborating on electrical infrastructure projects. Preparing and reviewing designs, performing analyses, and ensuring project delivery with multi - disciplinary teams.
Mechatronics Engineer responsible for product design and automatized systems development at Videndum. Collaborating with teams to ensure design intent and product testing.
Hardware Engineer responsible for designing hardware solutions and supporting manufacturing efficiency at Emerson. Collaborating across engineering, project management, and supply chain for successful project execution.
Repair Engineer at Ebara Elliott Energy performing engineering assignments and providing technical support in Indonesia. Responsibilities include design improvements and planning for repair jobs.
Consulting Senior Associate for Air Quality and Meteorology at ERM, supporting monitoring programs and guiding environmental strategies. Collaborating with over 300 air quality professionals for impactful solutions.
Electrical Project Engineer at Samudera Indonesia overseeing product/service development and project budgeting. Collaborating on engineering projects in the shipping industry with a global reach.
Sr. Industrial Engineer developing labor modeling strategies for Nordstrom's Restaurant Division. Leading innovative workforce planning and operational efficiency initiatives in a hybrid role.