Senior Data Engineer optimizing data pipelines for a startup improving urban safety and cleanliness. Collaborating with data science and DevOps teams to ensure data reliability and performance.
Responsibilities
Design, develop, and maintain robust, automated, and scalable data pipelines.
Ensure the quality, security, and reliability of data across its entire lifecycle.
Define and maintain infrastructure-as-code for data-related services.
Build and maintain dashboards, monitoring tools, and reports for internal teams.
Collaborate closely with Data Science, DevOps, and Product teams to ensure data consistency and maximize the value of data.
Monitor and optimize performance using observability tools (Datadog, Grafana, Prometheus).
Requirements
Master's degree (or equivalent) in Computer Science, Data Engineering, Artificial Intelligence, or a related field.
5+ years of experience in Data Engineering, preferably in cloud and AI environments.
Excellent proficiency in Python and development best practices (testing, version control, packaging).
Strong knowledge of SQL and NoSQL databases (PostgreSQL, DynamoDB).
Project Manager overseeing payroll system implementation with global outsourcing partner. Leading cross - functional teams and stakeholder engagement for project success.
Data Engineer 3 optimizing Market Place processes for Walmart Global Tech's Chennai team. Developing data pipelines and ensuring efficient utilization of Market Place systems.
Data Engineer at CBTW handling data pipelines and ETL processes using SAS. Collaborating with business stakeholders and ensuring data governance within SAS environments.
Data Engineer I at Catalyst Brands developing and optimizing data pipelines for cross - functional teams. Designing next generation data platform architecture to meet increasing data demands in a retail environment.
Data Engineer at Grupo Iter responsible for data pipelines and architecture in Azure. Collaborating on data governance and integrating analytics with Power BI.
Full Stack Data Architect for Concurrency designing Azure data - intensive applications. Leading complex data architecture initiatives and mentoring engineering teams in a high - performance environment.
AHEAD builds digital business platforms; seeking a Data Engineer in a development program. Join us to grow into a technical leader emphasizing skills across various practices.
Data Engineer creating clean, reliable data pipelines for Plenti, a fintech lender. Collaborating with modern tools like AWS and Databricks to enhance data quality and analytics.