Data Engineer supporting business intelligence, analytics, and data automation at Associated Wholesale Grocers. Involves building data ecosystem for new company-wide environment.
Responsibilities
Support Availability and Services (50-60%)
Troubleshoot and develop solutions to problems, including using AWG approved AI tools such as Gemini, CoPilot and NotebookLM.
Collaborate with other developers and support engineers to resolve production, enhancement or development issues.
Participate in an on-call rotation for integration and transformation pipelines, legacy systems, and modern data platforms that may involve occasional off-hours and weekend support.
Take ownership of following on-call procedures and instituting permanent fixes for repetitive problems.
Maintain documentation for legacy systems, jobs, modern pipelines, and modernization implementation.
Understand and implement change control procedures (including RFC, CAB, CI/CD).
Deliver Solutions (25%)
Build real-time and batch data integrations from disparate source systems into the data lake/data warehouse/delta lake.
Build and maintain scalable ETL processes using workflow automation tools.
Provide documentation (including Technical Design Documents) for installations and deliverables.
Design dimensional models and be able to cleanse and transform raw data into structured formats.
Administer and maintain data pipelines used for loading data into the data warehouse or lakehouse.
Scale and tune data pipelines, data sets, and SQL queries.
Responsible for Unit testing, support of Integration testing, and User Acceptance Testing.
Learning and Continuous Improvement (10-20%)
Responsible for understanding and adoption of IT Architecture practice.
Continuous learning of existing and future data technologies and tools.
Apply standard methodologies to analyze, design, develop, test, and deploy data management solutions.
Participate in agile story authoring, sizing, and demo sessions for developed features.
Participate in code reviews and receive feedback from the team.
Propose process improvements for continuous department maturity.
Align Roadmap and Strategy (5%)
Collaborate with business partners to understand their business problems or needs and desired outcomes.
In collaboration with other members of the team and user community, configure cloud-based capabilities that enable the AWG community.
Communicate priorities to the technology organization to drive effective business solutions.
Maintain verbal and written issue identification and status updates to cross-functional teams and leadership.
Requirements
Experience: 1-3 years of data engineering or related experience (Associate Analyst level). Basic understanding of data modelling, mapping and data quality/governance practices.
Education: Bachelor’s degree in software engineering, computer science, computer information systems, or related degree, or equivalent professional experience.
SQL Skills: Must be able to read/write SQL in the following environments (SQL Server, Oracle, DB2).
Cloud Experience: Experience working in cloud data environments (AWS, Azure). Experience working with AWS or Azure workflow orchestration tools.
Data Systems: Experience working with one or more columnar storage systems (Snowflake, Redshift, BigQuery, etc.).
Process: Must have completed at least one full cycle of building a data lake and/or a data warehouse.
Analytical Skills: Knowledge and skills with Power BI will be important, not critical.
Soft Skills: Strong business communications skills for requirements gathering and development. Ability to multi-task and change priorities.
Benefits
Medical, Dental, & Vision Insurance
Health Savings Account
Dependent Care Flexible Spending Account
Paid Vacation, Holiday, and Sick Time
401(k) with 4% match along with 3 other contributions
Solutions Architect at Lovable to design solutions aligning with customer goals and technical constraints. Collaborating with teams to drive adoption of AI - native software creation.
Solutions Architect at Orb driving evaluations of billing solutions for prospective clients. Bridging technology and business strategy while enhancing customer relationships and experiences.
Senior Client Solution Manager building strategic partnerships and driving revenue growth on Pinterest. Seeking experienced digital advertising sales professional with strong relationship building skills.
Solutions Architect designing and implementing complex solutions at MassMutual. Collaborating with teams to deliver technologies for sales and distribution processes enhancing business outcomes.
Oracle Applications Architect leading architecture, design, and optimization of Oracle ERP solutions at GDIT. Collaborating with teams to ensure safety and security of the nation through modernization efforts.
Solutions Architect leading Software Engineering for Chemistry Applications. Collaborating with engineers and stakeholders at leading chemical companies to enhance R&D processes.
Senior Manager leading design and implementation of integration solutions for enterprise systems at Simpson Thacher. Collaborating with teams to enhance scalability, security, and reliability.
Consulting Solution Architect developing comprehensive security solutions for CDW customers. Collaborating with sales and delivery teams to drive business growth in Hybrid Infrastructure services.
Senior Data & AI Solutions Architect at DXC Technology managing cloud data platforms and AI solutions. Leading architecture design, customer advisory, and implementation efforts in a remote capacity.
Solution Engineer Intern supporting sales engineering efforts and customer success for innovative automation solutions at Stonebranch. Collaborating with experienced engineers on technical evaluations and proof - of - concept projects.