Senior AI Platform Engineer designing core AI framework on data platform for financial technology company. Integrating AI services with pipelines and mentoring fellow engineers in a hybrid work environment.
Responsibilities
Design and build a scalable Agentic AI framework on top of our data platform
Implement MCP- and A2A-based architectures for agent collaboration and orchestration
Integrate AI services with data pipelines (Airflow, Spark, Trino, StarRocks, DBT)
Build APIs, SDKs, and tooling to enable other teams to use the framework
Work with platform and application teams to ensure secure, reliable, and multi-tenant deployment of AI agents
Evaluate new agentic AI, LLM, and orchestration technologies and recommend adoption
Mentor other engineers and contribute to AI engineering best practices
Requirements
Strong programming skills in Python with 5+ years of experience
Proven experience with data engineering or distributed systems (Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes)
Deep understanding of LLM-based systems and agent frameworks (LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A)
Hands-on experience with API design & integration (REST, GraphQL, gRPC)
Knowledge of cloud infrastructure & container orchestration (Kubernetes, Docker)
Strong understanding of IAM, security, and multi-tenancy in enterprise systems
Track record of building production-grade AI/data platforms
Experience in Information Security (Nice-to-Have)
Experience with vector databases (pgvector, Pinecone, Weaviate, Milvus, Vespa) (Nice-to-Have)
Familiarity with event-driven architectures (Kafka, Pulsar) (Nice-to-Have)
Understanding of retrieval-augmented generation (RAG) patterns (Nice-to-Have)
Background in authorization/identity systems (ReBAC, RBAC, Zanzibar-style) (Nice-to-Have)
Familiarity with observability (OpenTelemetry, DataHub, MLflow, Prometheus) (Nice-to-Have)
Experience in enterprise AI governance (audit, lineage, compliance) (Nice-to-Have)
Contributions to open-source AI frameworks (LangChain, OpenAI MCP, Hugging Face, etc.) (Nice-to-Have)
Lead Platform Engineer at TD Securities, developing a high performing Trading Risk Warehouse platform. Responsible for ensuring stability and scalability, while managing underlying infrastructure and supporting development teams.
Lead Platform Engineer at Capital One driving transformation in technology and solutions with Agile practices and DevOps tools. Collaborating on complex technical problems in a fast - paced environment.
Data Platform Engineer managing daily operations of data platforms for a global cybersecurity company. Collaborating with teams to ensure platform reliability and performance.
Senior Platform Engineer focused on building internal platform capabilities for developer tooling and experience at MONY Group. Collaborating with teams to enhance platform engineering and software delivery.
Databricks Platform Engineer working on AWS ecosystem design, build, and optimization. Responsible for implementing scalable pipeline solutions across data platforms.
Senior Data & Platform Support Engineer supporting Oracle databases at the Federal Reserve Bank. Collaborating with teams to ensure operability of payment systems and enhance business outcomes.
IT Project Manager involved in managing diverse projects at Fidelity focusing on architecture and data solutions. Lead delivery teams in technology initiatives enhancing existing systems.
Data Platform Engineer transforming operational data into clean, analysis - ready datasets for Versana's platform. Collaborating within a team to implement data engineering practices and ensuring data quality standards.