What You'll Be Doing

• Design, build, and maintain automated test frameworks for the AI Gateway, backend services, and cloud integrations.
• Develop end-to-end, integration, API, and regression tests covering gateway functionality across multiple AI providers.
• Test integrations with AWS Bedrock, Azure OpenAI, Google Vertex AI, OpenAI, Anthropic, and other providers.
• Automate cloud authentication scenarios using API keys, IAM roles, role assumption, service accounts, and identity federation.
• Validate AI API behavior including streaming responses, tool calling, embeddings, multimodal requests, and error handling.
• Test gateway features such as routing, retries, failover, rate limits, quotas, budgets, authentication, authorization, and usage metering.
• Build reusable test utilities, provider mocks, simulators, and automated cloud test environments.
• Develop performance, load, and resilience tests simulating outages, throttling, timeouts, network failures, and partial responses.
• Integrate automated tests into CI/CD pipelines, enhancing test reliability and reducing developer feedback time.
• Investigate defects using logs, metrics, traces, and source code, turning production issues into regression tests.
• Collaborate closely with software engineers on feature design, testability, and quality throughout the development lifecycle.

Requirements

• 2+ years of experience in software development, SDET, test automation, or similar engineering roles.
• Strong programming skills in Go, Python, Java, or another modern programming language.
• Hands-on experience developing automated testing frameworks and tools beyond individual test cases.
• Experience testing backend services, REST APIs, and distributed system integrations.
• Good understanding of HTTP, JSON, networking fundamentals, authentication, and common failure scenarios.
• Comfortable working with Linux, Git, Docker, and debugging tools.
• Ability to read production code, investigate failures across services, and identify root causes.
• Solid understanding of test design, regression testing, negative testing, and automated integration testing.
• Ability to work independently on features and collaborate effectively with other engineers.

Nice to Haves

• Experience with Go for backend development or test automation.
• Experience testing API gateways, proxies, microservices, or cloud infrastructure platforms.
• Familiarity with LLM APIs and providers like AWS Bedrock, Azure OpenAI, Google Vertex AI, OpenAI, or Anthropic.
• Experience testing streaming protocols such as Server-Sent Events (SSE), WebSockets, or gRPC.
• Experience with performance and load-testing tools like k6, Locust, or JMeter.
• Familiarity with OAuth/OIDC, IAM, RBAC, SSO, and enterprise identity systems.
• Experience with OpenTelemetry, Prometheus, Grafana, or distributed tracing.
• Experience testing multi-tenant SaaS applications, rate limiting, quotas, or usage-based billing systems.

Perks and Benefits

• Market leader in compensation and equity awards.
• Comprehensive physical and mental wellness programs.
• Competitive vacation and holidays for recharge.
• Paid parental and adoption leaves.
• Professional development opportunities for all employees regardless of level or role.
• Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections.
• Vibrant office culture with world class amenities.
• Great Place to Work Certified™ across the globe.