Sr. Software Engineer - Charlotte AI (Hybrid, ROU)

What You'll Be Doing

  • Provide hands-on technical leadership for architecture, development, and operation of backend microservices and AI-native platform capabilities.
  • Build, deploy, and scale production agents and agentic systems including orchestration, tool use, planning, retrieval, memory, and human-in-the-loop workflows.
  • Design reliable integrations with hosted Large Language Models and support open-source and fine-tuned models with routing, fallbacks, and graceful degradation.
  • Define and improve evaluation strategies for agent quality, safety, and reliability using various testing and feedback methods.
  • Collaborate with platform and ML specialists to scale model serving focusing on availability, throughput, latency, capacity, and cost.
  • Build and maintain data and MLOps pipelines for data curation, evaluation, model adaptation, and production deployment.
  • Design safeguards against prompt injection, data leakage, unsafe tool use, and cross-tenant access while ensuring auditability and least-privilege access.
  • Establish production-readiness standards including SLOs, observability, tracing, testing, release controls, incident response, and operational reviews.
  • Use established CrowdStrike tools and services to build cloud security solutions.
  • Set technical direction, lead design reviews, and make pragmatic architecture decisions while remaining hands-on with code.
  • Collaborate across engineering, product, data science, security research, and operations teams to deliver solutions.
  • Mentor engineers and continuously improve product architecture, user experience, performance, and reliability.
  • Own work end to end: develop, test, deploy, monitor, and improve your changes.
  • Thrive in a collaborative and agile environment focusing on trust, learning, and customer outcomes.

Requirements

  • Degree in Computer Science or related field, or equivalent practical experience.
  • Hands-on experience building, deploying, and operating LLM-powered agents or agentic systems in production.
  • Significant software engineering experience including technical leadership of complex, cross-team initiatives.
  • Strong experience with backend microservices, cloud platforms, data-intensive systems, and distributed system concepts like partitioning, concurrency, consistency, fault tolerance, and scaling.
  • Experience integrating language models into production software and handling model/provider variability.
  • Ability to evaluate and troubleshoot AI systems, focusing on quality, safety, latency, cost, and reliability.
  • Strong coding skills in Go, Python, or comparable languages with willingness to work across both.
  • Thorough understanding of engineering best practices including testing, peer review, secure design, resilient architecture, and production observability.
  • Ability to make sound technical trade-offs, communicate clearly, and influence engineering direction.
  • Proven ability to thrive in a test-driven, collaborative, and iterative engineering environment.
  • Track record of delivering high-quality, continuously integrated software operated in production.
  • Team-first mindset and commitment to mentoring and developing other engineers.
  • Proven experience using AI technologies to enhance decision-making, streamline workflows, improve efficiency, and drive business outcomes.

Nice to Haves

  • Hands-on experience fine-tuning LLMs including data curation, supervised fine-tuning, and parameter-efficient techniques like LoRA.
  • Experience deploying and scaling open-source or fine-tuned LLMs in production with GPU capacity planning, batching, caching, quantization, and inference optimization.
  • Experience with preference optimization, reinforcement learning from feedback, or model distillation.
  • Exposure to Go, AWS, Cassandra, Kafka, and Elasticsearch.
  • Prior experience in cybersecurity or intelligence.
  • Contributions to relevant open-source projects, applied research, or technical publications.

Perks and Benefits

  • Market leader in compensation and equity awards.
  • Comprehensive physical and mental wellness programs.
  • Competitive vacation and holidays for recharge.
  • Paid parental and adoption leaves.
  • Professional development opportunities for all employees regardless of level or role.
  • Employee networks, geographic neighborhood groups, and volunteer opportunities to build connections.
  • Vibrant office culture with world-class amenities.
  • Great Place to Work Certified™ across the globe.
AI Summary ✨

Similar jobs

  • a day agoNew
  • 4 days ago
  • Staff Technical Lead Health Features, Backend, Data Infrastructure

    Google·Bucharest, Romania

    ≈ €94k – €97k / yearbase

    5 days ago
  • 6 days agoRemote
  • See all jobs in Romania →