AI Software Engineer II

Requirements

• Bachelors degree in computer science, or related technical discipline
• Experience coding in one or more high level languages including, but not limited to Python, C#, Java
• Proven experience in developing and deploying large language models (LLMs)
• Practical experience in prompt engineering and evaluation

Nice to Haves

• Experience with Agent based architectures, frameworks and technologies (such as MCP, A2A protocol, Langchain, Azure AI Foundry)
• Proficiency in Python for data science workflows, leveraging libraries such as NumPy, Pandas, scikit-learn, Matplotlib, and Jupyter
• Exposure to Deep Neural Network training and inference and experience in deep learning frameworks (PyTorch, TensorFlow, etc.)
• Experienced in web application development frameworks, such as React
• Experience delivering a Cloud SaaS product on Azure, AWS or GCP
• Excellent communication and collaboration skills to work effectively across disciplines and partner teams

What You'll Be Doing

• Implement, evaluate, and deploy AI-powered applications and services
• Develop and fine-tune large language models (LLMs) and other deep learning models
• Write clean, maintainable, and scalable code for model training, evaluation, and inference pipelines
• Optimize AI models for performance, latency, and cost efficiency in production environments
• Apply prompt engineering to enhance model outputs and performance
• Collaborate with cross-functional teams to integrate AI solutions into our products
• Stay current with emerging research, tools, and frameworks in AI/ML to drive innovation
• Conduct experiments, analyze results, and communicate findings to both technical and non-technical stakeholders

Perks and Benefits

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.