Principal Data Scientist

Overview

Are you passionate about using data, experimentation, and measurement science to influence product strategy and business outcomes at global scale? Do you thrive in ambiguous environments and enjoy helping senior leaders make better decisions through analytical rigor, customer insights, and evidence-based recommendations?

The Windows Data & Applied Sciences team is seeking a Principal Data Scientist to shape the future of Windows through world-class decision science, measurement, experimentation, and AI evaluation. You will partner with Product, Engineering, Design, Research, and Business leaders to evaluate strategic investments, define success metrics, measure outcomes, and influence product direction across the Windows ecosystem.

As a senior technical leader, you will define decision frameworks, establish measurement strategies, evaluate AI-powered experiences, and help leaders assess progress against strategic objectives. Your work will drive clarity, accountability, and business impact at Windows scale.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

Strategic Decision Science & Measurement Leadership

• Define measurement frameworks used to evaluate strategic investments, prioritize opportunities, and assess product and business outcomes.
• Partner with Senior Directors and senior leaders to frame complex business questions and translate ambiguity into actionable decisions.
• Define success metrics, KPIs, and accountability mechanisms for critical initiatives.
• Influence product and business strategy through data-driven insights, analytical frameworks, and evidence-based recommendations.

Experimentation, Analytics & Impact Assessment

• Lead large-scale experimentation, causal inference studies, forecasting efforts, and impact assessments.
• Develop scalable measurement systems and evaluation frameworks for products, features, and strategic initiatives.
• Establish best practices for experimentation, statistical rigor, metric development, and decision quality.
• Quantify the impact of investments and provide recommendations on future direction.

AI Evaluation & Responsible Innovation

• Define evaluation frameworks and success metrics for AI-powered product experiences.
• Design and operationalize offline and evaluation methodologies to assess quality, reliability, usefulness, and customer value.
• Partner with Product and Engineering teams to establish launch criteria, guardrail metrics, monitoring frameworks, and evidence-based decision processes.
• Drive Responsible AI practices, ensuring fairness, reliability, transparency, privacy, and measurement integrity.

Technical Leadership & Influence

• Develop reusable methodologies, analytical frameworks, and best practices that raise the quality bar across the organization.
• Communicate insights, risks, trade-offs, and recommendations to senior leadership.
• Mentor and guide data scientists through technical reviews, coaching, and thought leadership.
• Champion modern AI-assisted analytical workflows while maintaining solid scientific rigor and validation standards.

• Bachelor's Degree in Statistics, Data Science, Computer Science, Economics, Mathematics, Engineering, Operations Research, or a related field.
• 12+ years of experience in Data Science, Analytics, Applied Statistics, Economics, or related quantitative disciplines.
• Deep expertise in experimentation, A/B testing, statistical inference, causal analysis, forecasting, and metric design.
• Proven experience influencing high-impact product and business decisions through data and analytical insights.
• Experience designing measurement frameworks and success metrics for product, customer, and business outcomes.
• Solid programming skills in Python, SQL, R, or similar analytical languages.
• Excellent communication, collaboration, and stakeholder management skills.
• Experience supporting large-scale consumer products and services.
• Expertise in product analytics, customer measurement, engagement analysis, growth, retention, or monetization.
• Familiarity with Generative AI, Large Language Models (LLMs), and modern AI evaluation methodologies.
• Experience evaluating AI-powered experiences such as copilots, recommendation systems, search, or intelligent customer-facing products.
• Knowledge of Responsible AI principles and AI quality measurement frameworks.
• Experience with large-scale data platforms such as Spark, Cosmos, Hadoop, or cloud analytics environments.
• Join us in shaping the future of Windows through world-class decision science, experimentation, measurement, and AI evaluation.

#W+DJOBS

This position will be open for a minimum of 5 days, with applications accepted on an basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process.