Skip to content
Andy Kemp Tools

Zero Trust Scorecard

Assess your Microsoft 365 and Entra ID environment against five Zero Trust pillars: identity, Conditional Access, privileged access, device security, and data protection. Identify the gaps that commonly undermine security posture — including whether your MFA strategy is phish-resistant.

Identity & MFA

How identities are secured — and whether MFA can withstand modern phishing attacks.

Phish-resistant = FIDO2 keys, Windows Hello for Business, passkeys, or certificate-based auth. Standard = push notifications, Authenticator OTP, SMS, or phone call.

Even with MFA enabled, standard methods can be bypassed by adversary-in-the-middle (AiTM) attacks and MFA fatigue.

Users who haven't registered MFA methods are not protected even when policies are enabled.

Conditional Access & authentication

Policies that govern how and when access is granted.

Legacy protocols (POP, IMAP, SMTP AUTH, older ActiveSync) bypass MFA entirely.

Entra ID Protection provides sign-in risk (suspicious login behaviour) and user risk (compromised credential detection) signals.

Privileged access & governance

How privileged roles are managed, scoped, and reviewed.

PIM provides just-in-time role activation instead of permanent standing assignments.

If Conditional Access or MFA locks out all admins, break-glass accounts are the recovery path.

E.g. Exchange Admin, SharePoint Admin, User Admin — rather than Global Admin for everything.

Device & endpoint

Device identity, management, and access restrictions.

E.g. web-only access, app protection policies, or blocking downloads on personal devices.

Data protection

Classification, labelling, and data loss prevention.

Microsoft Purview Information Protection sensitivity labels for classifying and protecting documents and emails.

Data Loss Prevention for Exchange, Teams, SharePoint, OneDrive, and endpoint.

About this tool

How Zero Trust Scorecard works

Answer around twenty questions across five pillars: identity and MFA, Conditional Access, privileged access, devices and endpoints, and data protection. The pillars are weighted by real-world impact (identity and MFA 30%, Conditional Access 25%, privileged access 20%, devices 15%, data protection 10%), and phishing-resistant MFA scores higher than push, codes or SMS.

You get an overall score, a score for each pillar and the gaps that matter most. It's a directional check rather than a full security review: it doesn't cover network segmentation, app consent, threat detection or incident response.

For a step-by-step plan to close the gaps, answer the same questions in the Zero Trust Remediation Planner.

Questions

Does it connect to my tenant?

Nothing. You answer questions from what you know about your tenant, or can check in the admin centres; the tool doesn't sign in to Microsoft 365 or read anything from it.

Where do my answers go?

Your answers stay in your browser and are worked out there. The site only counts, anonymously, that the tool was opened, finished or downloaded.

Do I need an account?

No account is needed to use it. Downloading the report needs a free andykemp.com account, which takes a minute to create.

Why does my score drop with push or SMS MFA?

Adversary-in-the-middle phishing and MFA fatigue attacks get past push notifications, codes and SMS. Passkeys, FIDO2 security keys and Windows Hello for Business resist them, so the scorecard rewards them.

Related tools

Use it with

Downloads need a free account

The tools are free to use. To download what they produce, sign in with your free andykemp.com account: the same one for the blog, the Tenant Audit and the deploy tools. No newsletter unless you choose one.

Prefer to sign up on the main site? andykemp.com/join