NYC Local Law 144 — Public Disclosure
View Results
Ninjahire
NYC LL 144 Bias Audit
NYC LL 144

Automated Employment Decision Tool — Annual Bias Audit Report

1
Report Summary
Systems
2
Frequency
Monthly
Latest Audit
Total Samples
Protected Classes
Sex, Race
Regulation
NYC LL 144

This report covers NYC Local Law 144 requirements for Automated Employment Decision Tools (AEDTs). A Disparate Impact Analysis was conducted to assess potential adverse impact on protected groups by sex and race/ethnicity, and their intersections, in compliance with NYC DCWP final rules.

2
System and Audit Details
3
Bias Audit Results
Disparate impact calculated for Sex, Race/Ethnicity, and Intersectional categories. Impact Ratio threshold per EEOC 4/5ths rule: ≥ 0.80. Groups <2% excluded per DCWP guidance.
4
Methodology

Ongoing Audits

Audits are performed monthly, with on-demand re-audits triggered by significant product updates, ensuring bias results always reflect the current production system.

NYC Local Law 144

Our bias auditing approach meets the specific requirements for AEDTs as published in the final rules of the NYC Department of Consumer and Worker Protection.

Data Source

A proprietary dataset of synthetic candidate profiles ensures balanced demographic representation. Groups <2% of the dataset are excluded per DCWP rules.

Disparate Impact Analysis

Evaluates whether protected groups are adversely affected. Uses the selection rate method: candidates scoring ≥ overall median are counted as "selected".

Formulas
Selection Rate = (# in group ≥ median) ÷ (# total in group)
Impact Ratio = (Group selection rate) ÷ (Highest group rate)
Impact Ratio ≥ 0.80 → Pass (EEOC 4/5ths rule) · Impact Ratio < 0.80 → Flag for review
5
About the Auditor
Independent Third-Party Auditor

The auditor is an independent AI audit and assurance provider. Fees associated with the auditing service are solely for evaluation — their payment is not related to the outcome of the results.

Auditing services are strictly limited to testing and monitoring the trustworthiness of AI systems. The auditor does not form part of the solution, does not develop or distribute the AEDT, and has no direct financial interest in the employer or the platform vendor.

The nature of auditing methods are the same for all systems of the same use-case. The service is not customized to produce favorable outcomes for any particular system.

Audit Information

Latest Audit
Next Audit
Frequency
Monthly
Contact
6
Disclaimer

This AI Assurance Report provides an independent audit of the AI systems described above, based on proprietary methodologies and synthetic datasets. The results reflect best judgments derived from information available at the time of evaluation.

Findings do not guarantee the absence of bias within the audited AI systems. Instead, they indicate that no significant adverse impact was identified for the groups and metrics specified within the scope of analysis.

This report is intended for public disclosure under NYC Local Law 144 §20-871(b). It does not constitute legal advice. Recipients should consult qualified legal counsel before relying on this report for compliance filings.