Impactful Legal Scholarship Evaluation

Status, May 2026: paused; reconsidering. We deprioritized this in late 2025 while handling other priorities and funding/operations constraints, and because we had not found a clear legal-scholarship champion. We would consider reviving it if we found a senior or promising mid-career legal scholar to help lead it, ideally alongside existing law-and-AI, animal welfare law, or legal-priorities initiatives.

The Unjournal has mainly focused on public evaluation of quantitative social science, economics, and policy research. We have also explored whether our model could extend to high-impact legal scholarship: legal research that might shape regulation, litigation, judicial reasoning, law-school curricula, advocacy, and policy design.

The practical model is to evaluate already-public legal research, publish citable expert assessments, invite author responses where useful, and produce ratings that scholars, law reviews, funders, workshops, and policy groups can interpret as an additional signal. A lighter-weight version would start with prioritization and curation.

Why legal scholarship might be a strong fit

Legal work can be directly influential

Scholarship can shape legislation, court reasoning, agency action, policy design, and what future lawyers are taught to treat as authoritative. This is especially true in the US, where jurisprudence carries unusual weight and scholarly argument often feeds the reasoning that courts, clerks, litigators, and agencies draw on when they confront novel questions. An empirical study of the federal courts of appeals finds that judicial use of legal scholarship is substantial and has been rising.

There may be a review gap

In the US, many high-prestige law reviews, such as Harvard Law Review, Yale Law Journal, and Stanford Law Review, are edited by law students rather than through the expert peer review standard in most other fields. These editors are typically JD candidates, not senior scholars or PhD researchers, and usually have little direct experience conducting serious legal research. Public expert evaluation could fill that gap, add an independent quality signal, and direct attention toward legal work with potential global impact or catastrophic-risk relevance.

Early feedback can matter

Legal scholarship leans heavily on working papers: drafts circulate on SSRN and through workshops, and are often read, cited, and acted on well before formal law-review placement, which can lag by a year or more. That long window is exactly where fast, structured expert feedback could improve a paper and give authors, workshops, student editors, funders, policy teams, and practitioners a signal to act on before publication and citation catch up.

Proposed evaluation model

Standard Unjournal model, legal version

Identify and curate public legal research with unusually high expected value for evaluation.
Commission legal scholars, practitioners, and relevant subject-matter experts to assess the work.
Pay evaluators for full evaluations, with a rough target around $500 where funding allows.
Evaluate legal claims, reasoning, practical usefulness, likely influence, impact pathway, and limitations.
Let authors respond where appropriate.
Publish citable evaluations and ratings, with evaluator anonymity optional.
Discuss implications with practitioner organizations, impact-driven funders, workshops, and policy groups where the research or evaluation could inform decisions.

Legal-specific adaptations

Recruit evaluators who can judge legal reasoning, doctrine, statutory interpretation, institutional feasibility, jurisdiction-specific context, and likely use by courts, agencies, advocates, or policymakers.
Adapt ratings so they distinguish scholarly quality from practical legal usefulness, citation value, policy relevance, and expected global impact.
Make the workflow compatible with the US law-review submission market, workshop circulation, SSRN drafts, and post-publication review of influential articles.
Separate US-focused pilots from European or international legal scholarship where journal norms, peer review, and the role of jurisprudence differ.
Clarify when a piece is legal scholarship rather than adjacent policy commentary, and when a practitioner review would be more valuable than an academic review.

Prioritization and evaluation criteria

The working framework separates prioritizing research for evaluation from evaluating the quality of the research itself. A paper can be high quality but low priority for Unjournal evaluation if further public review has little expected value. The reverse can also hold: a flawed but influential paper may deserve public scrutiny if an expert evaluation would help users interpret it.

Show criteria

Global or societal impact

Does the research address or inform important issues such as AI safety and governance, biosecurity, animal welfare, health, rule of law, catastrophic risk, or other global-priorities-relevant areas in ways that suggest meaningful near-term paths to global impact?

Applicability, prominence, and influence

Could the arguments affect courts, regulators, policymakers, advocacy organizations, funders, law reviews, workshops, or future legal scholarship? Is the paper already widely read, quoted, used, or influential enough that public expert evaluation could improve how decision-makers and funders interpret it?

Contribution to legal theory and practice

Does the work add something useful to legal reasoning, doctrine, institutional design, comparative law, or interdisciplinary practice? This matters, but we would likely weight it less than law journals do when it is disconnected from practical or near-term impact.

Evaluability

Does the work make specific claims that legal experts can meaningfully assess, rather than broad synthesis, conventional wisdom, or informal social commentary?

Curation-first path

A lower-commitment way to restart this is to adapt The Unjournal's prioritization workflow to legal scholarship. Instead of beginning with full public evaluations, we could first build a public candidate list and ask legal scholars, practitioners, policy researchers, and research users to suggest, label, and discuss entries. This would be integrated with AI tools for initial search, filtering, clustering, and summarization, while leaving final prioritization judgments to people with relevant legal and policy expertise. We have begun doing exactly this: our legal scholarship prioritization prototype, described just below, is an early AI-assisted version of this candidate list, alongside a parallel prototype covering economics and related research.

Prototype in action: the legal prioritization dashboard

To make this concrete, and to give a sense of the kind of research we have in mind, we have built an early, AI-assisted legal scholarship prioritization dashboard. A first automated pass scanned roughly 360 public legal papers (law-review articles, SSRN working drafts, and forthcoming pieces) and scored each one from 0 to 10 on five weighted dimensions that track the criteria above:

Global or societal impact (about 35%): AI safety, biosecurity, animal welfare, catastrophic risk, or rule of law.
Influence potential (about 25%): whether the work could affect courts, regulators, or policymakers.
Contribution and evaluability (about 20%): whether it advances legal reasoning with claims experts can meaningfully assess.
Prominence (about 10%): venue, authorship, and citation signals.
Timing (about 10%): draft stage and open policy windows.

Each paper is sorted into a bucket from "prioritize now" through "monitor," "deprioritize," and "out of scope," and tagged by theme: AI liability and tort law, law-following AI and AI agents, compute governance, biosecurity governance, animal welfare law, deepfakes and information integrity, rule of law, and global health law. A few of the candidates it currently surfaces near the top:

"Regulating Deepfakes at Home and Abroad," Jane C. Ginsburg and Graeme W. Austin (SSRN draft).
"A Pragmatic Approach to Regulating AI Agents," Philipp Hacker and Matthias Holweg (SSRN draft).
"Acting with AI: An Interaction-Based Framework for Agentic Tort Liability," Yiheng Yao (SSRN draft).
"Frontier AI Regulation: Managing Emerging Risks to Public Safety," Markus Anderljung and co-authors (SSRN draft).

This is an exploratory prototype. The scores are AI-generated and not yet calibrated against human prioritization decisions, so treat them as rough triage rather than considered judgments. We would value your feedback: try the dashboard, tell us where the rankings look wrong, and suggest papers or themes we are missing.

Contributor workflow and rationale

What contributors would do

Suggest public legal papers, drafts, reports, or research agendas with possible global-priorities relevance.
Add labels such as "highly impactful," "not practical," "needs legal expert review," "too broad," "strong AI-safety relevance," or "good post-publication review candidate."
Briefly explain the path to impact, tractability, and what kind of evaluation would add value.
Nominate legal scholars or practitioners who could evaluate or advise on the work.

Why start here

It creates a public-good filter: a pre-screened map of what legal research may be worth reading or evaluating.
It is cheaper and faster than commissioning full evaluations immediately.
It gives potential champions a concrete artifact to react to rather than an abstract proposal.
Small incentives could reward useful labeling, suggestions, and short prioritization notes.

Revival plan

Our working conclusion is practical: if we can secure legal-scholarship ownership, we should restart with a narrow first use case. That could be a candidate-prioritization project, a workshop-linked pilot, or full evaluations of one to three papers.

Step 1

Find a champion

Recruit a senior or promising mid-career legal scholar, or a small partner group, to advise on field norms, credibility, evaluator selection, and scope.

Step 2

Build the candidate list

Collect public legal research candidates and invite lightweight labels, short prioritization notes, and evaluator nominations.

Step 3

Refresh and choose a pilot

Update the candidate set from the earlier pass, since many papers and priorities may now be stale, then select one to three papers or working papers in a concrete area such as AI liability, law-following AI, biosecurity governance, or animal welfare law.

Step 4

Evaluate and assess

Commission serious, in-depth evaluations where warranted, allow author responses, share outputs with relevant communities such as law-and-AI groups, animal welfare advocates, funders, workshops, and policy users, and assess whether the outputs are highly credible to legal audiences, useful to practitioners, and likely to inform work with global impact.

Pilot options and planning content

Show pilot options

Option	Why it is promising	What we would need
High-impact legal research candidate list	A curation-first project could quickly become useful if legal scholars, practitioners, policy researchers, and research users label suggestions and discuss why each paper is or is not evaluation-worthy. AI tools could help with initial search, filtering, clustering, and summaries, as in our early automated prioritization prototype outside legal research.	A lightweight database, clear labels, modest incentives for useful suggestions, and a few people willing to seed and review the first entries.
AI safety, AI governance, and animal welfare legal papers	Fast-moving, high-stakes areas where legal arguments may influence regulation, liability, institutional design, welfare standards, and safety norms.	Law-and-AI scholars, animal welfare law experts, evaluator candidates, and a short list of public papers with concrete legal claims.
Workshop-linked evaluations	Workshops already screen papers, convene relevant scholars, and generate feedback. That makes them an intermediate signal: not a final quality judgment, but a credible place to find papers, evaluators, discussants, and potential advisors.	A workshop partner willing to nominate papers, let us add structured evaluation around selected drafts, and possibly connect us to board members or evaluators.
Post-publication review of influential articles	Some legal scholarship remains influential after journal placement. Public expert evaluation could still help readers judge use and limits.	Clear selection criteria and evaluators willing to review already-published work without turning it into general commentary.
Prize or call for high-impact legal scholarship	A prize could draw attention and submissions, especially around global catastrophic risk or AI governance.	Funding, visibility, credible judges, and a clear explanation of what counts as impactful legal scholarship.
Funder-linked evaluation requirements	Funders could ask grantees or applicants to get at least one relevant public evaluation, making engagement less dependent on author self-selection.	A funder or fellowship program willing to treat public evaluation as a useful research-quality and public-good signal.

Candidate themes

We thank Ziyi Wang for substantial earlier work on candidate themes.

AI liability and tort law for catastrophic risk.
Law-following AI and AI agents under the rule of law.
Compute governance, monitoring, and regulatory authority.
Biosecurity governance, international institutions, and liability.
Animal welfare and international legal frameworks.
Deepfakes, information integrity, and democratic resilience.

Open questions before launch

Could the possibility of public negative evaluations deter authors from engaging?
Can we start with public prioritization and labeling before asking authors to accept full public evaluations?
Should the first pilot focus on preprints, workshop papers, or post-publication review?
Should the first pilot focus mainly on the US context because of the greater review gap and role of court jurisprudence, even if US legal scholars may be harder or more expensive to recruit?
Can we recruit strong legal scholars and practitioners to complete serious, in-depth evaluations at the available compensation?
Which ratings are useful without becoming misleading in legal contexts?
What does an "AI-safety framing" require? The likely answer is not ideological agreement, but a willingness to evaluate whether a paper improves AI-risk governance, legal incentives, institutional control, or law-following AI.
How should the model differ between US law reviews and European peer-reviewed legal scholarship?
Which partners would make the signal credible enough to matter?

Source materials and context

This page is a public summary. It does not quote private Slack messages, private meeting transcripts, or sensitive outreach notes. Some working notes are access-controlled; review sharing settings before wider circulation.

Show links

Interested in helping revive this? The highest-value next step is a conversation with a legal scholar or organization that can help lead a narrow pilot and make the evaluation signal credible to legal audiences.

Contact The Unjournal