REPOSITORY ANALYSIS

jev-research-pipeline

A single-user research monitor where code fetches and versions evidence, Jev screens and scores it, and Qwen drafts cited notes for human review.

E2 · source reviewedPublic material or source evidence was reviewed. A fixed-version source review requires checking a pinned revision; this is not a reproduction, performance endorsement, or safety guarantee.
Stars
1
Forks
0
License
MIT
Last commit
2026-09-23

What Jev does here

For each (fetched source, open research question) pair, Jev answers Noul gates (on topic, method transferable, evidence compatible) and then Score dimensions through Pydantic AI's native `typesafe:` model; deterministic code applies the thresholds and routes each pair to keep / review / drop.

Links source-level judgments to versioned questions and human labels; threshold fitting writes proposals rather than silently changing policy.

Fixed-version documentation and implementation material were inspected on 2026-10-24. No vault writes, Qwen generations or live judgments were performed. The author reports unfinished runtime/threshold goals; this review does not certify them as achieved.

What task does this project fit?

Monitor standing research questions while keeping fetched evidence, judgments and generated notes separate.

Material analysed:

From input to action

  1. Code fetches sources and binds them to a versioned research question.
  2. Jev gates and scores source/question pairs, then selects relevant verbatim sentences.
  3. Qwen writes notes with citations; human checkboxes become feedback for proposed threshold changes.

Implementation details that matter

The schema is part of the experiment

core.py hashes instructions, transmitted schema and Score level names. Changing wording or level descriptions changes what was asked even if the high-level function name stays the same.

Inspect the supporting source ↗

Threshold fitting does not silently change production policy

The README describes fit as writing a proposal rather than applying it. Human labels are inputs to review, not a license to retroactively claim better production results.

Inspect the supporting source ↗

When to choose it

Useful for a single-user research vault with explicit standing questions. Prefer a simpler feed if you cannot review generated claims or maintain question versions.

How to inspect it yourself

Read Ask’s question-identity logic in core.py and the README’s fit/export-cases workflow. Check that a rubric change produces a distinct identity and that proposed thresholds require a separate decision.

Limits of this review

  • No vault writes, Qwen generations or live judgments were performed.
  • The author reports unfinished runtime/threshold goals; this review does not certify them as achieved.
Primary material used in this analysis