Side project · AI content pipeline
testhoop-qgen — Verified Question Generation Pipeline
LLM-assisted pipeline that drafts exam questions, mechanically verifies them with real oracles (javac, Oracle SQL, SymPy, Pint, chemistry rules), runs content lints and imports the survivors into TestHoop over REST.
Role: Architect and Developer
Project context
Content quality is the product behind the product: one bad question erodes a learner's trust in the whole platform. qgen is the build-time authoring pipeline that makes LLM-drafted questions safe to ship. The guiding principle is that verification is a gradient, not a boolean — code compiles and runs (confidence ≈ 1.0), maths is checked symbolically (~0.95), physics and chemistry numerics are checked with units (~0.85), and purely conceptual items go to a second-model judge (~0.7) and a human reviewer. The pipeline runs locally and fits a flat-rate Claude subscription by default, with metered API use as an opt-in.