Tag: data-quality

Showing 1-3 of 3

Jun 23, 20267 min readModel Release BriefIntermediate

Outsourced annotators report using public chatbots to generate 'human' training dialogues

Whistleblowers say subcontracted annotators often prompt public chatbots (e.g. ChatGPT) to produce 'human' training dialogues—risking model feedback loops. Practical checklist included.

training-data data-quality crowdwork model-risk ai-safety

+2 more

data-governance newscientist

NewsFrance

Open

Apr 02, 20266 min readAgent PlaybookIntermediate

Vesper: an MCP-native engine that discovers, validates, cleans and exports agent-ready Parquet/Arrow/JSONL

Vesper is an MCP-native autonomous data engine that discovers web, API and file sources, validates and cleans schemas, fuses data, and exports agent-ready Parquet/Arrow/JSONL.

vesper MCP autonomous-data-engine datasets agents

+3 more

parquet arrow data-quality

TutorialsUnited States

Open

Mar 07, 20268 min readSecurity BoundaryIntermediate180 min build

Commit-gated validation pipeline to prevent AI-generated schema errors

A commit-gated pipeline (Prompt→LLM→Validation→Normalizer→Retry→Commit) keeps AI-generated structured files off disk until they pass schema checks, revealing schema gaps.

validation LLM schema pipeline CI

+3 more

devops data-quality automation