memaudit
Local auditor that tests a fine-tuned LLM for training-data memorization and leakage risk.
Pluginfreeglobal
memaudit is a free, local plugin for Hugging Face Trainer and TRL fine-tuning jobs that tests a model for training-data memorization and regurgitation risk by injecting canary examples and producing a versioned, statistically-grounded report, with everything running on the user's own machine and no data uploaded anywhere. It is aimed at ML engineers and compliance reviewers who need documented evidence of memorization testing for a fine-tune in a regulated setting.
Categories
machine learning toolsprivacy/compliance auditing
Something wrong with this listing — dead link, not a real product, wrong info?

