New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.
Already on GitHub? Sign in to your account
馃殌 Feature: Log prompts while preserving user PII with Presidio #751
Comments
Thanks @clemlesne that's a great idea! |
Presidio works very badly on languages other than english. just a heads up. we ended up using another PaaS MSFT service (Cogservices). But perhaps it would make sense to have a plugin interface process PII before loggin it. |
Or potentially this might be something that should be done on the ingestion side? I worry about creating a significant overhead on production devices. |
Which component is this feature for?
All instrumentations backend
馃敄 Feature description
Remove PII from prompts before sending it, with Presidio.
馃帳 Why is this feature needed?
Today, either we log prompts to monitoring backend or nothing. Monitor those details are important for prompt quality and A/B testing. But, this includes sending PII to the monitoring backend, which is in most companies not conceived to handle this type of data (GDPR if you hear me).
The text was updated successfully, but these errors were encountered: