The Offensive Content Filter is a document analysis tool to filter content regarded
The offensive content filter is implemented as a separate document processor that can be added to an ESP
pipeline and In Autonomy IDOL can be implemented using eduction module.
How it works:
Document content is generally run through filters and compared to pre-defined dictionary. the terms can be added, replaced, removed or even entire document can be rejected.
The output of the filter is an overall score that provides an indication of the likeliness that a document is offensive.