What’s next for NSFW detection in Discourse AI

[AWS]

If you’ve seen our previous announcement, then you are aware that we are shifting to prefer LLM preferred solutions as they provide a vastly superior experience. Hence, coming soon we’ll be decommissioning the NSFW module in favor of Discourse AI Post Classifier - Automation rules

This will be a beta experience so expect changes to occur to the feature.

Why are we doing this?

For the same reasons…

What's next for Toxicity detection in Discourse AI?

Previously using the Toxicity module meant…

• You were stuck using a single pre-defined model
• No customization for your community-specific needs
• Confusing threshold metrics
• Subpar performance

LLMs have come a long way and can now provide a better performing and customizable experience.

Whats new?

What's next for Toxicity detection in Discourse AI?

Discourse AI Post Classifier - Automation rule can be used to triage posts for Toxicity (amongst other ways) and enforce communities to specific code of conducts. This means…

• Multiple LLMs supported for different performance requirements
• Easy to define what and how content should be treated
• Customizable prompts for community-specific needs
• Flag content for review

and much more.

To assist with the transition we have already written out 2 guides

• Setting up toxicity/code of conduct detection in your community
• Setting up spam detection in your community
• Setting up NSFW detection in your community

We will add another guide specifically for NSFW detection to help with the transition.

What happens to NSFW?

This announcement should be considered very early, until we are ready to decommission you can continue to use NSFW. When we do it, we will be decommissioning the module, and removing all code from the Discourse AI plugin and associated services from our servers. The deprecation will only happen after AI Triage is ready to handle images which will be done soon.

4 posts - 1 participant

Read full topic

View the full article