This highlights a need in the market for tools to help moderate a community. Imagine a tool that automatically detects hate speech and either auto-deletes or brings it to a moderator’s attention. Certain communities are being highjacked by extremist, racist, and simply malicious actors. The current method of reading chat and banning users doesn’t scale when sudden growth occurs.
If effective moderation can occur at smaller levels, like discord channels or subreddits, then those communities won’t been to be removed by the larger platform. This would also be helpful for startup social media platforms that have yet to bring enough revenue to afford a facebook sized moderation team.
Technically speaking it can do things like:
* Flag posts that contain a blacklist of words, including non-obvious spellings of said word (using non-standard Unicode characters in place of letters)
* Cross reference IP addresses or user names with banned users in other communities
* Notify moderators of trending slogans, phrases, or hashtags that have non-obvious extremist roots.
* Identify images containing extremist/hateful content
* Flag content that contains any political discussion for communities that want to be completely apolitical.
* Flag pornography
EDIT: To be clear, the target audience for this would be community moderators/admins or startup social networks that haven’t built their own moderation infrastructure.
If effective moderation can occur at smaller levels, like discord channels or subreddits, then those communities won’t been to be removed by the larger platform. This would also be helpful for startup social media platforms that have yet to bring enough revenue to afford a facebook sized moderation team.
Technically speaking it can do things like:
* Flag posts that contain a blacklist of words, including non-obvious spellings of said word (using non-standard Unicode characters in place of letters)
* Cross reference IP addresses or user names with banned users in other communities
* Notify moderators of trending slogans, phrases, or hashtags that have non-obvious extremist roots.
* Identify images containing extremist/hateful content
* Flag content that contains any political discussion for communities that want to be completely apolitical.
* Flag pornography
EDIT: To be clear, the target audience for this would be community moderators/admins or startup social networks that haven’t built their own moderation infrastructure.