API to inspect all user content
Ross Lambert
Our site is for high school students who are exploring post-high school education options. Therefore we must absolutely prevent spam, porn, or even suggestive content. We are currently on Wordpress and have developed a plug-in that inspects all user generated content and analyzes it with several Microsoft AI tools for adherence to our community standards. The "strictness" is configurable. If the message is deemed inappropriate, it is automatically held for moderation (for comments) or fails to send if it is a direct message. We can optionally notify our admins as well.
We would very much like to move our community site to Heartbeat, but we must have this sort of hook into user generated content. This even includes direct messages. As you might imagine, a site for high school students attracts predators, so we cannot allow someone posing as a student make inappropriate communications of any kind with one of our members. Our member's safety is paramount.
I'm hoping that a webhook where we can analyze and approve/disapprove of all user generated content is not too onerous a task. This would include image uploads, comments, channel chats, and direct messages. We'd certainly move our site to Heartbeat if you pull this off. We'd also love to be a case study for you.
Not only that, but we might be able to work out some sort of arrangement for our content moderation API. We would eventually like to make it available as a product, but for now it is just a tool we use to protect our own members.
Thanks for your consideration. If you have any questions or would like to explore further, please reach out to:
e-mail: ross@digiprov.com
phone: 1-509-679-0782
Log In