10 Alarming Issues with Character.AI's Safety and Moderation

[{"selector":"#anim-bd043a3d-4719-40d5-845f-97ebc27ba998 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(17.357142905892115%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-e69dd3ca-4fe3-439f-9c94-a2c38ee44cdd","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-02953a0a-76b9-4dbb-bf31-ccbb63c70e70","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Disturbing Chatbot Profiles – Bots promoting inappropriate content

[{"selector":"#anim-90378f3d-d487-4125-a829-80d2e2ff00cd [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-a1a36b4c-988b-4146-87ce-22d0875b4575","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-939bb202-751c-4f2f-8183-bf529d684396","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Grooming of Minors – Bots engaging in manipulative behavior with minors

[{"selector":"#anim-e891e951-dfff-46de-b1e5-2e95561f388b [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-3.552713678800501e-15%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-b65ca9f6-eeee-4556-9320-a44f04fd1ecf","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-38f2caf1-6021-43df-a183-3b7aa8f514ef","keyframes":{"transform":["translate3d(0px, 256.52786%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Illegal Roleplay – Bots encouraging explicit and abusive scenarios

[{"selector":"#anim-384c2e41-3428-48e6-9538-66b8e239b5c7 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-3.552713678800501e-15%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-1dfc2cf9-bf54-469f-acb3-90cf37b91018","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2104b886-81e1-4a10-88c3-ef6397ecb932","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Weak Moderation – Inadequate flagging and removal of harmful content

[{"selector":"#anim-137a83dc-3560-4773-bce3-be244c453f82 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-3.552713678800501e-15%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-707fdb0b-52d3-4bfb-bbb3-bf3b1fed9309","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2db4c714-d549-4c1f-9297-2f48e377c2c6","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Normalization of Abuse – Bots desensitizing minors to abusive behavior

[{"selector":"#anim-8b94e97a-17e8-4819-9150-1ef8cb055c2b [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(25%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-8b305195-a145-445e-99c1-f68fa83e360e","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-eae87e4d-6afc-4c6f-8609-4c1ec966a6c6","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Ignored Terms of Service – Policies on harmful content often not enforced

[{"selector":"#anim-a8cbea69-b5fa-44b2-a01c-883c86c0db37 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(25%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-1ce96f9e-1442-4e1d-a861-0af383f3c654","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2c7299a8-f28b-450c-bab9-20251361aca9","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Ineffective Content Warnings – Warnings are insufficient to block harmful exchanges

[{"selector":"#anim-9c23541c-dcdd-4801-88ce-8160cf72ef2e [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-8d1decba-ef99-41c6-b57b-c712bea7d10b","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-93008d81-47d7-465e-8e9e-7ed86db5b246","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Predatory Behavior Normalization – Bots teaching grooming tactics

[{"selector":"#anim-cfcdb803-8f2a-424b-a050-f79122e4c7d1 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-3a66e589-6be8-4714-8906-82f4229402af","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-55c50a0c-e5a2-4bad-91c7-3f37410f7edf","keyframes":{"transform":["translate3d(0px, 197.32905%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Public Backlash – Lawsuits and criticism regarding harmful interactions

[{"selector":"#anim-8cce2180-c28c-4ea6-8460-c8790c90f1fd [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-9fd8cdca-528c-4425-a0c4-5d71bbbb6734","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a20f7d07-05e6-4e8a-9426-3524220b8d58","keyframes":{"transform":["translate3d(0px, 207.90600%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Slow Response to Concerns – Predatory bots remain despite user reports Learn more