AB 1137: Reporting mechanism: child sexual abuse material.
- Session Year: 2025-2026
- House: Assembly
- Latest Version Date: 2025-04-21
Current Status:
Failed
(2026-02-02: From committee: Filed with the Chief Clerk pursuant to Joint Rule 56.)
Introduced
In Committee
Awaiting First Chamber Vote
Passed First Chamber
In Committee
Awaiting Second Chamber Vote
Passed Second Chamber
Enacted
Existing law requires a social media platform to take certain actions with respect to child sexual abuse material on the social media platform, including by requiring the social media platform to provide, in a mechanism that is reasonably accessible to users, a means for a user who is a California resident to report material to the social media platform that the user reasonably believes meets certain criteria, including that the reported material is child sexual abuse material and that the reporting user is depicted in the material. Existing law also requires the social media platform to collect information reasonably sufficient to enable the social media platform to contact, as specified, a reporting user.
This bill would delete the requirement for reporting material that the reporting user be depicted in the material, would require that the depicted individual be depicted as a minor, and would additionally require the mechanism to be clear and conspicuous, and conspicuous. The bill would require a social media platform to ensure that any report submitted using the reporting mechanism receives a review is reviewed through a hash matching process or, if there is not an established or known hash match to child sexual abuse material, and would require a social media company to ensure review by a natural person. person if there is not an established or known hash match to child sexual abuse material with respect to the reported material and the reported material is not otherwise blocked.
Existing law makes a noncomplying social media company liable to a reporting user for actual damages and statutory damages, as specified.
This bill would also impose a civil penalty on a noncomplying social media company to be collected in a civil action by certain public attorneys, including the Attorney General. The bill would make a social media company liable to a depicted individual, as defined, for specified violations.
Existing law prohibits a social media platform from knowingly facilitating, aiding, or abetting commercial sexual exploitation, as defined, and exempts a social media platform from being deemed in violation of that prohibition if it instituted a specified audit program and provided to each member of its board of directors a true and correct copy of each audit, as prescribed.
This bill would revise those provisions to, instead, require a social media platform to submit to third-party audits and release audit reports to the public in order to be exempt from being deemed in violation that prohibition, as prescribed.
This bill would declare that its provisions are severable.
Existing law requires a social media platform to take certain actions with respect to child sexual abuse material on the social media platform, including by requiring the social media platform to provide, in a mechanism that is reasonably accessible to users, a means for a user who is a California resident to report material to the social media platform that the user reasonably believes meets certain criteria, including that the reported material is child sexual abuse material and that the reporting user is depicted in the material. Existing law also requires the social media platform to collect information reasonably sufficient to enable the social media platform to contact, as specified, a reporting user.
This bill would delete the requirement for reporting material that the reporting user be depicted in the material, would require that the depicted individual be depicted as a minor, would additionally require the mechanism to be clear and conspicuous, conspicuous, and would require a social media platform to ensure that any report submitted using the reporting mechanism receives a review through a hash matching process or, if there is not an established or known hash match to child sexual abuse material, by a natural person.
Existing law makes a noncomplying social media company liable to a reporting user for actual damages and statutory damages, as specified.
This bill would also impose a civil penalty on a noncomplying social media company to be collected in a civil action by certain public attorneys, including the Attorney General. The bill would make a social media company liable to a depicted user, individual, as defined, for specified violations.
Existing law prohibits a social media platform from knowingly facilitating, aiding, or abetting commercial sexual exploitation, as defined, and exempts a social media platform from being deemed in violation of that prohibition if it instituted a specified audit program and provided to each member of its board of directors a true and correct copy of each audit, as prescribed.
This bill would revise those provisions to, instead, require a social media platform to submit to third-party audits and release audit reports to the public in order to be exempt from being deemed in violation that prohibition, as prescribed.
This bill would declare that its provisions are severable.
Existing law requires a social media platform to take certain actions with respect to child sexual abuse material on the social media platform, including by requiring the social media platform to provide, in a mechanism that is reasonably accessible to users, a means for a user who is a California resident to report material to the social media platform that the user reasonably believes meets certain criteria, including that the reported material is child sexual abuse material and that the reporting user is depicted in the material. Existing law also requires the social media platform to collect information reasonably sufficient to enable the social media platform to contact, as specified, a reporting user.
This bill would additionally require the mechanism to be clear and conspicuous, and would require a social media platform to ensure that any report submitted using the reporting mechanism receives a review by a natural person.
Existing law makes a noncomplying social media company liable to a reporting user for actual damages and statutory damages, as specified.
This bill would also impose a civil penalty on a noncomplying social media company to be collected in a civil action by certain public attorneys, including the Attorney General. The bill would make a social media company liable to a depicted user, as defined, for specified violations.
Existing law prohibits a social media platform from knowingly facilitating, aiding, or abetting commercial sexual exploitation, as defined, and exempts a social media platform from being deemed in violation of that prohibition if it instituted a specified audit program and provided to each member of its board of directors a true and correct copy of each audit, as prescribed.
This bill would revise those provisions to, instead, require a social media platform to submit to third-party audits and release audit reports to the public in order to be exempt from being deemed in violation that prohibition, as prescribed.
This bill would declare that its provisions are severable.
Existing law requires a developer of a generative artificial intelligence system or service to post certain documentation on its internet website regarding the data it uses before making that system or service publicly available to Californians for use, as prescribed, and defines various terms for these purposes.This bill would make a nonsubstantive change to those definition provisions.Existing law requires a developer of a generative artificial intelligence system or service to post certain documentation on its internet website regarding the data it uses before making that system or service publicly available to Californians for use, as prescribed, and defines various terms for these purposes.
This bill would make a nonsubstantive change to those definition provisions.
As used in this title:
(a)Child pornography has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.
(b)Child sexual abuse material means either of the following:
(1)Child pornography.
(2)Obscene matter that depicts a minor personally engaging in, or personally simulating, sexual conduct.
(c)Clear and conspicuous has the same meaning as defined in Section 17601 of the Business and Professions Code.
(d)Depicted individual means a person who is depicted, including through the use of digitization or artificial intelligence, as a minor in child sexual abuse material on a social media platform.
(e)Minor has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.
(f)Obscene matter has the same meaning as defined in Section 311 of the Penal Code.
(g)Reporting user means a natural person who reports material to a social media platform using the means provided by the social media platform pursuant to Section 3273.66.
(h)(1)Social media company has, except as provided in paragraph (2), the same meaning as defined in Section 22675 of the Business and Professions Code.
(2)Social media company does not include a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
(i)(1)Social media platform has, except as provided in paragraph (2), the same meaning as defined in Section 22675 of the Business and Professions Code.
(2)Social media platform does not include either of the following:
(A)A stand-alone direct messaging service that provides end-to-end encrypted communication or the portion of a multiservice platform that uses end-to-end encrypted communication.
(B)An internet-based service or application owned or operated by a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
SEC. 2.Section 3273.66 of the Civil Code is amended to read:3273.66.A social media platform shall do all of the following:
(a)Provide, in a clear and conspicuous mechanism that is reasonably accessible to users, a means for a user who is a California resident to report material to the social media platform that the user reasonably believes meets both of the following criteria:
(1)The reported material is child sexual abuse material.
(2)The reported material is displayed, stored, or hosted on the social media platform.
(b)(1)Collect information reasonably sufficient to enable the social media platform to contact, pursuant to subdivision (c), a reporting user.
(2)(A)Ensure that any report submitted using the mechanism required by subdivision (a) receives a review is reviewed through a hash matching process or, if there is not an established or known hash match to child sexual abuse material, by a natural person. process.
(B)A social media platform shall ensure a report submitted using the mechanism required by subdivision (a) is reviewed by a natural person if both of the following are true:
(i)There is not an established or known hash match to child sexual abuse material with respect to the reported material.
(ii)The reported material is not otherwise blocked.
(c)Contact a reporting user in writing by a method, including, but not limited to, a telephone number for purposes of sending text messages, or an email address, that meets both of the following criteria:
(1)The method is chosen by the reporting user.
(2)The method is not a method that is within the control of the social media company that owns or operates the social media platform.
(d)(1)Permanently block the instance of reported material from being viewable on the social media platform if the reported material meets all of the following criteria:
(A)There is a reasonable basis to believe that the reported material is child sexual abuse material.
(B)The reported material is displayed, stored, or hosted on the social media platform.
(C)(i)The report contains basic identifying information, such as an account identifier, sufficient to permit the social media platform to locate the reported material.
(ii)A social media platform shall not require a report to contain a specific piece of information for purposes of this subparagraph.
(2)A social media platform shall make reasonable efforts to remove and block other instances of the same reported material blocked pursuant to this subdivision from being viewable on the social media platform.
(e)Provide written confirmation to a reporting user that the social media platform received that persons report that meets all of the following criteria:
(1)The written confirmation is provided to the reporting user within 36 hours of when the material was first reported.
(2)The written confirmation is provided using the information collected from the reporting user under subdivision (b).
(3)The written confirmation informs the reporting user of the schedule of regular written updates that the social media platform is required to make under subdivision (f).
(f)(1)Provide a written update to the reporting user as to the status of the social media platforms handling of the reported material using the information collected from the reporting user under subdivision (b).
(2)The written update required by this subdivision shall be provided seven days after the date on which the written confirmation required under subdivision (e) was provided and every seven days thereafter until the final written determination required by subdivision (g) is provided.
(g)Issue a final written determination to the reporting user, using the information collected from the reporting user under subdivision (b), stating one of the following:
(1)The reported material has been determined to be child sexual abuse material that was displayed, stored, or hosted on the social media platform and has been blocked on the social media platform.
(2)The reported material has been determined not to be child sexual abuse material.
(3)The reported material has been determined not to be displayed, stored, or hosted on the social media platform.
(h)(1)Except as provided in paragraph (2), comply with subdivisions (c) to (g), inclusive, no later than 30 days after the date on which material was first reported pursuant to this section.
(2)(A)If the social media platform cannot comply with subdivisions (c) to (g), inclusive, due to circumstances beyond the reasonable control of the social media platform, the social media platform shall comply with subdivisions (c) to (g), inclusive, no later than 60 days after the date on which material was first reported pursuant to this section.
(B)If this paragraph applies, the social media platform shall promptly provide written notice of the delay, no later than 48 hours from the time the social media platform knew the delay was likely to occur, to the reporting user using the information collected from the reporting user under subdivision (b).
SEC. 3.Section 3273.67 of the Civil Code is amended to read:3273.67.(a)(1)A social media company that fails to comply with Section 3273.66 shall be liable in a civil action brought by the Attorney General, a district attorney, a city attorney, or a county counsel for a civil penalty not to exceed two hundred fifty thousand dollars ($250,000) for each day that the reporting mechanism is unavailable or nonfunctional and for reasonable attorneys fees and costs.
(2)For purposes of this subdivision, a reporting mechanism shall be deemed unavailable or nonfunctional if any of the following are true:
(A)The reporting mechanism is inaccessible to users due to technical failures, design defects, or removal from the social media platform.
(B)The reporting mechanism does not permit reporting in a manner consistent with the requirements of Section 3273.66.
(C)The reporting mechanism results in the failure to confirm receipt of a report within the timeframes described in Section 3273.66.
(3)The penalties described in this subdivision shall continue to accrue daily until the social media company restores full functionality of the reporting mechanism in compliance with Section 3273.66.
(4)In addition to monetary penalties, the Attorney General may seek injunctive relief to compel a social media company to immediately restore and maintain a fully functional reporting mechanism in compliance with Section 3273.66. The court may issue temporary, preliminary, or permanent injunctive relief as necessary to prevent ongoing violations.
(b)Subject to subdivision (c), a social media company that fails to comply with this title other than subdivision (a) of Section 3273.66 shall be liable to a depicted individual who is the reporting user for all of the following:
(1)Any actual damages sustained by the depicted individual as a result of the violation.
(2)(A)(i)Subject to clauses (ii) and (iii), statutory damages of no more than two hundred fifty thousand dollars ($250,000) per violation.
(ii)If a social media platform has permanently blocked the instance of the reported material pursuant to subdivision (d) of Section 3273.66 before a complaint is filed for a violation of this title, the maximum statutory damages awarded pursuant to clause (i) shall be one hundred twenty-five thousand dollars ($125,000) per violation.
(iii)If a social media platform meets all of the following requirements, the maximum statutory damages awarded pursuant to clause (i) for a violation of subdivisions (d) to (g), inclusive, of Section 3273.66 shall be seventy-five thousand dollars ($75,000) per violation:
(I)The social media platform registers with, and participates in, the National Center for Missing and Exploited Childrens Take It Down service or its successor.
(II)The social media platform receives updated hash values for identified child sexual abuse material from the National Center for Missing and Exploited Childrens Take It Down service, or its successor, at least once every 36 hours.
(III)Within 36 hours of receiving updated hash values for identified child sexual abuse material from the National Center for Missing and Exploited Childrens Take It Down service, or its successor, pursuant to subclause (II), the social media platform removes child sexual abuse material identified by hash values from the social media platform.
(IV)The social media platform reports identified child sexual abuse material to the National Center for Missing and Exploited Childrens CyberTipline, as required by Section 2258A of Title 18 of the United States Code.
(V)The social media platform provides to a reporting user both of the following when a user reports child sexual abuse material to the platform directly:
(ia)Written confirmation to the reporting user that the social media platform received that persons report within 36 hours after the child sexual abuse material was reported.
(ib)A final written determination to the reporting user within 30 days after the date on which the material was first reported.
(B)In determining the amount of statutory damages pursuant to this paragraph, a court shall consider the willfulness and severity of the violation and whether the social media platform has previously violated this title.
(3)Costs of the action, together with reasonable attorneys fees, as determined by the court.
(4)Any other relief that the court deems proper.
(c)For a violation of subdivision (d) of Section 3273.66, a depicted individual may bring a civil action to obtain relief pursuant to subdivision (b) if the depicted individual is not a reporting user.
(d)The failure of a social media company to comply with subdivisions (c) to (g), inclusive, of Section 3273.66 within 60 days after the date on which material was first reported pursuant to Section 3273.66 shall establish a rebuttable presumption that the social media company is liable for statutory damages under this section.
(e)This title shall not be construed to limit or impair in any way a cause of action under paragraph (1) of Section 1710.
SEC. 4.Section 3345.1 of the Civil Code is amended to read:3345.1.(a)This section shall apply only in a civil action brought by, or on behalf of, or for the benefit of, a person who is a minor or nonminor dependent and is a victim of commercial sexual exploitation committed by a person who is over 18 years of age or facilitated, aided, or abetted by a social media platform in violation of subdivision (g). For purposes of this section, the age of the victim, the status of the victim as a minor or nonminor dependent, and the age of the defendant is determined at the time of the defendants act of commercial sexual exploitation of the victim.
(b)In a civil action brought by, on behalf of, or for the benefit of a minor, or nonminor dependent, against a person who engaged in any act of commercial sexual exploitation of a minor or nonminor dependent, whenever a trier of fact is authorized by a statute, other than subdivision (c), to impose either a fine, or a civil penalty or other penalty, or any other remedy the purpose or effect of which is to punish or deter, and the amount of the fine, penalty, or other remedy is subject to the trier of facts discretion, the trier of fact shall consider all of the following factors, in addition to other appropriate factors, in determining the amount of fine, civil penalty, or other penalty, or other remedy to impose. If the trier of fact makes an affirmative finding in regard to one or more of the following factors, it may impose a fine, civil penalty, or other penalty, or other remedy in an amount up to three times greater than authorized by the statute, or, if the statute does not authorize a specific amount, up to three times greater than the amount the trier of fact would impose in the absence of that affirmative finding:
(1)Whether the defendants conduct was directed to more than one minor or nonminor dependent.
(2)Whether one or more minors or nonminor dependents suffered substantial physical, emotional, or economic damage resulting from the defendants conduct.
(3)Whether the defendant knew or reasonably should have known that the victim was a minor or nonminor dependent. It shall not be a defense to imposition of fines, penalties, or other remedies pursuant to this paragraph that the defendant was unaware of the victims age or status as a nonminor dependent at the time of the act.
(c)If the trier of fact is not authorized by statute to impose a civil penalty in an action described in subdivision (b), the court may award a civil penalty not exceeding fifty thousand dollars ($50,000), and not less than ten thousand dollars ($10,000), for each act of commercial sexual exploitation committed by the defendant upon making an affirmative finding in regard to one or more of the factors set forth in paragraphs (1) to (3), inclusive, of subdivision (b). This penalty may be imposed in addition to any other remedy available in law or in equity.
(d)Any penalty imposed pursuant to this section shall be paid to the victim of the act of sexual exploitation.
(e)It shall not be a defense to the imposition of fines or penalties pursuant to this section that the victim consented to the act of commercial sexual exploitation.
(f)If the victim is under 18 years of age, the court, in its discretion, may order that any penalty imposed pursuant to this section be held in trust for the victim and used exclusively for the benefit and well-being of the victim. When the victim reaches 18 years of age or is emancipated, the trust shall expire and any unspent remainder shall be the sole property of the victim.
(g)(1)A social media platform shall not knowingly facilitate, aid, or abet commercial sexual exploitation.
(2)For a violation of this subdivision, a court shall award statutory damages not exceeding four million dollars ($4,000,000) and not less than one million dollars ($1,000,000) for each act of commercial sexual exploitation facilitated, aided, or abetted by the social media platform.
(3)A social media platform shall not be deemed to be in violation of this subdivision if it demonstrates all of the following:
(A)The social media platform has submitted for audit twice a year its designs, algorithms, practices, affordances, and features to an independent third-party auditor with proven experience in trust and safety and content moderation to detect designs, algorithms, practices, affordances, or features that have the potential to cause, or contribute to, violations of this subdivision.
(B)The social media platform took action, within 30 days of the completion of an audit described in subparagraph (A), designed to mitigate or eliminate the reasonably foreseeable risk that a design, algorithm, practice, affordance, or feature violates, or contributes to a violation of, this subdivision.
(C)The social media platform provided to each member of the social media platforms board of directors a true and correct copy of each audit within 90 days of the audit being completed accompanied by a description of any action taken pursuant to subparagraph (B).
(D)Subject to the redaction of trade secrets, as defined in Section 3426.1, the social media company made public, within 90 days of its completion, the third-party audit described in subparagraph (A).
(4)Without in any way limiting the application of the term knowingly under paragraph (1), for purposes of this subdivision, a social media platform shall be deemed to have knowledge under paragraph (1) if all of the following are true:
(A)Material was reported to a social media platform using the mechanism required under subdivision (a) of Section 3273.66 for four consecutive months.
(B)The criteria set forth in paragraphs (1) to (3), inclusive, subdivision (a) of Section 3273.66 are established with respect to that reported material.
(C)The reported material was first displayed, stored, or hosted on the platform after January 1, 2025.
(5)As used in this subdivision, facilitate, aid, or abet means to deploy a system, design, feature, or affordance that is a substantial factor in causing minor users minors to be victims of commercial sexual exploitation.
(h)As used in this section:
(1)Commercial sexual exploitation means an act committed for the purpose of obtaining property, money, or anything else of value in exchange for, or as a result of, a sexual act of a minor or nonminor dependent, including, but not limited to, an act that would constitute a violation of any of the following:
(A)Sex trafficking of a minor in violation of subdivision (c) of Section 236.1 of the Penal Code.
(B)Pimping of a minor in violation of Section 266h of the Penal Code.
(C)Pandering of a minor in violation of subdivision (b) of Section 266i of the Penal Code.
(D)Procurement of a child under 16 years of age for lewd and lascivious acts in violation of Section 266j of the Penal Code.
(E)Solicitation of a child for a purpose that is either in violation of subparagraph (A) or pursuant to paragraph (3) of subdivision (b) of Section 647 of the Penal Code.
(F)An act of sexual exploitation described in subdivision (c) or (d) of Section 11165.1 of the Penal Code.
(2)Nonminor dependent has the same meaning as in subdivision (v) of Section 11400 of the Welfare and Institutions Code.
(3)(A)Social media platform has, except as provided in subparagraph (B), the same meaning as defined in Section 22675 of the Business and Professions Code.
(B)Social media platform does not include either of the following:
(i)A stand-alone direct messaging service that provides end-to-end encrypted communication or the portion of a multiservice platform that uses end-to-end encrypted communication.
(ii)An internet-based service or application owned or operated by a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
(i)A waiver of the provisions of this section is contrary to public policy and is void and unenforceable.
SEC. 5.The provisions of this act are severable. If any provision of this act or its application is held invalid, that invalidity shall not affect other provisions or applications that can be given effect without the invalid provision or application.
REVISIONS: HeadingLine 2.As used in this title:
(a)Child pornography has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.
(b)Child sexual abuse material means either of the following:
(1)Child pornography.
(2)Obscene matter that depicts a minor personally engaging in, or personally simulating, sexual conduct.
(c)Clear and conspicuous has the same meaning as defined in Section 17601 of the Business and Professions Code.
(d)Depicted user individual means a user of a social media platform person who is depicted, including through the use of digitization or artificial intelligence, as a minor in child sexual abuse material on a social media platform.
(e)Minor has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.
(f)Obscene matter has the same meaning as defined in Section 311 of the Penal Code.
(g)Reporting user means a natural person who reports material to a social media platform using the means provided by the social media platform pursuant to Section 3273.66.
(h)(1)Social media company has, except as provided in paragraph (2), the same meaning as defined in Section 22675 of the Business and Professions Code.
(2)Social media company does not include a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
(i)(1)Social media platform has, except as provided in paragraph (2), the same meaning as defined in Section 22675 of the Business and Professions Code.
(2)Social media platform does not include either of the following:
(A)A stand-alone direct messaging service that provides end-to-end encrypted communication or the portion of a multiservice platform that uses end-to-end encrypted communication.
(B)An internet-based service or application owned or operated by a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
SEC. 2.Section 3273.66 of the Civil Code is amended to read:3273.66.A social media platform shall do all of the following:
(a)Provide, in a clear and conspicuous mechanism that is reasonably accessible to users, a means for a user who is a California resident to report material to the social media platform that the user reasonably believes meets both of the following criteria:
(1)The reported material is child sexual abuse material.
(2)The reported material is displayed, stored, or hosted on the social media platform.
(b)(1)Collect information reasonably sufficient to enable the social media platform to contact, pursuant to subdivision (c), a reporting user.
(2)Ensure that any report submitted using the mechanism required by subdivision (a) receives a review through a hash matching process or, if there is not an established or known hash match to child sexual abuse material, by a natural person.
(c)Contact a reporting user in writing by a method, including, but not limited to, a telephone number for purposes of sending text messages, or an email address, that meets both of the following criteria:
(1)The method is chosen by the reporting user.
(2)The method is not a method that is within the control of the social media company that owns or operates the social media platform.
(d)(1)Permanently block the instance of reported material from being viewable on the social media platform if the reported material meets all of the following criteria:
(A)There is a reasonable basis to believe that the reported material is child sexual abuse material.
(B)The reported material is displayed, stored, or hosted on the social media platform.
(C)(i)The report contains basic identifying information, such as an account identifier, sufficient to permit the social media platform to locate the reported material.
(ii)A social media platform shall not require a report to contain a specific piece of information for purposes of this subparagraph.
(2)A social media platform shall make reasonable efforts to remove and block other instances of the same reported material blocked pursuant to this subdivision from being viewable on the social media platform.
(e)Provide written confirmation to a reporting user that the social media platform received that persons report that meets all of the following criteria:
(1)The written confirmation is provided to the reporting user within 36 hours of when the material was first reported.
(2)The written confirmation is provided using the information collected from the reporting user under subdivision (b).
(3)The written confirmation informs the reporting user of the schedule of regular written updates that the social media platform is required to make under subdivision (f).
(f)(1)Provide a written update to the reporting user as to the status of the social media platforms handling of the reported material using the information collected from the reporting user under subdivision (b).
(2)The written update required by this subdivision shall be provided seven days after the date on which the written confirmation required under subdivision (e) was provided and every seven days thereafter until the final written determination required by subdivision (g) is provided.
(g)Issue a final written determination to the reporting user, using the information collected from the reporting user under subdivision (b), stating one of the following:
(1)The reported material has been determined to be child sexual abuse material that was displayed, stored, or hosted on the social media platform and has been blocked on the social media platform.
(2)The reported material has been determined not to be child sexual abuse material.
(3)The reported material has been determined not to be displayed, stored, or hosted on the social media platform.
(h)(1)Except as provided in paragraph (2), comply with subdivisions (c) to (g), inclusive, no later than 30 days after the date on which material was first reported pursuant to this section.
(2)(A)If the social media platform cannot comply with subdivisions (c) to (g), inclusive, due to circumstances beyond the reasonable control of the social media platform, the social media platform shall comply with subdivisions (c) to (g), inclusive, no later than 60 days after the date on which material was first reported pursuant to this section.
(B)If this paragraph applies, the social media platform shall promptly provide written notice of the delay, no later than 48 hours from the time the social media platform knew the delay was likely to occur, to the reporting user using the information collected from the reporting user under subdivision (b).
SEC. 3.Section 3273.67 of the Civil Code is amended to read:3273.67.(a)(1)A social media company that fails to comply with Section 3273.66 shall be liable in a civil action brought by the Attorney General, a district attorney, a city attorney, or a county counsel for a civil penalty not to exceed two hundred fifty thousand dollars ($250,000) for each day that the reporting mechanism is unavailable or nonfunctional and for reasonable attorneys fees and costs.
(2)For purposes of this subdivision, a reporting mechanism shall be deemed unavailable or nonfunctional if any of the following are true:
(A)The reporting mechanism is inaccessible to users due to technical failures, design defects, or removal from the social media platform.
(B)The reporting mechanism does not permit reporting in a manner consistent with the requirements of Section 3273.66.
(C)The reporting mechanism results in the failure to confirm receipt of a report within the timeframes described in Section 3273.66.
(3)The penalties described in this subdivision shall continue to accrue daily until the social media company restores full functionality of the reporting mechanism in compliance with Section 3273.66.
(4)In addition to monetary penalties, the Attorney General may seek injunctive relief to compel a social media company to immediately restore and maintain a fully functional reporting mechanism in compliance with Section 3273.66. The court may issue temporary, preliminary, or permanent injunctive relief as necessary to prevent ongoing violations.
(b)Subject to subdivision (c), a social media company that fails to comply with this title other than subdivision (a) of Section 3273.66 shall be liable to a depicted user individual who is the reporting user for all of the following:
(1)Any actual damages sustained by the depicted user individual as a result of the violation.
(2)(A)(i)Subject to clauses (ii) and (iii), statutory damages of no more than two hundred fifty thousand dollars ($250,000) per violation.
(ii)If a social media platform has permanently blocked the instance of the reported material pursuant to subdivision (d) of Section 3273.66 before a complaint is filed for a violation of this title, the maximum statutory damages awarded pursuant to clause (i) shall be one hundred twenty-five thousand dollars ($125,000) per violation.
(iii)If a social media platform meets all of the following requirements, the maximum statutory damages awarded pursuant to clause (i) for a violation of subdivisions (d) to (g), inclusive, of Section 3273.66 shall be seventy-five thousand dollars ($75,000) per violation:
(I)The social media platform registers with, and participates in, the National Center for Missing and Exploited Childrens Take It Down service or its successor.
(II)The social media platform receives updated hash values for identified child sexual abuse material from the National Center for Missing and Exploited Childrens Take It Down service, or its successor, at least once every 36 hours.
(III)Within 36 hours of receiving updated hash values for identified child sexual abuse material from the National Center for Missing and Exploited Childrens Take it It Down service, or its successor, pursuant to subclause (II), the social media platform removes child sexual abuse material identified by hash values from the social media platform.
(IV)The social media platform reports identified child sexual abuse material to the National Center for Missing and Exploited Childrens CyberTipline, as required by Section 2258A of Title 18 of the United States Code.
(V)The social media platform provides to a reporting user both of the following when a user reports child sexual abuse material to the platform directly:
(ia)Written confirmation to the reporting user that the social media platform received that persons report within 36 hours after the child sexual abuse material was reported.
(ib)A final written determination to the reporting user within 30 days after the date on which the material was first reported.
(B)In determining the amount of statutory damages pursuant to this paragraph, a court shall consider the willfulness and severity of the violation and whether the social media platform has previously violated this title.
(3)Costs of the action, together with reasonable attorneys fees, as determined by the court.
(4)Any other relief that the court deems proper.
(c)For a violation of subdivision (d) of Section 3273.66, a depicted user individual may bring a civil action to obtain relief pursuant to subdivision (b) if the depicted user individual is not a reporting user.
(d)The failure of a social media company to comply with subdivisions (c) to (g), inclusive, of Section 3273.66 within 60 days after the date on which material was first reported pursuant to Section 3273.66 shall establish a rebuttable presumption that the social media company is liable for statutory damages under this section.
(e)This title shall not be construed to limit or impair in any way a cause of action under paragraph (1) of Section 1710.
SEC. 4.Section 3345.1 of the Civil Code is amended to read:3345.1.(a)This section shall apply only in a civil action brought by, or on behalf of, or for the benefit of, a person who is a minor or nonminor dependent and is a victim of commercial sexual exploitation committed by a person who is over 18 years of age or facilitated, aided, or abetted by a social media platform in violation of subdivision (g). For purposes of this section, the age of the victim, the status of the victim as a minor or nonminor dependent, and the age of the defendant is determined at the time of the defendants act of commercial sexual exploitation of the victim.
(b)In a civil action brought by, on behalf of, or for the benefit of a minor, or nonminor dependent, against a person who engaged in any act of commercial sexual exploitation of a minor or nonminor dependent, whenever a trier of fact is authorized by a statute, other than subdivision (c), to impose either a fine, or a civil penalty or other penalty, or any other remedy the purpose or effect of which is to punish or deter, and the amount of the fine, penalty, or other remedy is subject to the trier of facts discretion, the trier of fact shall consider all of the following factors, in addition to other appropriate factors, in determining the amount of fine, civil penalty, or other penalty, or other remedy to impose. If the trier of fact makes an affirmative finding in regard to one or more of the following factors, it may impose a fine, civil penalty, or other penalty, or other remedy in an amount up to three times greater than authorized by the statute, or, if the statute does not authorize a specific amount, up to three times greater than the amount the trier of fact would impose in the absence of that affirmative finding:
(1)Whether the defendants conduct was directed to more than one minor or nonminor dependent.
(2)Whether one or more minors or nonminor dependents suffered substantial physical, emotional, or economic damage resulting from the defendants conduct.
(3)Whether the defendant knew or reasonably should have known that the victim was a minor or nonminor dependent. It shall not be a defense to imposition of fines, penalties, or other remedies pursuant to this paragraph that the defendant was unaware of the victims age or status as a nonminor dependent at the time of the act.
(c)If the trier of fact is not authorized by statute to impose a civil penalty in an action described in subdivision (b), the court may award a civil penalty not exceeding fifty thousand dollars ($50,000), and not less than ten thousand dollars ($10,000), for each act of commercial sexual exploitation committed by the defendant upon making an affirmative finding in regard to one or more of the factors set forth in paragraphs (1) to (3), inclusive, of subdivision (b). This penalty may be imposed in addition to any other remedy available in law or in equity.
(d)Any penalty imposed pursuant to this section shall be paid to the victim of the act of sexual exploitation.
(e)It shall not be a defense to the imposition of fines or penalties pursuant to this section that the victim consented to the act of commercial sexual exploitation.
(f)If the victim is under 18 years of age, the court, in its discretion, may order that any penalty imposed pursuant to this section be held in trust for the victim and used exclusively for the benefit and well-being of the victim. When the victim reaches 18 years of age or is emancipated, the trust shall expire and any unspent remainder shall be the sole property of the victim.
(g)(1)A social media platform shall not knowingly facilitate, aid, or abet commercial sexual exploitation.
(2)For a violation of this subdivision, a court shall award statutory damages not exceeding four million dollars ($4,000,000) and not less than one million dollars ($1,000,000) for each act of commercial sexual exploitation facilitated, aided, or abetted by the social media platform.
(3)A social media platform shall not be deemed to be in violation of this subdivision if it demonstrates all of the following:
(A)The social media platform has submitted for audit twice a year its designs, algorithms, practices, affordances, and features to a an independent third-party auditor with proven experience in trust and safety and content moderation to detect designs, algorithms, practices, affordances, or features that have the potential to cause, or contribute to, violations of this subdivision.
(B)The social media platform took action, within 30 days of the completion of an audit described in subparagraph (A), designed to mitigate or eliminate the reasonably foreseeable risk that a design, algorithm, practice, affordance, or feature violates, or contributes to a violation of, this subdivision.
(C)The social media platform provided to each member of the social media platforms board of directors a true and correct copy of each audit within 90 days of the audit being completed accompanied by a description of any action taken pursuant to subparagraph (B).
(D)Subject to the redaction of trade secrets, as defined in Section 3426.1, the social media company made public, within 90 days of its completion, the third-party audit described in subparagraph (A).
(4)Without in any way limiting the application of the term knowingly under paragraph (1), for purposes of this subdivision, a social media platform shall be deemed to have knowledge under paragraph (1) if all of the following are true:
(A)Material was reported to a social media platform using the mechanism required under subdivision (a) of Section 3273.66 for four consecutive months.
(B)The criteria set forth in paragraphs (1) to (3), inclusive, subdivision (a) of Section 3273.66 are established with respect to that reported material.
(C)The reported material was first displayed, stored, or hosted on the platform after January 1, 2025.
(5)As used in this subdivision, facilitate, aid, or abet means to deploy a system, design, feature, or affordance that is a substantial factor in causing minor users to be victims of commercial sexual exploitation.
(h)As used in this section:
(1)Commercial sexual exploitation means an act committed for the purpose of obtaining property, money, or anything else of value in exchange for, or as a result of, a sexual act of a minor or nonminor dependent, including, but not limited to, an act that would constitute a violation of any of the following:
(A)Sex trafficking of a minor in violation of subdivision (c) of Section 236.1 of the Penal Code.
(B)Pimping of a minor in violation of Section 266h of the Penal Code.
(C)Pandering of a minor in violation of subdivision (b) of Section 266i of the Penal Code.
(D)Procurement of a child under 16 years of age for lewd and lascivious acts in violation of Section 266j of the Penal Code.
(E)Solicitation of a child for a purpose that is either in violation of subparagraph (A) or pursuant to paragraph (3) of subdivision (b) of Section 647 of the Penal Code.
(F)An act of sexual exploitation described in subdivision (c) or (d) of Section 11165.1 of the Penal Code.
(2)Nonminor dependent has the same meaning as in subdivision (v) of Section 11400 of the Welfare and Institutions Code.
(3)(A)Social media platform has, except as provided in subparagraph (B), the same meaning as defined in Section 22675 of the Business and Professions Code.
(B)Social media platform does not include either of the following:
(i)A stand-alone direct messaging service that provides end-to-end encrypted communication or the portion of a multiservice platform that uses end-to-end encrypted communication.
(ii)An internet-based service or application owned or operated by a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
(i)A waiver of the provisions of this section is contrary to public policy and is void and unenforceable.
SEC. 5.The provisions of this act are severable. If any provision of this act or its application is held invalid, that invalidity shall not affect other provisions or applications that can be given effect without the invalid provision or application.
As used in this title:
(a)Child pornography has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.
(b)Child sexual abuse material means either of the following:
(1)Child pornography.
(2)Obscene matter that depicts a minor personally engaging in, or personally simulating, sexual conduct.
(c)Identifiable minor has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.(c)Clear and conspicuous has the same meaning as defined in Section 17601 of the Business and Professions Code.
(d)Depicted user means a user of a social media platform who is depicted, including through the use of digitization or artificial intelligence, in child sexual abuse material on a social media platform.
(d)(e)Minor has the same meaning as defined in Section 2256 of Title 18 of the United States Code, as amended from time to time.
(e)(f)Obscene matter has the same meaning as defined in Section 311 of the Penal Code.
(f)(g)Reporting user means a natural person who reports material to a social media platform using the means provided by the social media platform pursuant to Section 3273.61. 3273.66.
(g)(h)(1)Social media company has, except as provided in paragraph (2), the same meaning as defined in Section 22675 of the Business and Professions Code.
(2)Social media company does not include a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
(h)(i)(1)Social media platform has, except as provided in paragraph (2), the same meaning as defined in Section 22675 of the Business and Professions Code.
(2)Social media platform does not include either of the following:
(A)A stand-alone direct messaging service that provides end-to-end encrypted communication or the portion of a multiservice platform that uses end-to-end encrypted communication.
(B)An internet-based service or application owned or operated by a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
SEC. 2.Section 3273.66 of the Civil Code is amended to read:3273.66.A social media platform shall do all of the following:
(a)Provide, in a clear and conspicuous mechanism that is reasonably accessible to users, a means for a user who is a California resident to report material to the social media platform that the user reasonably believes meets all both of the following criteria:
(1)The reported material is child sexual abuse material.
(2)The reporting user is an identifiable minor depicted in the reported material.(3)(2)The reported material is displayed, stored, or hosted on the social media platform.
(b)(1)Collect information reasonably sufficient to enable the social media platform to contact, pursuant to subdivision (c), a reporting user.
(2)Ensure that any report submitted using the mechanism required by subdivision (a) receives a review by a natural person.
(c)A social media platform shall contact Contact a reporting user in writing by a method, including, but not limited to, a telephone number for purposes of sending text messages, or an email address, that meets both of the following criteria:
(1)The method is chosen by the reporting user.
(2)The method is not a method that is within the control of the social media company that owns or operates the social media platform.
(d)(1)Permanently block the instance of reported material from being viewable on the social media platform if the reported material meets all of the following criteria:
(A)There is a reasonable basis to believe that the reported material is child sexual abuse material.
(B)The reported material is displayed, stored, or hosted on the social media platform.
(C)(i)The report contains basic identifying information, such as an account identifier, sufficient to permit the social media platform to locate the reported material.
(ii)A social media platform shall not require a report to contain a specific piece of information for purposes of this subparagraph.
(2)A social media platform shall make reasonable efforts to remove and block other instances of the same reported material blocked pursuant to this subdivision from being viewable on the social media platform.
(e)Provide written confirmation to a reporting user that the social media platform received that persons report that meets all of the following criteria:
(1)The written confirmation is provided to the reporting user within 36 hours of when the material was first reported.
(2)The written confirmation is provided using the information collected from the reporting user under subdivision (b).
(3)The written confirmation informs the reporting user of the schedule of regular written updates that the social media platform is required to make under subdivision (f).
(f)(1)Provide a written update to the reporting user as to the status of the social media platforms handling of the reported material using the information collected from the reporting user under subdivision (b).
(2)The written update required by this subdivision shall be provided seven days after the date on which the written confirmation required under subdivision (e) was provided and every seven days thereafter until the final written determination required by subdivision (g) is provided.
(g)Issue a final written determination to the reporting user, using the information collected from the reporting user under subdivision (b), stating one of the following:
(1)The reported material has been determined to be child sexual abuse material that was displayed, stored, or hosted on the social media platform and has been blocked on the social media platform.
(2)The reported material has been determined not to be child sexual abuse material.
(3)The reported material has been determined not to be displayed, stored, or hosted on the social media platform.
(h)(1)Except as provided in paragraph (2), comply with subdivisions (c) to (g), inclusive, no later than 30 days after the date on which material was first reported pursuant to this section.
(2)(A)If the social media platform cannot comply with subdivisions (c) to (g), inclusive, due to circumstances beyond the reasonable control of the social media platform, the social media platform shall comply with subdivisions (c) to (g), inclusive, no later than 60 days after the date on which material was first reported pursuant to this section.
(B)If this paragraph applies, the social media platform shall promptly provide written notice of the delay, no later than 48 hours from the time the social media platform knew the delay was likely to occur, to the reporting user using the information collected from the reporting user under subdivision (b).
SEC. 3.Section 3273.67 of the Civil Code is amended to read:3273.67.(a)A (1)A social media company that fails to comply with Section 3273.66 shall be liable in a civil action brought by the Attorney General, a district attorney, a city attorney, or a county counsel for a civil penalty not to exceed two hundred fifty thousand dollars ($250,000) for each day that the reporting mechanism is unavailable or nonfunctional and for reasonable attorneys fees and costs.
(2)For purposes of this subdivision, a reporting mechanism shall be deemed unavailable or nonfunctional if any of the following are true:
(A)The reporting mechanism is inaccessible to users due to technical failures, design defects, or removal from the social media platform.
(B)The reporting mechanism does not permit reporting in a manner consistent with the requirements of Section 3273.66.
(C)The reporting mechanism results in the failure to confirm receipt of a report within the timeframes described in Section 3273.66.
(3)The penalties described in this subdivision shall continue to accrue daily until the social media company restores full functionality of the reporting mechanism in compliance with Section 3273.66.
(4)In addition to monetary penalties, the Attorney General may seek injunctive relief to compel a social media company to immediately restore and maintain a fully functional reporting mechanism in compliance with Section 3273.66. The court may issue temporary, preliminary, or permanent injunctive relief as necessary to prevent ongoing violations.
(b)Subject to subdivision (c), a social media company that fails to comply with the requirements of this title other than subdivision (a) of Section 3273.66 shall be liable to a depicted user who is the reporting user for all of the following:
(1)Any actual damages sustained by the reporting depicted user as a result of the violation.
(2)(A)(i)Subject to clauses (ii) and (iii), statutory damages of no more than two hundred fifty thousand dollars ($250,000) per violation.
(ii)If a social media platform has permanently blocked the instance of the reported material pursuant to subdivision (d) of Section 3273.66 before a complaint is filed for a violation of this title, the maximum statutory damages awarded pursuant to clause (i) shall be one hundred twenty-five thousand dollars ($125,000) per violation.
(iii)If a social media platform meets all of the following requirements, the maximum statutory damages awarded pursuant to clause (i) for a violation of subdivisions (d) to (g), inclusive, of Section 3273.66 shall be seventy-five thousand dollars ($75,000) per violation:
(I)The social media platform registers with, and participates in, the National Center for Missing and Exploited Childrens Take It Down service or its successor.
(II)The social media platform receives updated hash values for identified child sexual abuse material from the National Center for Missing and Exploited Childrens Take It Down service, or its successor, at least once every 36 hours.
(III)Within 36 hours of receiving updated hash values for identified child sexual abuse material from the National Center for Missing and Exploited Childrens Take it Down service, or its successor, pursuant to subclause (II), the social media platform removes child sexual abuse material identified by hash values from the social media platform.
(IV)The social media platform reports identified child sexual abuse material to the National Center for Missing and Exploited Childrens CyberTipline, as required by Section 2258A of Title 18 of the United States Code.
(V)The social media platform provides to a reporting user both of the following when a user reports child sexual abuse material to the platform directly:
(ia)Written confirmation to the reporting user that the social media platform received that persons report within 36 hours after the child sexual abuse material was reported.
(ib)A final written determination to the reporting user within 30 days after the date on which the material was first reported.
(B)In determining the amount of statutory damages pursuant to this paragraph, a court shall consider the willfulness and severity of the violation and whether the social media platform has previously violated this title.
(3)Costs of the action, together with reasonable attorneys fees, as determined by the court.
(4)Any other relief that the court deems proper.
(c)For a violation of subdivision (d) of Section 3273.66, a depicted user may bring a civil action to obtain relief pursuant to subdivision (b) if the depicted user is not a reporting user.
(b)(d)The failure of a social media platform company to comply with subdivisions (c) to (g), inclusive, of Section 3273.66 within 60 days after the date on which material was first reported pursuant to Section 3273.66 shall establish a rebuttable presumption that the reporting user is entitled to social media company is liable for statutory damages under this section.
(c)(e)This title shall not be construed to limit or impair in any way a cause of action under paragraph (1) of Section 1710.
SEC. 4.Section 3345.1 of the Civil Code is amended to read:3345.1.(a)This section shall apply only in a civil action brought by, or on behalf of, or for the benefit of, a person who is a minor or nonminor dependent and is a victim of commercial sexual exploitation committed by a person who is over 18 years of age or facilitated, aided, or abetted by a social media platform in violation of subdivision (g). For purposes of this section, the age of the victim, the status of the victim as a minor or nonminor dependent, and the age of the defendant is determined at the time of the defendants act of commercial sexual exploitation of the victim.
(b)In a civil action brought by, on behalf of, or for the benefit of a minor, or nonminor dependent, against a person who engaged in any act of commercial sexual exploitation of a minor or nonminor dependent, whenever a trier of fact is authorized by a statute, other than subdivision (c), to impose either a fine, or a civil penalty or other penalty, or any other remedy the purpose or effect of which is to punish or deter, and the amount of the fine, penalty, or other remedy is subject to the trier of facts discretion, the trier of fact shall consider all of the following factors, in addition to other appropriate factors, in determining the amount of fine, civil penalty, or other penalty, or other remedy to impose. If the trier of fact makes an affirmative finding in regard to one or more of the following factors, it may impose a fine, civil penalty, or other penalty, or other remedy in an amount up to three times greater than authorized by the statute, or, if the statute does not authorize a specific amount, up to three times greater than the amount the trier of fact would impose in the absence of that affirmative finding:
(1)Whether the defendants conduct was directed to more than one minor or nonminor dependent.
(2)Whether one or more minors or nonminor dependents suffered substantial physical, emotional, or economic damage resulting from the defendants conduct.
(3)Whether the defendant knew or reasonably should have known that the victim was a minor or nonminor dependent. It shall not be a defense to imposition of fines, penalties, or other remedies pursuant to this paragraph that the defendant was unaware of the victims age or status as a nonminor dependent at the time of the act.
(c)If the trier of fact is not authorized by statute to impose a civil penalty in an action described in subdivision (b), the court may award a civil penalty not exceeding fifty thousand dollars ($50,000), and not less than ten thousand dollars ($10,000), for each act of commercial sexual exploitation committed by the defendant upon making an affirmative finding in regard to one or more of the factors set forth in paragraphs (1) to (3), inclusive, of subdivision (b). This penalty may be imposed in addition to any other remedy available in law or in equity.
(d)Any penalty imposed pursuant to this section shall be paid to the victim of the act of sexual exploitation.
(e)It shall not be a defense to the imposition of fines or penalties pursuant to this section that the victim consented to the act of commercial sexual exploitation.
(f)If the victim is under 18 years of age, the court, in its discretion, may order that any penalty imposed pursuant to this section be held in trust for the victim and used exclusively for the benefit and well-being of the victim. When the victim reaches 18 years of age or is emancipated, the trust shall expire and any unspent remainder shall be the sole property of the victim.
(g)(1)A social media platform shall not knowingly facilitate, aid, or abet commercial sexual exploitation.
(2)For a violation of this subdivision, a court shall award statutory damages not exceeding four million dollars ($4,000,000) and not less than one million dollars ($1,000,000) for each act of commercial sexual exploitation facilitated, aided, or abetted by the social media platform.
(3)A social media platform shall not be deemed to be in violation of this subdivision if it demonstrates all of the following:
(A)The social media platform instituted and maintained a program of at least biannual audits of has submitted for audit twice a year its designs, algorithms, practices, affordances, and features to a third-party auditor to detect designs, algorithms, practices, affordances, or features that have the potential to cause cause, or contribute to to, violations of this subdivision.
(B)The social media platform took action, within 30 days of the completion of an audit described in subparagraph (A), designed to mitigate or eliminate the reasonably foreseeable risk that a design, algorithm, practice, affordance, or feature violates, or contributes to a violation of, this subdivision.
(C)The social media platform provided to each member of the social media platforms board of directors a true and correct copy of each audit within 90 days of the audit being completed accompanied by a description of any action taken pursuant to subparagraph (B).
(D)Subject to the redaction of trade secrets, as defined in Section 3426.1, the social media company made public, within 90 days of its completion, the third-party audit described in subparagraph (A).
(4)Without in any way limiting the application of the term knowingly under paragraph (1), for purposes of this subdivision, a social media platform shall be deemed to have knowledge under paragraph (1) if all of the following are true:
(A)Material was reported to a social media platform using the mechanism required under subdivision (a) of Section 3273.66 for four consecutive months.
(B)The criteria set forth in paragraphs (1) to (3), inclusive, subdivision (a) of Section 3273.66 are established with respect to that reported material.
(C)The reported material was first displayed, stored, or hosted on the platform after January 1, 2025.
(5)As used in this subdivision, facilitate, aid, or abet means to deploy a system, design, feature, or affordance that is a substantial factor in causing minor users to be victims of commercial sexual exploitation.
(h)As used in this section:
(1)Commercial sexual exploitation means an act committed for the purpose of obtaining property, money, or anything else of value in exchange for, or as a result of, a sexual act of a minor or nonminor dependent, including, but not limited to, an act that would constitute a violation of any of the following:
(A)Sex trafficking of a minor in violation of subdivision (c) of Section 236.1 of the Penal Code.
(B)Pimping of a minor in violation of Section 266h of the Penal Code.
(C)Pandering of a minor in violation of subdivision (b) of Section 266i of the Penal Code.
(D)Procurement of a child under 16 years of age for lewd and lascivious acts in violation of Section 266j of the Penal Code.
(E)Solicitation of a child for a purpose that is either in violation of subparagraph (A) or pursuant to paragraph (3) of subdivision (b) of Section 647 of the Penal Code.
(F)An act of sexual exploitation described in subdivision (c) or (d) of Section 11165.1 of the Penal Code.
(2)Nonminor dependent has the same meaning as in subdivision (v) of Section 11400 of the Welfare and Institutions Code.
(3)(A)Social media platform has, except as provided in subparagraph (B), the same meaning as defined in Section 22675 of the Business and Professions Code.
(B)Social media platform does not include either of the following:
(i)A stand-alone direct messaging service that provides end-to-end encrypted communication or the portion of a multiservice platform that uses end-to-end encrypted communication.
(ii)An internet-based service or application owned or operated by a nonprofit organization exempt from federal income tax pursuant to Section 501(c)(3) of the Internal Revenue Code.
(i)A waiver of the provisions of this section is contrary to public policy and is void and unenforceable.
SEC. 5.The provisions of this act are severable. If any provision of this act or its application is held invalid, that invalidity shall not affect other provisions or applications that can be given effect without the invalid provision or application.
SECTION 1.Section 3110 of the Civil Code is amended to read:3110.For purposes of this title, the following definitions apply:(a)Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.(b)Developer means a person, partnership, state or local government agency, or corporation that designs, codes, produces, or substantially modifies an artificial intelligence system or service for use by members of the public. For purposes of this subdivision, members of the public does not include an affiliate as defined in subparagraph (A) of paragraph (1) of subdivision (c) of Section 1799.1a, or a hospitals medical staff member.(c)Generative artificial intelligence means artificial intelligence that can generate derived synthetic content, such as text, images, video, and audio, that emulates the structure and characteristics of the artificial intelligences training data.(d)Substantially modifies or substantial modification means a new version, new release, or other update to a generative artificial intelligence system or service that materially changes its functionality or performance, including the results of retraining or fine tuning.(e)Synthetic data generation means a process in which seed data are used to create artificial data that have some of the statistical characteristics of the seed data.(f)Train a generative artificial intelligence system or service includes testing, validating, or fine tuning by the developer of the artificial intelligence system or service.For purposes of this title, the following definitions shall apply:
(a)Artificial intelligence means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.
(b)Developer means a person, partnership, state or local government agency, or corporation that designs, codes, produces, or substantially modifies an artificial intelligence system or service for use by members of the public. For purposes of this subdivision, members of the public does not include an affiliate as defined in subparagraph (A) of paragraph (1) of subdivision (c) of Section 1799.1a, or a hospitals medical staff member.
(c)Generative artificial intelligence means artificial intelligence that can generate derived synthetic content, such as text, images, video, and audio, that emulates the structure and characteristics of the artificial intelligences training data.
(d)Substantially modifies or substantial modification means a new version, new release, or other update to a generative artificial intelligence system or service that materially changes its functionality or performance, including the results of retraining or fine tuning.
(e)Synthetic data generation means a process in which seed data are used to create artificial data that have some of the statistical characteristics of the seed data.
(f)Train a generative artificial intelligence system or service includes testing, validating, or fine tuning by the developer of the artificial intelligence system or service.
|
Date
|
Status
|
|---|---|
| Feb 2, 2026 | From committee: Filed with the Chief Clerk pursuant to Joint Rule 56. |
| Jan 31, 2026 | Died pursuant to Art. IV, Sec. 10(c) of the Constitution. |
| May 23, 2025 | In committee: Held under submission. |
| May 7, 2025 | In committee: Set, first hearing. Referred to APPR. suspense file. |
| Apr 30, 2025 | From committee: Do pass and re-refer to Com. on APPR. (Ayes 11. Noes 0.) (April 29). Re-referred to Com. on APPR. |
| Apr 30, 2025 | Coauthors revised. |
| Apr 23, 2025 | From committee: Do pass and re-refer to Com. on JUD. (Ayes 13. Noes 0.) (April 22). Re-referred to Com. on JUD. |
| Apr 23, 2025 | Coauthors revised. |
| Apr 22, 2025 | Re-referred to Com. on P. & C.P. |
| Apr 21, 2025 | From committee chair, with author's amendments: Amend, and re-refer to Com. on P. & C.P. Read second time and amended. |
| Apr 21, 2025 | Re-referred to Com. on P. & C.P. |
| Apr 10, 2025 | From committee chair, with author's amendments: Amend, and re-refer to Com. on P. & C.P. Read second time and amended. |
| Mar 25, 2025 | Re-referred to Com. on P. & C.P. |
| Mar 24, 2025 | From committee chair, with author's amendments: Amend, and re-refer to Com. on P. & C.P. Read second time and amended. |
| Mar 24, 2025 | Referred to Coms. on P. & C.P. and JUD. |
| Feb 21, 2025 | From printer. May be heard in committee March 23. |
| Feb 20, 2025 | Read first time. To print. |
|
Date
|
Description
|
Location
|
Votes
|
|
|---|---|---|---|---|
| Apr 29, 2025 | Do pass and be re-referred to the Committee on [Appropriations] | Assembly Standing Committee on Judiciary |
Passed |
|
| Apr 22, 2025 | Do pass and be re-referred to the Committee on [Judiciary] | Assembly Standing Committee on Privacy and Consumer Protection |
Passed |
This list shows positions taken on this bill by organizations on the date displayed, which is linked to the original source.
Positions by individuals are not included.
|
Organization
|
Position
|
Date
|
|---|---|---|
| 3strands global foundation | ** Support | |
| California Catholic Conference | ** Support | |
| California Chamber Of Commerce | ** Against | |
| California Initiative for Technology & Democracy, a Project of California Common Cause | ** Support | |
| Childrens Advocacy Institute | ** Support | |
| Computer & Communications Industry Association | ** Against | |
| Jewish Family and Children's Services of San Francisco, the Peninsula, Marin and Sonoma Counties | ** Support | |
| National Center for Missing & Exploited Children | ** Support | |
| National Center on Sexual Exploitation | ** Support | |
| Technet-Technology Network | ** Against |
Date of Hearing: May 7, 2025
ASSEMBLY COMMITTEE ON APPROPRIATIONS
Buffy Wicks, Chair
ABPCA Bill Id:AB 1137
Author:(Krell) – As Amended Ver:April 21, 2025
Policy Committee: | Privacy and Consumer Protection | Vote: | 13 - 0 |
Judiciary | 11 - 0 | ||
|
|
Urgency: No State Mandated Local Program: No Reimbursable: No
SUMMARY:
This bill authorizes enforcement of the child sexual abuse material (CSAM) reporting law by public prosecutors, allows any person to report CSAM content to a social media platform, and requires related social media company audits to be conducted by a third party auditor and made public.
FISCAL EFFECT:
- Possible costs (General Fund, special funds) to the Department of Justice (DOJ) of an unknown amount. Actual costs will depend on whether the Attorney General pursues enforcement actions, and, if so, the level of additional staffing DOJ needs to handle the related workload. If DOJ hires staff to handle enforcement actions authorized by this bill, the department would incur significant costs, likely in the low hundreds of thousands of dollars annually at a minimum. If DOJ does not pursue enforcement as authorized by this bill, the department would likely not incur any costs.
- Cost pressures (Trial Court Trust Fund, General Fund) of an unknown but potentially significant amount to the courts to adjudicate civil enforcement actions authorized by this bill. Actual costs will depend on the number of cases filed and the amount of court time needed to resolve each case. It generally costs approximately $1,000 to operate a courtroom for one hour. Although courts are not funded on the basis of workload, increased pressure on the Trial Court Trust Fund may create a demand for increased funding for courts from the General Fund. The fiscal year 2024-25 state budget provides $37.3 million ongoing General Fund to backfill declining revenue to the Trial Court Trust Fund.
COMMENTS:
In 2023, the Legislature enacted AB 1394 (Wicks), Chapter 579, Statutes of 2023, which requires a social media platform to remove CSAM (sometimes referred to as child pornography) when a person depicted in the material notifies the platform and requests its removal. If a platform fails to do so, as specified in the law, the person depicted in the material may file a lawsuit against the platform.
This bill expands reporting of CSAM to platforms and enforcement of a platform’s failure to comply with the exiting law. It requires a social media platform to accept reports of CSAM from any user of the platform (not just from a person depicted in the material) requires the platform to provide a human review (rather an automated review) of specified reports of CSAM, and authorizes civil enforcement by public prosecutors, with civil penalties of up to $250,000 for each day a social media platform’s CSAM reporting mechanism is nonoperational.
Analysis Prepared by: Annika Carlson / APPR. / (916) 319-2081
Date of Hearing: April 29, 2025
ASSEMBLY COMMITTEE ON JUDICIARY
Ash Kalra, Chair
ABPCA Bill Id:AB 1137
Author:(Krell) – As Amended Ver:April 21, 2025
SUBJECT: Reporting mechanism: child sexual abuse material
KEY ISSUE: Should the Legislature enhance California’s statutory framework for combating online child sexual abuse material (CSAM) and commercial sexual exploitation by closing gaps in a Recently enacted law?
SYNOPSIS
In 2023, the Legislature enacted AB 1394 (Wicks, Chap. 579, Stats. 2023), establishing a first-in-the-nation statutory framework to require social media platforms to remove child sexual abuse material (CSAM) reported by victims and to impose civil liability on platforms that knowingly facilitated the commercial sexual exploitation of minors through harmful design choices. That law became operative on January 1, 2025.
AB 1137 strengthens and clarifies existing provisions by (1) allowing any user—not just the depicted minor—to report CSAM; (2) requiring human review when automated systems fail to detect reported content; (3) enabling public enforcement when a reporting mechanism is inaccessible or nonfunctional; and (4) ensuring that platforms claiming a liability safe harbor have conducted independent, third-party audits that are made public. The bill is sponsored by the Children’s Advocacy Institute at the University of San Diego School of Law and National Center on Sexual Exploitation, and is supported by the California Initiative for Technology & Democracy (CITED), Jewish Family and Children’s Services in the in the Bay Area, and the National Center for Missing & Exploited Children. The bill is opposed by TechNet, California Chamber of Commerce, and Computer & Communications Industry Association. This measure passed out of the Assembly Committee on Privacy and Consumer Protection by a 13-0 vote.
SUMMARY: Strengthens enforcement and accountability under California’s child sexual abuse material (CSAM) reporting law by expanding who may report, requiring human review of flagged content, enabling public enforcement, and mandating independent audits of platform features that contribute to commercial sexual exploitation. Specifically, this bill:
- Requires CSAM reporting mechanisms on social media platforms to be clear and conspicuous.
- Expands the scope of users who may report CSAM to a social media platform by no longer limiting such users to identifiable minors, thereby enabling any user to submit such reports.
- Requires platforms to ensure CSAM reports receive a review by a natural person if the material does not match a hash value for known CSAM and will not otherwise be blocked.
- Enables public prosecutors to bring a civil action against a social media company for each day the mechanism is unavailable or nonfunctional. The public prosecutor may seek up to $250,000 for each day in which the company is noncompliant, as well as reasonable attorney’s fees and costs. Deems a mechanism unavailable or nonfunctional if the mechanism is inaccessible or otherwise not compliant with existing requirements governing the mechanism. Enables the Attorney General to seek injunctive relief to compel a social media company to immediately restore and maintain a fully functional reporting mechanism.
- Limits private standing to sue social media companies for failure to properly implement the CSAM reporting mechanism to depicted individuals who are reporting users, rather than reporting users generally. Enables depicted individuals who are not reporting users to obtain relief for a platform’s failure to block the material depicting the individual.
- With respect to an existing provision that shields social media platforms from liability for knowing facilitation, aiding, or abetting of commercial sexual exploitation if they conduct biannual audits, requires that such audits be conducted by independent third-party auditors with proven experience in trust and safety and content moderation. The audit must be made public within 90 days of completion, and may be redacted for trade secrets.
- Clarifies that the definition of “facilitate, aid, or abet” applies to commercial sexual exploitation of minors, rather than minor users.
- Contains a severability clause.
EXISTING LAW:
- Requires online electronic service providers in the United States to report to the CyberTipline operated by the National Center for Missing & Exploited Children if they become aware of apparent CSAM on their platform. (18 U.S.C. Section 2258A.)
- Defines, among other terms:
- “Child abuse material” to include child pornography or obscene matter depicting a minor personally engaging in or personally simulating sexual conduct. Incorporates definitions from existing law, including:
- “Child pornography,” which means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where any of the following apply:
- The production of such visual depiction involves the use of a minor engaging in sexually explicit conduct.
- Such visual depiction is a digital image, computer image, or computer-generated image that is, or is indistinguishable from, that of a minor engaging in sexually explicit conduct.
- Such visual depiction has been created, adapted, or modified to appear that an identifiable minor is engaging in sexually explicit conduct. (18 U.S.C. Section 2256(8).)
- “Minor,” which means a person under the age of 18 years. (Id. at (1).).
- “Obscene matter,” which means matter, taken as a whole, that to the average person, applying contemporary statewide standards, appeals to the prurient interest, that, taken as a whole, depicts or describes sexual conduct in a patently offensive way, and that, taken as a whole, lacks serious literary, artistic, political, or scientific value. (Penal Code Section 311 (a).)
- “Child pornography,” which means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where any of the following apply:
- “Clear and conspicuous” to mean larger type than the surrounding text, or in contrasting type, font, or color to the surrounding text of the same size, or set off from the surrounding text of the same size by symbols or other marks, in a manner that clearly calls attention to the language. (Business and Professions Code Section 17601.)
- “Social media company” as a person or entity that owns or operates one or more social media platforms. (Business and Professions Code Section 22675(e).)
- “Social media platform” as a public or semipublic internet-based service or application that has users in California and that meets both of the following criteria:
- A substantial function of the service or application is to connect users in order to allow users to interact socially with each other within the service or application. A service or application that provides email or direct messaging services shall not be considered to meet this criterion on the basis of that function alone.
- The service or application allows users to do all of the following:
- Construct a public or semipublic profile for purposes of signing into and using the service or application.
- Populate a list of other users with whom an individual shares a social connection within the system.
- Create or post content viewable by other users, including, but not limited to, on message boards, in chat rooms, or through a landing page or main feed that presents the user with content generated by other users. (Business and Professions Code Section 22675 (f).)
- “Child abuse material” to include child pornography or obscene matter depicting a minor personally engaging in or personally simulating sexual conduct. Incorporates definitions from existing law, including:
- Requires a social media platform to do all of the following:
- Provide an accessible mechanism for California users to report material to the platform the user reasonably believes is CSAM that is displayed, stored, or hosted on the platform. (Civil Code Section 3273.66 (a).)
- Collect information reasonably sufficient to enable the platform to contact the reporting user and contact the user in writing by a method chosen by the user that is not in control of the social media company that operates the platform. (Id. at (b), (c).)
- Permanently block the instance of reported material, and make reasonable efforts to remove and block other instances of the same material, from being viewable on the platform if there is a reasonable basis to believe it is CSAM; it is stored, displayed, hosted on the platform; and the report contains basic identifying information sufficient to permit the platform to locate the reported material. (Id. at (d).)
- Provide a written confirmation regarding receipt of the report within 36 hours of the report with a description of the schedule of regular written updates that the platform is required to make. (Id. at (e).)
- Provide a written update to the reporting user as to the status of the platform’s handling of the reported material using the information collected from the reporting user, as described above. (Id. at (f).)
- Issue a final written determination to the reporting use stating whether the material has been determined to be CSAM displayed, stored, or hosted on the social media platform. (Id. at (g).)
- Comply with the requirements described above within 30 days unless there are circumstances beyond the reasonable control of the platform, which case compliance must be within 60 days but notice of the delay must be provided to the reporting user within 48 hours of the time the platform knew the delay was likely to occur. (Id. at (h).)
- Makes a social media platform that fails to comply with the requirements described above liable to a reporting user for actual damages sustained by the reporting user as a result of the violation, statutory damages of no more than $250,000, as specified, costs of the action, and any other relief the court deems proper. (Civil Code Section 3273.67 (a).)
- Establishes a rebuttable presumption that the social media company is liable for statutory damages if it fails to comply with the reporting and blocking provisions described above within 60 days of the date on which the material was first reported. (Id. at (b).)
- Prohibits a social media platform from knowingly facilitating, aiding, or abetting commercial sexual exploitation of a minor or nonminor dependent. Deems a platform to have knowledge if CSAM is reported on its platform for four consecutive months, and provides the platform is facilitating, aiding, or abetting if its features are a substantial factor in causing minor users to be victims of commercial sexual exploitation. Imposes statutory damages of between $1,000,000 and $4,000,000 for violations. Provides that a platform is not subject to this liability if it institutes a program of at least biannual audits of its designs, algorithms, practices, affordances, and features to detect designs, algorithms, practices, affordances, or features that have the potential to result in violations; takes action within 30 days of completion of an audit designed to mitigate or eliminate foreseeable risk of violations; and provides the platform’s board of directors with the audits within 90 days of completion of the mitigations. (Civil Code Section 3345.1 (g).)
FISCAL EFFECT: As currently in print this bill is keyed fiscal.
COMMENTS: Social media platforms continue to serve as central vectors for the dissemination of child sexual abuse material (CSAM) and the facilitation of commercial sexual exploitation, often through design choices that amplify harmful content or allow it to persist despite user reports. In 2023, the Legislature enacted AB 1394 (Wicks, Chap. 579, Stats. 2023) to create a statutory right for victims to demand the removal of CSAM in which they are depicted and to hold platforms liable when their systems knowingly facilitate child exploitation.
AB 1137 strengthens the law by refining and enforcing AB 1394’s core protections: it expands who may report CSAM, requires human review when hash-matching fails, authorizes public prosecutors to enforce reporting obligations, and mandates that liability-shielding audits be conducted by independent experts and made public. These measured amendments ensure that the original intent of AB 1394—protecting children from enduring digital abuse—is realized in practice. The author explains the impetus for this measure:
Social media has become one of the preferred avenues for predators to solicit, market, and share child sexual abuse material (CSAM). In 2023 alone, Facebook and Instagram each reported more than 10,000,000 instances of CSAM, as noted in the CyberTipline Reports by Electronic Services Providers. Behind the reports are images of kids who have been sexually abused. The most frequently traded CSAM depicts children aged 9-12 years old. In graphic and brutal pictures and videos, the violation of a child is on display for the world to see. For the child, it serves as a permanent reminder of their trauma and humiliation.
AB 1137 strengthens the existing tool to report child sexual abuse material on social media platforms by allowing anyone to report CSAM (not just the victim depicted), requiring reports to be reviewed by a natural person, and empowering victims to take legal action. This bill further compels social media platforms to have more transparency by requiring the reporting mechanism to be clear and conspicuous.
Existing law allows social media companies to be protected from liability for commercial sexual exploitation if they conduct a biannual audit aimed at identifying designs and features contributing to its spread. To improve transparency and accountability, this bill would instead require that audit to be performed by a third-party and made public.
Legislative history – AB 1394 (Wicks, Chap. 579, Stats. 2023). AB 1394 established California’s first statutory framework to combat the proliferation of child sexual abuse material (CSAM) on social media platforms. AB 1394 was enacted in response to escalating evidence that major platforms—including Facebook, Instagram, TikTok, and others—not only host vast amounts of CSAM, but through design features such as algorithmic recommendations, livestream gifting, and unmoderated chat functions, actively facilitate its production and dissemination. As enacted, AB 1394 imposed two primary obligations:
- CSAM Reporting and Removal: Social media platforms must provide a mechanism for users to report material they reasonably believe constitutes CSAM in which they are depicted as identifiable minors. The platform must review, block, and remove the reported content within 30 days (extendable to 60 days in limited circumstances), and issue written confirmation and weekly status updates to the reporting user. Platforms are required to block not only the reported material, but also make reasonable efforts to prevent recirculation of the same content.
- Liability for Facilitating Commercial Sexual Exploitation: The bill amended Civil Code Section 3345.1 to impose strict civil liability—ranging from $1 million to $4 million per act—on social media platforms that knowingly “facilitate, aid, or abet” the commercial sexual exploitation of minors. “Facilitate, aid, or abet” was defined to include deploying a system, design, feature, or affordance that is a substantial factor in causing exploitation. Platforms could invoke a safe harbor if they conducted biannual audits and mitigated foreseeable risks.
AB 1394’s passage followed extensive findings of fact. The bill cited whistleblower testimony revealing that Meta (Facebook and Instagram) deprioritized CSAM enforcement due to “return on investment” concerns, failed to train moderators, and permitted encrypted systems and groups to operate as hubs for trafficking. It also relied on investigative reporting showing how TikTok’s livestream functions were monetizing sexualized interactions with minors. AB 1394 passed both houses of the Legislature unanimously, with votes of 77-0 on the Assembly floor and 40-0 in the Senate. It was widely supported by survivor advocates, child safety organizations, and public interest groups, and was signed into law by Governor Newsom on October 8, 2023. The law became operative on January 1, 2025.
AB 1137 builds upon this statutory foundation by refining enforcement mechanisms, expanding standing, and addressing gaps in audit transparency and reporting accessibility that have emerged in the initial months following AB 1394’s implementation.
The legislative gap left by AB 1394. Social media platforms remain vectors for the viral spread of child sexual abuse material (CSAM), and existing statutory protections enacted by AB 1394—though groundbreaking—reveal gaps in existing law.
First, survivors cannot access the protections of AB 1394 unless they themselves submit the report, even when the CSAM is identified and reported by a trusted adult, clinician, teacher, or nonprofit. This limitation has created a substantial barrier for the most vulnerable users—especially traumatized minors, or those who may be unaware that such images are circulating. AB 1137 addresses this flaw by expanding reporting eligibility to any user and preserving standing for the depicted individual, thereby ensuring that victims are not barred from relief due to procedural technicalities.
Second, platforms are under no legal obligation to meaningfully review a report, unless there is a hash match, even when CSAM is obvious to a human reviewer. Hash matching tools work “by assigning a unique digital fingerprint, called a hash value, to nude, partially nude, or sexually explicit images or videos of people under the age of 18. Online platforms can use hash values to detect these images or videos on their services and remove this content.” (NCMEC: Take It Down, available at https://takeitdown.ncmec.org/.) Once a hash is generated, social media platforms can use it to not only remove existing copies of the CSAM, but also rapidly compare image and video files that users attempt to upload for a match, analogous to the process that they use to scan incoming files for computer viruses. But as generative AI tools rapidly advance, bad actors now digitally manipulate content to avoid detection by hash-matching systems, which automated technological tools that identify known digital content—such as CSAM—by comparing the cryptographic “hash” of a file against a database of hashes corresponding to previously identified illegal material. In the absence of a human review mandate, such images may continue circulating indefinitely. AB 1137 fills this enforcement gap by requiring natural person review of reported material that does not trigger a known hash match and remains unblocked.
Third, AB 1394 lacks a clear and enforceable mechanism to ensure that the CSAM reporting portal is actually functional. Investigations by child safety advocates have documented that many major platforms bury their reporting tools deep within app settings, fragment the process across multiple interfaces, or provide pathways that lead to dead ends. Platforms can claim to have “implemented” the required reporting system while making it nearly impossible to find or use. AB 1137 resolves this deficiency by requiring a “clear and conspicuous” reporting mechanism.
Fourth, while the California Attorney General generally retains the authority to enforce any civil statute, unless expressly excluded, AB 1394 was silent on public enforcement. As a result, it was unclear whether local prosecutors or the Attorney General could enforce its provisions independently of private litigants. AB 1137 makes this enforcement power explicit. It grants the Attorney General, district attorneys, city attorneys, and county counsel clear authority to pursue civil penalties and injunctive relief for failure to maintain a functional reporting system. This amendment ensures that public enforcement does not depend on the availability of private litigants and creates a more proactive compliance framework.
Finally, the audit safe harbor provision under AB 1394 allows platforms to avoid liability for facilitating commercial sexual exploitation if they conduct biannual audits and mitigate foreseeable risks—but the law does not require those audits to be performed by independent experts or to made public. As a result, companies may self-certify compliance without scrutiny. AB 1137 attempts to correct this by requiring independent, third-party audits conducted by experts in trust and safety, and mandates public disclosure of the audit (with redaction of trade secrets).
Concerns. Industry groups argue that AB 1137 makes significant changes to AB 1394, which only became operative on January 1, 2025. They contend that enforcement data is not yet available and that the Legislature should wait before amending the law. AB 1137, however, does not revise the core obligations enacted by AB 1394—it clarifies, enforces, and according to the author, closes known loopholes identified during the implementation ramp-up period.
The majority of the concerns raised by the opposition—and the gist of the discussion in the Committee on Privacy and Consumer Protection’s hearing on this bill, centered on the audit frequency and publication requirements—issues largely outside this Committee’s jurisdiction. Industry representatives argue that the requirement to make CSAM-related audits public—subject to trade secret redactions—could inadvertently assist bad actors by revealing system vulnerabilities and enforcement strategies. They further argue that requiring twice-yearly independent audits places an extreme burden on providers. The audit requirement under Civil Code Section 3345.1 already existed under AB 1394, but it permitted self-directed reviews and internal disclosures. AB 1137 amends that provision to require that the audits are conducted by qualified, independent third parties and are transparent to the public, subject to redactions to protect proprietary technology.
Opponents further contend that the daily penalty for nonfunctional reporting systems is disproportionate and punitive, particularly for platforms that are making good-faith efforts to comply, and that the enforcement should be “proportional.” As drafted, the daily penalty applies only when the reporting mechanism is unavailable, inaccessible, or noncompliant with statutory requirements. These failures are not minor technical glitches—they represent the entire mechanism by which survivors report CSAM and seek protection. The penalty is calibrated to ensure rapid remediation of platform failures. Moreover, AB 1137 preserves judicial discretion in the event of enforcement. Specifically, the statute permits a civil penalty of up to $250,000 per day for failure to maintain a functional reporting mechanism, but leaves the amount of the penalty to the discretion of the court, which may consider the nature of the violation, efforts to comply, and mitigating circumstances. Courts are fully empowered to impose lower penalties where appropriate, ensuring that enforcement is proportional and tailored to the facts of each case. This flexible structure ensures that serious violations can be meaningfully deterred without creating rigid or unfair burdens for platforms acting in good faith.
ARGUMENTS IN SUPPORT: The Children’s Advocacy Institute at the University of San Diego School of Law, a co-sponsor of the bill, writes:
Given a full year to comply with California’s landmark AB 1394 (Wicks and Flora) and notwithstanding soaring profits, social media platforms have apparently done nothing or next to nothing to comply with that law, one compassionately aimed at protecting sexually brutalized and exploited children.
AB 1394 was prompted by the well-documented role social media platforms play in helpfully and indispensably ensuring (i) that images and videos of child rape and sex abuse (CSAM) randomly uploaded by third-party criminals are efficiently delivered to eager pedophiles even when they don’t search for it and (ii) that criminal sex traffickers who profit from child rape are efficiently and inexpensively matched with pedophile customers.
Also, since AB 1394’s enactment, the astonishing growth in the power and sophistication of AI means all this will soon get worse, fast. For these reasons, AB 1137 surgically makes current law stronger in the hope the platforms will do more to prevent child sex abuse and trafficking.
The National Center on Sexual Exploitation, co-sponsors of the bill, write:
This legislation represents a critical step in preventing the further spread of CSAM and protecting children from sexual exploitation online. The harms of CSAM cannot be overstated. Survivors suffer long-lasting trauma, and every time an image is shared, it compounds that harm—creating a perpetual cycle of revictimization. Online platforms, as primary vehicles for sharing this material, have a responsibility to act swiftly and decisively to remove it and assist in the identification of perpetrators.
Research supports the need for vigilance and proactive measures. The Butner Study, a landmark longitudinal study conducted by the Federal Bureau of Prisons, found that over 85% of men convicted of offenses involving CSAM had also committed contact sexual offenses against children, even if they had not been previously charged. This finding dismantles the myth that CSAM offenders are not hands-on offenders, and highlights the very real risk they pose to children offline as well. Additionally, the National Center for Missing and Exploited Children (NCMEC) received over 36 million reports to its CyberTipline in 2023 alone—many involving material circulating on mainstream platforms. These numbers demonstrate the scale of the problem and the urgent need for platforms to implement effective, human-reviewed reporting mechanisms. (Emphasis in original.)
ARGUMENTS IN OPPOSITION: In opposition to the bill, TechNet, California Chamber of Commerce, and Computer & Communications Industry Association jointly write:
Audit Frequency Is Excessive and Unjustified, and Publication of Audit Results Could Undermine Safety
Requiring twice-yearly independent audits places an extreme burden on providers, especially given the serious compliance incentives already in place through enforcement risk. The requirement is disproportionate to any demonstrated need and far exceeds norms in comparable regulatory contexts.
Furthermore, there is genuine concern about the availability of properly qualified third-party auditors for this type of specialized content moderation review. Rushing to impose rigid audit requirements without ensuring adequate capacity will result in inconsistent quality and unnecessary expense.
Publishing audit outcomes does not materially improve compliance or enforcement and would undermine such efforts. Requiring audits to be publicly disclosed could inadvertently aid malicious actors, including those seeking to exploit platform systems to distribute CSAM. Companies constantly redesign and engineer their systems to prevent sophisticated, bad actors from abusing their users and platforms. These bad actors use publicly available information to help identify weak points in systems as well as understand how platforms are deploying resources and targeting enforcement of their policies. An increase in publicly available information about these systems will unintentionally give these actors a boost in their efforts. We strongly object to the bill’s requirement making these audits public. The existing transparency reporting requirements can serve enforcement and public accountability without compromising the integrity of internal safeguards.
Enforcement Focus Should Be Proportional
We support Attorney General enforcement and agree that it is a more appropriate mechanism than a private right of action. However, enforcement should target intentional or material noncompliance, with penalties scaled according to the severity of the violation. A balanced approach would protect users without overburdening responsible providers.
Premature and Unclear Justification
AB 1137 proposes significant changes to a law that only went into effect on January 1, 2025. With no demonstrated enforcement history or evidence of widespread noncompliance, it is unclear what specific problem this bill is intended to solve.
Our members are deeply committed to protecting children online. Every day, they work to strengthen systems and processes that detect and remove child sexual abuse material (CSAM). Considering that the existing statute only took effect on January 1 of this year, we believe it’s too soon to conclude what is or isn’t working. Rather than rushing to amend it, we would welcome an open conversation about early implementation challenges and how we can collaborate to strengthen what’s already in place. We all share the same goal—keeping children safe—and we believe thoughtful, data-driven policymaking is the best path forward.
REGISTERED SUPPORT / OPPOSITION:
Support
3strands Global Foundation (co-sponsor)
Childrens Advocacy Institute (co-sponsor)
California Catholic Conference
California Initiative for Technology & Democracy, a Project of California Common CAUSE
Jewish Family and Children's Services of San Francisco, the Peninsula, Marin and Sonoma Counties
National Center for Missing & Exploited Children
National Center on Sexual Exploitation (NCOSE)
Opposition
California Chamber of Commerce
Computer & Communications Industry Association
TechNet-Technology Network
Analysis Prepared by: Shiran Zohar / JUD. / (916) 319-2334
Date of Hearing: April 22, 2025
Fiscal:
ASSEMBLY COMMITTEE ON PRIVACY AND CONSUMER PROTECTION
Rebecca Bauer-Kahan, Chair
ABPCA Bill Id:AB 1137 (
Author:Krell) – As Amended Ver:April 21, 2025
SUBJECT: Reporting mechanism: child sexual abuse material
SYNOPSIS
Child sexual abuse material, commonly referred to under the acronym “CSAM,” is tragically pervasive on the internet—and not only in its illicit corners, on the so-called “dark web,” but also on popular social media websites and applications that billions of people use each day. This tragedy is compounded by the fact that certain websites and applications are not only a convenient means for sharing CSAM, but arguably induce its production.
AB 1394 (Wicks, Flora; Stats. 2023, Ch. 579) requires social media platforms to provide a mechanism for users to report CSAM in which they are depicted, and subjects platforms to liability if they fail to comply with these requirements or knowingly facilitate, aid, or abet commercial sexual exploitation. The bill also includes a safe harbor for platforms that opt to undertake biannual audits sent to the platform’s Board of Directors.
This bill updates and strengthens AB 1394 by, among other things, enabling any user to report CSAM, granting public prosecutors enhanced civil enforcement authority to hold accountable platforms that fail to maintain a properly functioning reporting mechanism, and requiring the aforementioned audits to be conducted by independent third-party auditors and made public, with redactions for trade secrets.
The bill is sponsored by the Children’s Advocacy Institute at the University of San Diego School of Law and National Center on Sexual Exploitation, and is supported by the California Initiative for Technology & Democracy (CITED), Jewish Family and Children’s Services in the in the Bay Area, and the National Center for Missing & Exploited Children.
The bill is opposed by TechNet, California Chamber of Commerce, and Computer & Communications Industry Association.
If passed by this Committee, this bill will next be heard by the Judiciary Committee.
THIS BILL:
- Requires CSAM reporting mechanisms on social media platforms to be clear and conspicuous.
- Expands the scope of users who may report CSAM to a social media platform by no longer limiting such users to identifiable minors, thereby enabling any user to submit such reports.
- Requires platforms to ensure CSAM reports receive a review by a natural person if the material does not match a hash value for known CSAM and will not otherwise be blocked.
- Enables public prosecutors to bring a civil action against a social media company for each day the mechanism is unavailable or nonfunctional. The public prosecutor may seek up to $250,000 for each day in which the company is noncompliant, as well as reasonable attorney’s fees and costs. Deems a mechanism unavailable or nonfunctional if the mechanism is inaccessible or otherwise not compliant with existing requirements governing the mechanism. Enables the Attorney General to seek injunctive relief to compel a social media company to immediately restore and maintain a fully functional reporting mechanism.
- Limits private standing to sue social media companies for failure to properly implement the CSAM reporting mechanism to depicted individuals who are reporting users, rather than reporting users generally. Enables depicted individuals who are not reporting users to obtain relief for a platform’s failure to block the material depicting the individual.
- With respect to an existing provision that shields social media platforms from liability for knowing facilitation, aiding, or abetting of commercial sexual exploitation if they conduct biannual audits, requires that such audits be conducted by independent third-party auditors with proven experience in trust and safety and content moderation. The audit must be made public within 90 days of completion, and may be redacted for trade secrets.
- Clarifies that definition of “facilitate, aid, or abet” applies to commercial sexual exploitation of minors, rather than minor users.
- Contains a severability clause.
EXISTING LAW:
- Requires online electronic service providers in the United States to report to the CyberTipline operated by the National Center for Missing & Exploited Children if they become aware of apparent CSAM on their platform. (18 U.S.C. § 2258A.)
- Defines, among other terms:
- “Child abuse material” to include child pornography or obscene matter depicting a minor personally engaging in or personally simulating sexual conduct. Incorporates definitions from existing law, including:
- “Child pornography,” which means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where any of the following apply:
- The production of such visual depiction involves the use of a minor engaging in sexually explicit conduct.
- Such visual depiction is a digital image, computer image, or computer-generated image that is, or is indistinguishable from, that of a minor engaging in sexually explicit conduct.
- Such visual depiction has been created, adapted, or modified to appear that an identifiable minor is engaging in sexually explicit conduct. (18 U.S.C. § 2256(8).)
- “Minor,” which means a person under the age of 18 years. (Id. at (1).).
- “Obscene matter,” which means matter, taken as a whole, that to the average person, applying contemporary statewide standards, appeals to the prurient interest, that, taken as a whole, depicts or describes sexual conduct in a patently offensive way, and that, taken as a whole, lacks serious literary, artistic, political, or scientific value. (Pen. Code § 311(a).)
- “Child pornography,” which means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where any of the following apply:
- “Clear and conspicuous” to mean larger type than the surrounding text, or in contrasting type, font, or color to the surrounding text of the same size, or set off from the surrounding text of the same size by symbols or other marks, in a manner that clearly calls attention to the language. (Bus. & Prof. Code § 17601.)
- “Social media company” as a person or entity that owns or operates one or more social media platforms. (Bus. & Prof. Code § 22675(e).)
- “Social media platform” as a public or semipublic internet-based service or application that has users in California and that meets both of the following criteria:
- A substantial function of the service or application is to connect users in order to allow users to interact socially with each other within the service or application. A service or application that provides email or direct messaging services shall not be considered to meet this criterion on the basis of that function alone.
- The service or application allows users to do all of the following:
- Construct a public or semipublic profile for purposes of signing into and using the service or application.
- Populate a list of other users with whom an individual shares a social connection within the system.
- Create or post content viewable by other users, including, but not limited to, on message boards, in chat rooms, or through a landing page or main feed that presents the user with content generated by other users. (Bus. & Prof. Code § 22675(f).)
- “Child abuse material” to include child pornography or obscene matter depicting a minor personally engaging in or personally simulating sexual conduct. Incorporates definitions from existing law, including:
- Requires a social media platform to do all of the following:
- Provide an accessible mechanism for California users to report material to the platform the user reasonably believes is CSAM that is displayed, stored, or hosted on the platform. (Civ. Code § 3273.66(a).)
- Collect information reasonably sufficient to enable the platform to contact the reporting user and contact the user in writing by a method chosen by the user that is not in control of the social media company that operates the platform. (Id. at (b), (c).)
- Permanently block the instance of reported material, and make reasonable efforts to remove and block other instances of the same material, from being viewable on the platform if there is a reasonable basis to believe it is CSAM; it is stored displayed, hosted on the platform; and the report contains basic identifying information sufficient to permit the platform to locate the reported material. (Id. at (d).)
- Provide a written confirmation regarding receipt of the report within 36 hours of the report with a description of the schedule of regular written updates that the platform is required to make. (Id. at (e).)
- Provide a written update to the reporting user as to the status of the platform’s handling of the reported material using the information collected from the reporting user, as described above. (Id. at (f).)
- Issue a final written determination to the reporting use stating whether the material has been determined to be CSAM displayed, stored, or hosted on the social media platform. (Id. at (g).)
- Comply with the requirements described above within 30 days unless there are circumstances beyond the reasonable control of the platform, which case compliance must be within 60 days but notice of the delay must be provided to the reporting user within 48 hours of the time the platform knew the delay was likely to occur. (Id. at (h).)
- Makes a social media platform that fails to comply with the requirements described above liable to a reporting user for actual damages sustained by the reporting user as a result of the violation, statutory damages of no more than $250,000, as specified, costs of the action, and any other relief the court deems proper. (Civ. Code § 3273.67(a).)
- Establishes a rebuttable presumption that the social media company is liable for statutory damages if it fails to comply with the reporting and blocking provisions described above within 60 days of the date on which the material was first reported. (Id. at (b).)
- Prohibits a social media platform from knowingly facilitating, aiding, or abetting commercial sexual exploitation of a minor or nonminor dependent. Deems a platform to have knowledge if CSAM is reported on its platform for four consecutive months, and provides the platform is facilitating, aiding, or abetting if its features are a substantial factor in causing minor users to be victims of commercial sexual exploitation. Imposes statutory damages of between $1,000,000 and $4,000,000 for violations. Provides that a platform is not subject to this liability if it institutes a program of at least biannual audits of its designs, algorithms, practices, affordances, or features that have the potential to result in violations; takes action within 30 days of completion of a an audit designed to mitigate or eliminate foreseeable risk of violations; and provides the platform’s board of directors with the audits within 90 days of completion of the mitigations. (Civ. Code § 3345.1(g).)
COMMENTS:
1) Author’s statement. According to the author:
Social media has become one of the preferred avenues for predators to solicit, market, and share child sexual abuse material (CSAM). In 2023 alone, Facebook and Instagram each reported more than 10,000,000 instances of CSAM, as noted in the CyberTipline Reports by Electronic Services Providers. Behind the reports are images of kids who have been sexually abused. The most frequently traded CSAM depicts children aged 9-12 years old. In graphic and brutal pictures and videos, the violation of a child is on display for the world to see. For the child, it serves as a permanent reminder of their trauma and humiliation.
AB 1137 strengthens the existing tool to report child sexual abuse material on social media platforms by allowing anyone to report CSAM (not just the victim depicted), requiring reports to be reviewed by a natural person, and empowering victims to take legal action. This bill further compels social media platforms to have more transparency by requiring the reporting mechanism to be clear and conspicuous.
Existing law allows social media companies to be protected from liability for commercial sexual exploitation if they conduct a biannual audit aimed at identifying designs and features contributing to its spread. To improve transparency and accountability, this bill would instead require that audit to be performed by a third-party and made public.
2) Background. Child sexual abuse material, commonly referred to under the acronym “CSAM,” is tragically pervasive on the internet. Roughly 500 CSAM files are traded online every minute.[1] From 2013 to 2023, the number of CyberTipline reports received by the National Center for Missing & Exploited Children (NCMEC), a federally-chartered nonprofit, skyrocketed from 500,000 to over 36 million.[2] The scourge of CSAM exists not only in the illicit corners of the internet, on the so-called “dark web,” but also on popular social media websites and applications that billions of people use every day. Last year, Discord, TikTok, and the platform formerly known as Twitter submitted hundreds of thousands of reports; Google reported nearly 1.6 million; and Meta – the parent company of Facebook, Instagram, and WhatsApp – submitted more than 30.5 million reports across those platforms.[3]
This tragedy is compounded by the fact that certain websites and applications are not only a convenient means for sharing CSAM, but arguably induce its production. For example, “[a] Forbes review of hundreds of recent TikTok livestreams reveals how viewers regularly use the comments to urge young girls to perform acts that appear to toe the line of child pornography—rewarding those who oblige with TikTok gifts, which can be redeemed for money, or off-platform payments to Venmo, PayPal or Cash App accounts that users list in their TikTok profiles.”[4]
Under federal law, online electronic service providers (ESPs) in the United States must report to the CyberTipline operated by NCMEC if they become aware of apparent CSAM on their platform. Using the geolocation provided by the ESPs, NCMEC reviews and refers the reports to relevant law enforcement agencies.[5] However, NCMEC reports that in 2023 it “continued to see inconsistencies in reporting from electronic service providers and tech companies regarding exploitation on their platforms. The majority of companies did not report at all, and many reports did not include the necessary details for NCMEC or law enforcement to take action.”[6]
ESPs may, but are not required to, use NCMEC’s Take It Down tool, which is funded by Meta. The tool “works by assigning a unique digital fingerprint, called a hash value, to nude, partially nude, or sexually explicit images or videos of people under the age of 18. Online platforms can use hash values to detect these images or videos on their services and remove this content.”[7] Once a hash is generated, social media platforms can use it to not only remove existing copies of the CSAM, but also rapidly compare image and video files that users attempt to upload for a match, analogous to the process that they use to scan incoming files for computer viruses.
In support of the bill, NCMEC writes:
In NCMEC’s experience CSAM often recirculates on the Internet long after a child’s initial physical abuse. This causes severe harm, psychological impact, and physical safety concerns for child victims, and adult survivors of these crimes, as offenders redistribute sexually exploitative material and track, harass, and share personal information relating to child victims. For many victims, one of their primary goals is to ensure that CSAM images and videos in which they are depicted are removed from the Internet as quickly as possible and stop circulating online. While NCMEC operates a notice and takedown program to notify online platforms when we receive a report of apparent CSAM, our notices do not have the force of law, and most platforms take days to remove content or do not respond at all to NCMEC’s notices.
Artificial intelligence can exacerbate and mitigate the proliferation of CSAM. As numerous state Attorneys General – California’s Rob Bonta included – have recently written, the urgency and ubiquity of these problems are increasing due to the widespread availability of generative AI, which can be used to create sexual deepfakes.[8] On the other hand, some platforms, such as Google and Meta, are using machine learning algorithms to identify potentially harmful content more efficiently.[9]
3) AB 1394. To ensure social media platform accountability when users report CSAM, AB 1394, which became operative January 1, 2025, requires platforms to establish a mechanism for underage users to report suspected CSAM they are depicted in and requires the platforms to permanently block CSAM and update the user who reported the violation throughout the process, which generally must be completed within 30 days of the report. Platforms that violate these provisions are subject to civil liability, including actual damages to the reporting user and statutory damages of up to $250,000 per violation.
AB 1394 also prohibits social media platforms from knowingly facilitating, aiding, or abetting commercial sexual exploitation of minors. “Facilitate, aid, or abet” means to deploy a system, design, feature, or affordance that is a substantial factor in causing minor users to be victims of commercial sexual exploitation. Each violation subjects the platform to statutory damages of up to $4,000,000 but no less than $1,000,000. The bill delineates circumstances in which a platform is deemed to have knowledge and provides a safe harbor from this liability where the platform has undertaken biannual audits and corrected its designs, algorithms, practices, affordances, and features that post a risk of a violation, as specified.
4) What this bill would do. This bill updates and strengthens AB 1394 by:
- Requiring the reporting mechanism to be clear and conspicuous.
- Enabling any user to submit reports of CSAM. Current law limits reporting users to victims, restricting the reach of AB 1394. Just as anyone can report child abuse offline, it makes sense to ensure any user of the platform can report CSAM.
- Requiring platforms to ensure CSAM reports receive a review by a natural person if the material does not match a hash value for known CSAM and will not otherwise be blocked.
- Enabling public prosecutors to bring a civil action against a social media company for each day the mechanism is unavailable or nonfunctional. The public prosecutor may seek a civil penalty of up to $250,000 per day and reasonable attorney’s fees and costs. Additionally, the AG may seek injunctive relief to compel a social media company to restore and maintain a fully functional reporting mechanism. This ensures that accountability for properly implementing a mechanism does not fall on the shoulders of those depicted in CSAM. Granting enforcement to public prosecutors only is intended to assuage concerns about excessive litigation.
- Enabling a depicted individual who is not a reporting user to obtain relief for a platform’s failure to block content containing the individual. An individual’s status as the reporter of the CSAM is immaterial to the harm they may suffer as a result of a platform’s failure to block the CSAM.
- With respect to the existing provision that shields social media platforms from liability for knowing facilitation of commercial sexual exploitation if they conduct biannual audits, the bill requires that such audits must be conducted by independent third-party auditors and made public within 90 days of completion, but allows for trade secret redactions. Proponents argue that if social media companies are to be provided a safe harbor, transparency is a fair trade-off.
In support of the bill, NCMEC writes:
AB 1137 will expand access to justice for child victims and clarify the obligations of social media platforms to remove CSAM they are displaying, storing, or hosting. The bill will require social media platforms to conduct a human review of reported material if there is no hash match to a known CSAM image. This will ensure that material reported by child victims is thoroughly reviewed and actioned by the platform and that platforms are fully engaged in the reporting process.
The bill also will enhance accountability and transparency requirements for social media platforms by requiring that an experienced subject matter expert audit their designs, algorithms, and features and that these audit reports be made available not only to the platform’s Board of Directors, but also to the public. NCMEC applauds AB 1137’s requirement that platforms utilize an expert with experience in trust and safety and content moderation issues to ensure that the audit is substantive and focuses on relevant aspects of technology and offender behavior online.
Crucially, AB 1137 will empower the California Attorney General and state and local prosecutors to protect child victims in California by enabling civil actions and actions for injunctive relief against social media platforms that fail to comply with their requirements to establish and maintain a reporting mechanism for victims. It is essential that State Attorney Generals have the authority to use their expansive resources to act against entities when their most vulnerable citizens are harmed.
5) Appears to align with federal law. Section 230(c)(1) of the federal Communications Decency Act of 1996 shields online platforms from liability for third-party content: “No provider or user of an interactive computer service shall be treated as the publisher or speaker of any information provided by another information content provider.”[10] This provision has been hailed as the law that created the modern internet, fostering free expression online and allowing an array of innovative services and spaces to flourish, from search engines to social media.[11] It has also come with a destructive side, absolving platforms of responsibility for virtually all third-party harms arising from the use of their services – “a protection not available to print material or television broadcasts.”[12]
Section 230 was intended to promote investment in online companies and encourage “‘Good Samaritan’ blocking and screening of offensive material” [13] without fear of liability for defamation.[14] Courts soon adopted an expansive interpretation – a key early decision construed “publisher” immunity as encompassing “traditional editorial functions” such as deciding whether to publish, remove, or even alter content.[15] Consequently, the plaintiff, a victim of online defamation by an anonymous user, had no recourse against the platform despite its failure to timely remove the content, which would have resulted in liability in the offline world. Following this logic, courts have extended Section 230 well beyond the defamation context, routinely concluding that online intermediaries are not liable for harms related to third-party illicit content.[16] “The common thread weaving through these cases is that the courts have sapped §230’s Good Samaritan concept of its meaning.”[17]
This sweeping grant of immunity has been the subject of widespread criticism and calls for reform.[18] Senators Lindsey Graham and Dick Durbin are planning to introduce a bill that would sunset Section 230.[19] Justice Clarence Thomas has called for the Supreme Court to review the scope of Section 230.[20] Ninth Circuit Judge Ryan Nelson recently stated that courts have “stretch[ed] the statute’s plain meaning beyond recognition,” leading to “perverse effects.”[21] The Ninth Circuit “should revisit our precedent,” he urged, particularly in light of “artificial intelligence raising the specter of lawless and limitless protections.”[22]
Section 230 has been amended once since it was adopted, following on the heels of the Backpage.com scandals. Using Section 230, Backpage was able to shield itself from several lawsuits brought by young sex trafficking victims.[23] Backpage wasn’t simply a passive conduit for the sexual exploitation of minors; it helped traffickers avoid restrictions on sex ads with minors. A Senate investigation revealed that “Backpage regularly edited ads to remove keywords that would identify them as objectionable or illegal, rather than removing them outright—so ads with words like ‘teenage,’ ‘rape,’ and ‘little girl,’ would still be published, just with those words removed.”[24] This led Congress to adopt an exemption to Section 230 for knowing facilitation of sex trafficking.[25]
AB 1394 was specifically amended in the Senate Judiciary Committee to track this exemption. This bill maintains those provisions and appears to continue to be compatible with Section 230.
ARGUMENTS IN SUPPORT: The Children’s Advocacy Institute at the University of San Diego School of Law, a co-sponsor of the bill, writes:
Given a full year to comply with California’s landmark AB 1394 (Wicks and Flora) and notwithstanding soaring profits, social media platforms have apparently done nothing or next to nothing to comply with that law, one compassionately aimed at protecting sexually brutalized and exploited children.
AB 1394 was prompted by the well-documented role social media platforms play in helpfully and indispensably ensuring (i) that images and videos of child rape and sex abuse (CSAM) randomly uploaded by third-party criminals are efficiently delivered to eager pedophiles even when they don’t search for it and (ii) that criminal sex traffickers who profit from child rape are efficiently and inexpensively matched with pedophile customers.
Also, since AB 1394’s enactment, the astonishing growth in the power and sophistication of AI means all this will soon get worse, fast. For these reasons, AB 1137 surgically makes current law stronger in the hope the platforms will do more to prevent child sex abuse and trafficking.
The National Center on Sexual Exploitation, co-sponsors of the bill, write:
This legislation represents a critical step in preventing the further spread of CSAM and protecting children from sexual exploitation online. The harms of CSAM cannot be overstated. Survivors suffer long-lasting trauma, and every time an image is shared, it compounds that harm—creating a perpetual cycle of revictimization. Online platforms, as primary vehicles for sharing this material, have a responsibility to act swiftly and decisively to remove it and assist in the identification of perpetrators.
Research supports the need for vigilance and proactive measures. The Butner Study, a landmark longitudinal study conducted by the Federal Bureau of Prisons, found that over 85% of men convicted of offenses involving CSAM had also committed contact sexual offenses against children, even if they had not been previously charged. This finding dismantles the myth that CSAM offenders are not hands-on offenders, and highlights the very real risk they pose to children offline as well. Additionally, the National Center for Missing and Exploited Children (NCMEC) received over 36 million reports to its CyberTipline in 2023 alone—many involving material circulating on mainstream platforms. These numbers demonstrate the scale of the problem and the urgent need for platforms to implement effective, human-reviewed reporting mechanisms. (Emphasis in original.)
ARGUMENTS IN OPPOSITION: In opposition to the bill, TechNet, California Chamber of Commerce, and Communications Industry Association jointly write:
Audit Frequency Is Excessive and Unjustified, and Publication of Audit Results Could Undermine Safety
Requiring twice-yearly independent audits places an extreme burden on providers, especially given the serious compliance incentives already in place through enforcement risk. The requirement is disproportionate to any demonstrated need and far exceeds norms in comparable regulatory contexts.
Furthermore, there is genuine concern about the availability of properly qualified third-party auditors for this type of specialized content moderation review. Rushing to impose rigid audit requirements without ensuring adequate capacity will result in inconsistent quality and unnecessary expense.
Publishing audit outcomes does not materially improve compliance or enforcement and would undermine such efforts. Requiring audits to be publicly disclosed could inadvertently aid malicious actors, including those seeking to exploit platform systems to distribute CSAM. Companies constantly redesign and engineer their systems to prevent sophisticated, bad actors from abusing their users and platforms. These bad actors use publicly available information to help identify weak points in systems as well as understand how platforms are deploying resources and targeting enforcement of their policies. An increase in publicly available information about these systems will unintentionally give these actors a boost in their efforts. We strongly object to the bill’s requirement making these audits public. The existing transparency reporting requirements can serve enforcement and public accountability without compromising the integrity of internal safeguards.
Enforcement Focus Should Be Proportional
We support Attorney General enforcement and agree that it is a more appropriate mechanism than a private right of action. However, enforcement should target intentional or material noncompliance, with penalties scaled according to the severity of the violation. A balanced approach would protect users without overburdening responsible providers.
Premature and Unclear Justification
AB 1137 proposes significant changes to a law that only went into effect on January 1, 2025. With no demonstrated enforcement history or evidence of widespread noncompliance, it is unclear what specific problem this bill is intended to solve.
Our members are deeply committed to protecting children online. Every day, they work to strengthen systems and processes that detect and remove child sexual abuse material (CSAM). Considering that the existing statute only took effect on January 1 of this year, we believe it’s too soon to conclude what is or isn’t working. Rather than rushing to amend it, we would welcome an open conversation about early implementation challenges and how we can collaborate to strengthen what’s already in place. We all share the same goal—keeping children safe—and we believe thoughtful, data-driven policymaking is the best path forward.
REGISTERED SUPPORT / OPPOSITION:
Support
3strands Global Foundation (Co-Sponsor)
Childrens Advocacy Institute (Co-Sponsor)
California Initiative for Technology & Democracy, a Project of California Common CAUSE
Jewish Family and Children's Services of San Francisco, the Peninsula, Marin and Sonoma Counties
National Center for Missing & Exploited Children
National Center on Sexual Exploitation (NCOSE)
Opposition
California Chamber of Commerce
Computer & Communications Industry Association
Technet-technology Network
Analysis Prepared by: Josh Tosney / P. & C.P. / (916) 319-2200
Jessica McGarvie, “From Hashtag to Hash Value: Using the Hash Value Model to Report Child Sex Abuse Material,” 13 Seattle Journal of Environmental Law (2023) 1, 1. ↑
CyberTipline 2023 Report, https://www.missingkids.org/gethelpnow/cybertipline/cybertiplinedata. ↑
https://www.missingkids.org/content/dam/missingkids/pdfs/2023-reports-by-esp.pdf ↑
Levine, “How TikTok Live Became ‘A Strip Club Filled With 15-Year-Olds,’” Forbes (Apr. 27, 2022), https://www.forbes.com/sites/alexandralevine/2022/04/27/how-tiktok-live-became-a-strip-club-filled-with-15-year-olds/. For more examples, see e.g. Asia Grace, “‘So f-ked up’: Instagram slammed for allowing paid content featuring kids in bikinis,” New York Post (Nov. 2, 2022), https://nypost.com/2022/11/02/instagram-slammed-for-paid-content-featuring-kids-in-bikinis; Jeff Horwitz and Katherine Blunt, “Instagram Connects Vast Pedophile Network,” The Wall Street Journal (Jun. 7, 2023), https://www.wsj.com/articles/instagram-vast-pedophile-network-4ab7189; Jennifer Valentino-DeVries and Michael H. Keller, “She Was a Child Instagram Influencer. Her Fans Were Grown Men,” The New York Times (Nov. 10, 2024), https://www.nytimes.com/2024/11/10/us/child-influencer.html. ↑
Paul Bischoff, “The rising tide of child abuse content on social media” Comparitech (Jul. 9, 2024) https://www.comparitech.com/blog/vpn-privacy/child-abuse-online-statistics/. ↑
NCMEC 2023 CyberTipline Report (2024), p.3 https://www.missingkids.org/content/dam/missingkids/pdfs/2023-CyberTipline-Report.pdf. ↑
NCMEC: Take It Down, available at https://takeitdown.ncmec.org/. ↑
“Artificial Intelligence and the Exploitation of Children,” National Association of Attorneys General (Sept. 5, 2023), https://ncdoj.gov/wp-content/uploads/2023/09/54-State-AGs-Urge-Study-of-AI-and-Harmful-Impacts-on-Children.pdf. ↑
Paul Bischoff, “The rising tide of child abuse content on social media” Comparitech (Jul. 9, 2024) https://www.comparitech.com/blog/vpn-privacy/child-abuse-online-statistics/. ↑
42 U.S.C. § 230(c)(1). Section 230 also (1) provides a safe harbor for good faith content moderation, (2) preempts contrary state laws, and (3) enumerates exemptions for enforcement of federal criminal statutes, intellectual property laws, communications privacy laws, and sex trafficking. ↑
See e.g., Kosseff, The Twenty-Six Words that Created the Internet (2019). ↑
Quinta Jurecic, “The politics of Section 230 reform: Learning from FOSTA’s mistakes” Brookings (Mar. 1, 2022), https://www.brookings.edu/articles/the-politics-of-section-230-reform-learning-from-fostas-mistakes. ↑
§ 230(c). ↑
Fair Hous. Council v. Roommates.com, LLC (9th Cir. 2008) 521 F.3d 1157, 1163. ↑
Zeran v. Am. Online, Inc (4th Cir. 1997) 129 F.3d 327. ↑
Michael Rustad & Thomas Koenig, “The Case for a CDA Section 230 Notice-and-Takedown Duty” (2023) 23 Nev.L.J. 533, 561-574. ↑
Danielle Keats Citron, “How to Fix Section 230” (2023) 103 B.U.L. Rev. 713, 727. ↑
E.g., John Lucas, “AG Moody Joins with Other Attorneys General to Urge Congress to Stop Protecting Illegal Activity on the Net,” Capitolist (May 23, 2019), https://thecapitolist.com/ag-moody-joins-with-other-attorneys-general-to-urge-congress-to-stop-protecting-illegal-activity-on-the-net. ↑
Lauren Feiner, “Lawmakers are tyring to repeal section 230 again” The Verge (Mar. 21, 2025), https://www.msn.com/en-us/politics/government/lawmakers-are-trying-to-repeal-section-230-again/ar-AA1BptAI?ocid=BingNewsVerp. ↑
Doe ex rel. Roe v. Snap, Inc. (2024) 144 S. Ct. 2493 (Thomas, J., dissenting from denial of certiorari). ↑
Calise v. Meta Platforms, Inc. (9th Cir. 2024) 103 F.4th 732, 747 (Nelson, J. concurring) (Calise). ↑
Ibid. ↑
See e.g. M.A. v. Vill. Voice Media Holdings (E.D.Mo. 2011) 809 F.Supp.2d 1041. ↑
Quinta Jurecic, “The politics of Section 230 reform: Learning from FOSTA’s mistakes (Mar. 1, 2022) Brookings, https://www.brookings.edu/articles/the-politics-of-section-230-reform-learning-from-fostas-mistakes/. ↑
Stop Enabling Sex Traffickers Act and the Allow States to Fight Online Sex Trafficking Act (SESTA/FOSTA) legislation package. (See P.L. 115-164, 113 Stat. 1253.) ↑
Date of Hearing: April 22, 2025
Fiscal: Yes
ASSEMBLY COMMITTEE ON PRIVACY AND CONSUMER PROTECTION
Rebecca Bauer-Kahan, Chair
ABPCA Bill Id:AB 1137 (
Author:Krell) – As Amended Ver:April 10, 2025
SUBJECT: Reporting mechanism: child sexual abuse material
SYNOPSIS
Child sexual abuse material, commonly referred to under the acronym “CSAM,” is tragically pervasive on the internet—and not only in its illicit corners, on the so-called “dark web,” but also on popular social media websites and applications that billions of people use each day. This tragedy is compounded by the fact that certain websites and applications are not only a convenient means for sharing CSAM, but arguably induce its production.
AB 1394 (Wicks, Flora; Stats. 2023, Ch. 579) requires social media platforms to provide a mechanism for users to report CSAM in which they are depicted, and subjects platforms to liability if they fail to comply with these requirements or knowingly facilitate, aid, or abet commercial sexual exploitation. The bill also includes a safe harbor for platforms that opt to undertake biannual audits sent to the platform’s Board of Directors.
This bill updates and strengthens AB 1394 by, among other things, enabling any user to report CSAM, granting public prosecutors enhanced civil enforcement authority to hold accountable platforms that fail to maintain a properly functioning reporting mechanism, and requiring the aforementioned audits to be conducted by independent third-party auditors and made public, with redactions for trade secrets.
The bill is sponsored by the Children’s Advocacy Institute at the University of San Diego School of Law and National Center on Sexual Exploitation, and is supported by the California Initiative for Technology & Democracy (CITED), Jewish Family and Children’s Services in the in the Bay Area, and the National Center for Missing & Exploited Children.
The bill is opposed by TechNet, California Chamber of Commerce, and Computer & Communications Industry Association.
If passed by this Committee, this bill will next be heard by the Judiciary Committee.
THIS BILL:
- Requires CSAM reporting mechanisms on social media platforms to be clear and conspicuous.
- Expands the scope of users who may report CSAM to a social media platform by no longer limiting such users to identifiable minors, thereby enabling any user to submit such reports.
- Requires platforms to ensure CSAM reports receive a review by a natural person if the material does not match a hash value for known CSAM and will not otherwise be blocked.
- Enables public prosecutors to bring a civil action against a social media company for each day the mechanism is unavailable or nonfunctional. The public prosecutor may seek up to $250,000 for each day in which the company is noncompliant, as well as reasonable attorney’s fees and costs. Deems a mechanism unavailable or nonfunctional if the mechanism is inaccessible or otherwise not compliant with existing requirements governing the mechanism. Enables the Attorney General to seek injunctive relief to compel a social media company to immediately restore and maintain a fully functional reporting mechanism.
- Limits private standing to sue social media companies for failure to properly implement the CSAM reporting mechanism to depicted individuals who are reporting users, rather than reporting users generally. Enables depicted individuals who are not reporting users to obtain relief for a platform’s failure to block the material depicting the individual.
- With respect to an existing provision that shields social media platforms from liability for knowing facilitation, aiding, or abetting of commercial sexual exploitation if they conduct biannual audits, requires that such audits be conducted by independent third-party auditors with proven experience in trust and safety and content moderation. The audit must be made public within 90 days of completion, and may be redacted for trade secrets.
- Clarifies that definition of “facilitate, aid, or abet” applies to commercial sexual exploitation of minors, rather than minor users.
- Contains a severability clause.
EXISTING LAW:
- Requires online electronic service providers in the United States to report to the CyberTipline operated by the National Center for Missing & Exploited Children if they become aware of apparent CSAM on their platform. (18 U.S.C. § 2258A.)
- Defines, among other terms:
- “Child abuse material” to include child pornography or obscene matter depicting a minor personally engaging in or personally simulating sexual conduct. Incorporates definitions from existing law, including:
- “Child pornography,” which means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where any of the following apply:
- The production of such visual depiction involves the use of a minor engaging in sexually explicit conduct.
- Such visual depiction is a digital image, computer image, or computer-generated image that is, or is indistinguishable from, that of a minor engaging in sexually explicit conduct.
- Such visual depiction has been created, adapted, or modified to appear that an identifiable minor is engaging in sexually explicit conduct. (18 U.S.C. § 2256(8).)
- “Minor,” which means a person under the age of 18 years. (Id. at (1).).
- “Obscene matter,” which means matter, taken as a whole, that to the average person, applying contemporary statewide standards, appeals to the prurient interest, that, taken as a whole, depicts or describes sexual conduct in a patently offensive way, and that, taken as a whole, lacks serious literary, artistic, political, or scientific value. (Pen. Code § 311(a).)
- “Child pornography,” which means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where any of the following apply:
- “Clear and conspicuous” to mean larger type than the surrounding text, or in contrasting type, font, or color to the surrounding text of the same size, or set off from the surrounding text of the same size by symbols or other marks, in a manner that clearly calls attention to the language. (Bus. & Prof. Code § 17601.)
- “Social media company” as a person or entity that owns or operates one or more social media platforms. (Bus. & Prof. Code § 22675(e).)
- “Social media platform” as a public or semipublic internet-based service or application that has users in California and that meets both of the following criteria:
- A substantial function of the service or application is to connect users in order to allow users to interact socially with each other within the service or application. A service or application that provides email or direct messaging services shall not be considered to meet this criterion on the basis of that function alone.
- The service or application allows users to do all of the following:
- Construct a public or semipublic profile for purposes of signing into and using the service or application.
- Populate a list of other users with whom an individual shares a social connection within the system.
- Create or post content viewable by other users, including, but not limited to, on message boards, in chat rooms, or through a landing page or main feed that presents the user with content generated by other users. (Bus. & Prof. Code § 22675(f).)
- “Child abuse material” to include child pornography or obscene matter depicting a minor personally engaging in or personally simulating sexual conduct. Incorporates definitions from existing law, including:
- Requires a social media platform to do all of the following:
- Provide an accessible mechanism for California users to report material to the platform the user reasonably believes is CSAM that is displayed, stored, or hosted on the platform. (Civ. Code § 3273.66(a).)
- Collect information reasonably sufficient to enable the platform to contact the reporting user and contact the user in writing by a method chosen by the user that is not in control of the social media company that operates the platform. (Id. at (b), (c).)
- Permanently block the instance of reported material, and make reasonable efforts to remove and block other instances of the same material, from being viewable on the platform if there is a reasonable basis to believe it is CSAM; it is stored displayed, hosted on the platform; and the report contains basic identifying information sufficient to permit the platform to locate the reported material. (Id. at (d).)
- Provide a written confirmation regarding receipt of the report within 36 hours of the report with a description of the schedule of regular written updates that the platform is required to make. (Id. at (e).)
- Provide a written update to the reporting user as to the status of the platform’s handling of the reported material using the information collected from the reporting user, as described above. (Id. at (f).)
- Issue a final written determination to the reporting use stating whether the material has been determined to be CSAM displayed, stored, or hosted on the social media platform. (Id. at (g).)
- Comply with the requirements described above within 30 days unless there are circumstances beyond the reasonable control of the platform, which case compliance must be within 60 days but notice of the delay must be provided to the reporting user within 48 hours of the time the platform knew the delay was likely to occur. (Id. at (h).)
- Makes a social media platform that fails to comply with the requirements described above liable to a reporting user for actual damages sustained by the reporting user as a result of the violation, statutory damages of no more than $250,000, as specified, costs of the action, and any other relief the court deems proper. (Civ. Code § 3273.67(a).)
- Establishes a rebuttable presumption that the social media company is liable for statutory damages if it fails to comply with the reporting and blocking provisions described above within 60 days of the date on which the material was first reported. (Id. at (b).)
- Prohibits a social media platform from knowingly facilitating, aiding, or abetting commercial sexual exploitation of a minor or nonminor dependent. Deems a platform to have knowledge if CSAM is reported on its platform for four consecutive months, and provides the platform is facilitating, aiding, or abetting if its features are a substantial factor in causing minor users to be victims of commercial sexual exploitation. Imposes statutory damages of between $1,000,000 and $4,000,000 for violations. Provides that a platform is not subject to this liability if it institutes a program of at least biannual audits of its designs, algorithms, practices, affordances, or features that have the potential to result in violations; takes action within 30 days of completion of a an audit designed to mitigate or eliminate foreseeable risk of violations; and provides the platform’s board of directors with the audits within 90 days of completion of the mitigations. (Civ. Code § 3345.1(g).)
COMMENTS:
1) Author’s statement. According to the author:
Social media has become one of the preferred avenues for predators to solicit, market, and share child sexual abuse material (CSAM). In 2023 alone, Facebook and Instagram each reported more than 10,000,000 instances of CSAM, as noted in the CyberTipline Reports by Electronic Services Providers. Behind the reports are images of kids who have been sexually abused. The most frequently traded CSAM depicts children aged 9-12 years old. In graphic and brutal pictures and videos, the violation of a child is on display for the world to see. For the child, it serves as a permanent reminder of their trauma and humiliation.
AB 1137 strengthens the existing tool to report child sexual abuse material on social media platforms by allowing anyone to report CSAM (not just the victim depicted), requiring reports to be reviewed by a natural person, and empowering victims to take legal action. This bill further compels social media platforms to have more transparency by requiring the reporting mechanism to be clear and conspicuous.
Existing law allows social media companies to be protected from liability for commercial sexual exploitation if they conduct a biannual audit aimed at identifying designs and features contributing to its spread. To improve transparency and accountability, this bill would instead require that audit to be performed by a third-party and made public.
2) Background. Child sexual abuse material, commonly referred to under the acronym “CSAM,” is tragically pervasive on the internet. Roughly 500 CSAM files are traded online every minute.[1] From 2013 to 2023, the number of CyberTipline reports received by the National Center for Missing & Exploited Children (NCMEC), a federally-chartered nonprofit, skyrocketed from 500,000 to over 36 million.[2] The scourge of CSAM exists not only in the illicit corners of the internet, on the so-called “dark web,” but also on popular social media websites and applications that billions of people use every day. Last year, Discord, TikTok, and the platform formerly known as Twitter submitted hundreds of thousands of reports; Google reported nearly 1.6 million; and Meta – the parent company of Facebook, Instagram, and WhatsApp – submitted more than 30.5 million reports across those platforms.[3]
This tragedy is compounded by the fact that certain websites and applications are not only a convenient means for sharing CSAM, but arguably induce its production. For example, “[a] Forbes review of hundreds of recent TikTok livestreams reveals how viewers regularly use the comments to urge young girls to perform acts that appear to toe the line of child pornography—rewarding those who oblige with TikTok gifts, which can be redeemed for money, or off-platform payments to Venmo, PayPal or Cash App accounts that users list in their TikTok profiles.”[4]
Under federal law, online electronic service providers (ESPs) in the United States must report to the CyberTipline operated by NCMEC if they become aware of apparent CSAM on their platform. Using the geolocation provided by the ESPs, NCMEC reviews and refers the reports to relevant law enforcement agencies.[5] However, NCMEC reports that in 2023 it “continued to see inconsistencies in reporting from electronic service providers and tech companies regarding exploitation on their platforms. The majority of companies did not report at all, and many reports did not include the necessary details for NCMEC or law enforcement to take action.”[6]
ESPs may, but are not required to, use NCMEC’s Take It Down tool, which is funded by Meta. The tool “works by assigning a unique digital fingerprint, called a hash value, to nude, partially nude, or sexually explicit images or videos of people under the age of 18. Online platforms can use hash values to detect these images or videos on their services and remove this content.”[7] Once a hash is generated, social media platforms can use it to not only remove existing copies of the CSAM, but also rapidly compare image and video files that users attempt to upload for a match, analogous to the process that they use to scan incoming files for computer viruses.
In support of the bill, NCMEC writes:
In NCMEC’s experience CSAM often recirculates on the Internet long after a child’s initial physical abuse. This causes severe harm, psychological impact, and physical safety concerns for child victims, and adult survivors of these crimes, as offenders redistribute sexually exploitative material and track, harass, and share personal information relating to child victims. For many victims, one of their primary goals is to ensure that CSAM images and videos in which they are depicted are removed from the Internet as quickly as possible and stop circulating online. While NCMEC operates a notice and takedown program to notify online platforms when we receive a report of apparent CSAM, our notices do not have the force of law, and most platforms take days to remove content or do not respond at all to NCMEC’s notices.
Artificial intelligence can exacerbate and mitigate the proliferation of CSAM. As numerous state Attorneys General – California’s Rob Bonta included – have recently written, the urgency and ubiquity of these problems are increasing due to the widespread availability of generative AI, which can be used to create sexual deepfakes.[8] On the other hand, some platforms, such as Google and Meta, are using machine learning algorithms to identify potentially harmful content more efficiently.[9]
3) AB 1394. To ensure social media platform accountability when users report CSAM, AB 1394, which became operative January 1, 2025, requires platforms to establish a mechanism for underage users to report suspected CSAM they are depicted in and requires the platforms to permanently block CSAM and update the user who reported the violation throughout the process, which generally must be completed within 30 days of the report. Platforms that violate these provisions are subject to civil liability, including actual damages to the reporting user and statutory damages of up to $250,000 per violation.
AB 1394 also prohibits social media platforms from knowingly facilitating, aiding, or abetting commercial sexual exploitation of minors. “Facilitate, aid, or abet” means to deploy a system, design, feature, or affordance that is a substantial factor in causing minor users to be victims of commercial sexual exploitation. Each violation subjects the platform to statutory damages of up to $4,000,000 but no less than $1,000,000. The bill delineates circumstances in which a platform is deemed to have knowledge and provides a safe harbor from this liability where the platform has undertaken biannual audits and corrected its designs, algorithms, practices, affordances, and features that post a risk of a violation, as specified.
4) What this bill would do. This bill updates and strengthens AB 1394 by:
- Requiring the reporting mechanism to be clear and conspicuous.
- Enabling any user to submit reports of CSAM. Current law limits reporting users to victims, restricting the reach of AB 1394. Just as anyone can report child abuse offline, it makes sense to ensure any user of the platform can report CSAM.
- Requiring platforms to ensure CSAM reports receive a review by a natural person if the material does not match a hash value for known CSAM and will not otherwise be blocked.
- Enabling public prosecutors to bring a civil action against a social media company for each day the mechanism is unavailable or nonfunctional. The public prosecutor may seek a civil penalty of up to $250,000 per day and reasonable attorney’s fees and costs. Additionally, the AG may seek injunctive relief to compel a social media company to restore and maintain a fully functional reporting mechanism. This ensures that accountability for properly implementing a mechanism does not fall on the shoulders of those depicted in CSAM. Granting enforcement to public prosecutors only is intended to assuage concerns about excessive litigation.
- Enabling a depicted individual who is not a reporting user to obtain relief for a platform’s failure to block content containing the individual. An individual’s status as the reporter of the CSAM is immaterial to the harm they may suffer as a result of a platform’s failure to block the CSAM.
- With respect to the existing provision that shields social media platforms from liability for knowing facilitation of commercial sexual exploitation if they conduct biannual audits, the bill requires that such audits must be conducted by independent third-party auditors and made public within 90 days of completion, but allows for trade secret redactions. Proponents argue that if social media companies are to be provided a safe harbor, transparency is a fair trade-off.
In support of the bill, NCMEC writes:
AB 1137 will expand access to justice for child victims and clarify the obligations of social media platforms to remove CSAM they are displaying, storing, or hosting. The bill will require social media platforms to conduct a human review of reported material if there is no hash match to a known CSAM image. This will ensure that material reported by child victims is thoroughly reviewed and actioned by the platform and that platforms are fully engaged in the reporting process.
The bill also will enhance accountability and transparency requirements for social media platforms by requiring that an experienced subject matter expert audit their designs, algorithms, and features and that these audit reports be made available not only to the platform’s Board of Directors, but also to the public. NCMEC applauds AB 1137’s requirement that platforms utilize an expert with experience in trust and safety and content moderation issues to ensure that the audit is substantive and focuses on relevant aspects of technology and offender behavior online.
Crucially, AB 1137 will empower the California Attorney General and state and local prosecutors to protect child victims in California by enabling civil actions and actions for injunctive relief against social media platforms that fail to comply with their requirements to establish and maintain a reporting mechanism for victims. It is essential that State Attorney Generals have the authority to use their expansive resources to act against entities when their most vulnerable citizens are harmed.
5) Appears to align with federal law. Section 230(c)(1) of the federal Communications Decency Act of 1996 shields online platforms from liability for third-party content: “No provider or user of an interactive computer service shall be treated as the publisher or speaker of any information provided by another information content provider.”[10] This provision has been hailed as the law that created the modern internet, fostering free expression online and allowing an array of innovative services and spaces to flourish, from search engines to social media.[11] It has also come with a destructive side, absolving platforms of responsibility for virtually all third-party harms arising from the use of their services – “a protection not available to print material or television broadcasts.”[12]
Section 230 was intended to promote investment in online companies and encourage “‘Good Samaritan’ blocking and screening of offensive material” [13] without fear of liability for defamation.[14] Courts soon adopted an expansive interpretation – a key early decision construed “publisher” immunity as encompassing “traditional editorial functions” such as deciding whether to publish, remove, or even alter content.[15] Consequently, the plaintiff, a victim of online defamation by an anonymous user, had no recourse against the platform despite its failure to timely remove the content, which would have resulted in liability in the offline world. Following this logic, courts have extended Section 230 well beyond the defamation context, routinely concluding that online intermediaries are not liable for harms related to third-party illicit content.[16] “The common thread weaving through these cases is that the courts have sapped §230’s Good Samaritan concept of its meaning.”[17]
This sweeping grant of immunity has been the subject of widespread criticism and calls for reform.[18] Senators Lindsey Graham and Dick Durbin are planning to introduce a bill that would sunset Section 230.[19] Justice Clarence Thomas has called for the Supreme Court to review the scope of Section 230.[20] Ninth Circuit Judge Ryan Nelson recently stated that courts have “stretch[ed] the statute’s plain meaning beyond recognition,” leading to “perverse effects.”[21] The Ninth Circuit “should revisit our precedent,” he urged, particularly in light of “artificial intelligence raising the specter of lawless and limitless protections.”[22]
Section 230 has been amended once since it was adopted, following on the heels of the Backpage.com scandals. Using Section 230, Backpage was able to shield itself from several lawsuits brought by young sex trafficking victims.[23] Backpage wasn’t simply a passive conduit for the sexual exploitation of minors; it helped traffickers avoid restrictions on sex ads with minors. A Senate investigation revealed that “Backpage regularly edited ads to remove keywords that would identify them as objectionable or illegal, rather than removing them outright—so ads with words like ‘teenage,’ ‘rape,’ and ‘little girl,’ would still be published, just with those words removed.”[24] This led Congress to adopt an exemption to Section 230 for knowing facilitation of sex trafficking.[25]
AB 1394 was specifically amended in the Senate Judiciary Committee to track this exemption. This bill maintains those provisions and appears to continue to be compatible with Section 230.
ARGUMENTS IN SUPPORT: The Children’s Advocacy Institute at the University of San Diego School of Law, a co-sponsor of the bill, writes:
Given a full year to comply with California’s landmark AB 1394 (Wicks and Flora) and notwithstanding soaring profits, social media platforms have apparently done nothing or next to nothing to comply with that law, one compassionately aimed at protecting sexually brutalized and exploited children.
AB 1394 was prompted by the well-documented role social media platforms play in helpfully and indispensably ensuring (i) that images and videos of child rape and sex abuse (CSAM) randomly uploaded by third-party criminals are efficiently delivered to eager pedophiles even when they don’t search for it and (ii) that criminal sex traffickers who profit from child rape are efficiently and inexpensively matched with pedophile customers.
Also, since AB 1394’s enactment, the astonishing growth in the power and sophistication of AI means all this will soon get worse, fast. For these reasons, AB 1137 surgically makes current law stronger in the hope the platforms will do more to prevent child sex abuse and trafficking.
The National Center on Sexual Exploitation, co-sponsors of the bill, write:
This legislation represents a critical step in preventing the further spread of CSAM and protecting children from sexual exploitation online. The harms of CSAM cannot be overstated. Survivors suffer long-lasting trauma, and every time an image is shared, it compounds that harm—creating a perpetual cycle of revictimization. Online platforms, as primary vehicles for sharing this material, have a responsibility to act swiftly and decisively to remove it and assist in the identification of perpetrators.
Research supports the need for vigilance and proactive measures. The Butner Study, a landmark longitudinal study conducted by the Federal Bureau of Prisons, found that over 85% of men convicted of offenses involving CSAM had also committed contact sexual offenses against children, even if they had not been previously charged. This finding dismantles the myth that CSAM offenders are not hands-on offenders, and highlights the very real risk they pose to children offline as well. Additionally, the National Center for Missing and Exploited Children (NCMEC) received over 36 million reports to its CyberTipline in 2023 alone—many involving material circulating on mainstream platforms. These numbers demonstrate the scale of the problem and the urgent need for platforms to implement effective, human-reviewed reporting mechanisms. (Emphasis in original.)
ARGUMENTS IN OPPOSITION: In opposition to the bill, TechNet, California Chamber of Commerce, and Communications Industry Association jointly write:
Audit Frequency Is Excessive and Unjustified, and Publication of Audit Results Could Undermine Safety
Requiring twice-yearly independent audits places an extreme burden on providers, especially given the serious compliance incentives already in place through enforcement risk. The requirement is disproportionate to any demonstrated need and far exceeds norms in comparable regulatory contexts.
Furthermore, there is genuine concern about the availability of properly qualified third-party auditors for this type of specialized content moderation review. Rushing to impose rigid audit requirements without ensuring adequate capacity will result in inconsistent quality and unnecessary expense.
Publishing audit outcomes does not materially improve compliance or enforcement and would undermine such efforts. Requiring audits to be publicly disclosed could inadvertently aid malicious actors, including those seeking to exploit platform systems to distribute CSAM. Companies constantly redesign and engineer their systems to prevent sophisticated, bad actors from abusing their users and platforms. These bad actors use publicly available information to help identify weak points in systems as well as understand how platforms are deploying resources and targeting enforcement of their policies. An increase in publicly available information about these systems will unintentionally give these actors a boost in their efforts. We strongly object to the bill’s requirement making these audits public. The existing transparency reporting requirements can serve enforcement and public accountability without compromising the integrity of internal safeguards.
Enforcement Focus Should Be Proportional
We support Attorney General enforcement and agree that it is a more appropriate mechanism than a private right of action. However, enforcement should target intentional or material noncompliance, with penalties scaled according to the severity of the violation. A balanced approach would protect users without overburdening responsible providers.
Premature and Unclear Justification
AB 1137 proposes significant changes to a law that only went into effect on January 1, 2025. With no demonstrated enforcement history or evidence of widespread noncompliance, it is unclear what specific problem this bill is intended to solve.
Our members are deeply committed to protecting children online. Every day, they work to strengthen systems and processes that detect and remove child sexual abuse material (CSAM). Considering that the existing statute only took effect on January 1 of this year, we believe it’s too soon to conclude what is or isn’t working. Rather than rushing to amend it, we would welcome an open conversation about early implementation challenges and how we can collaborate to strengthen what’s already in place. We all share the same goal—keeping children safe—and we believe thoughtful, data-driven policymaking is the best path forward.
REGISTERED SUPPORT / OPPOSITION:
Support
3strands Global Foundation (Co-Sponsor)
Childrens Advocacy Institute (Co-Sponsor)
California Initiative for Technology & Democracy, a Project of California Common CAUSE
Jewish Family and Children's Services of San Francisco, the Peninsula, Marin and Sonoma Counties
National Center for Missing & Exploited Children
National Center on Sexual Exploitation (NCOSE)
Opposition
California Chamber of Commerce
Computer & Communications Industry Association
Technet-technology Network
Analysis Prepared by: Josh Tosney / P. & C.P. / (916) 319-2200
Jessica McGarvie, “From Hashtag to Hash Value: Using the Hash Value Model to Report Child Sex Abuse Material,” 13 Seattle Journal of Environmental Law (2023) 1, 1. ↑
CyberTipline 2023 Report, https://www.missingkids.org/gethelpnow/cybertipline/cybertiplinedata. ↑
https://www.missingkids.org/content/dam/missingkids/pdfs/2023-reports-by-esp.pdf ↑
Levine, “How TikTok Live Became ‘A Strip Club Filled With 15-Year-Olds,’” Forbes (Apr. 27, 2022), https://www.forbes.com/sites/alexandralevine/2022/04/27/how-tiktok-live-became-a-strip-club-filled-with-15-year-olds/. For more examples, see e.g. Asia Grace, “‘So f-ked up’: Instagram slammed for allowing paid content featuring kids in bikinis,” New York Post (Nov. 2, 2022), https://nypost.com/2022/11/02/instagram-slammed-for-paid-content-featuring-kids-in-bikinis; Jeff Horwitz and Katherine Blunt, “Instagram Connects Vast Pedophile Network,” The Wall Street Journal (Jun. 7, 2023), https://www.wsj.com/articles/instagram-vast-pedophile-network-4ab7189; Jennifer Valentino-DeVries and Michael H. Keller, “She Was a Child Instagram Influencer. Her Fans Were Grown Men,” The New York Times (Nov. 10, 2024), https://www.nytimes.com/2024/11/10/us/child-influencer.html. ↑
Paul Bischoff, “The rising tide of child abuse content on social media” Comparitech (Jul. 9, 2024) https://www.comparitech.com/blog/vpn-privacy/child-abuse-online-statistics/. ↑
NCMEC 2023 CyberTipline Report (2024), p.3 https://www.missingkids.org/content/dam/missingkids/pdfs/2023-CyberTipline-Report.pdf. ↑
NCMEC: Take It Down, available at https://takeitdown.ncmec.org/. ↑
“Artificial Intelligence and the Exploitation of Children,” National Association of Attorneys General (Sept. 5, 2023), https://ncdoj.gov/wp-content/uploads/2023/09/54-State-AGs-Urge-Study-of-AI-and-Harmful-Impacts-on-Children.pdf. ↑
Paul Bischoff, “The rising tide of child abuse content on social media” Comparitech (Jul. 9, 2024) https://www.comparitech.com/blog/vpn-privacy/child-abuse-online-statistics/. ↑
42 U.S.C. § 230(c)(1). Section 230 also (1) provides a safe harbor for good faith content moderation, (2) preempts contrary state laws, and (3) enumerates exemptions for enforcement of federal criminal statutes, intellectual property laws, communications privacy laws, and sex trafficking. ↑
See e.g., Kosseff, The Twenty-Six Words that Created the Internet (2019). ↑
Quinta Jurecic, “The politics of Section 230 reform: Learning from FOSTA’s mistakes” Brookings (Mar. 1, 2022), https://www.brookings.edu/articles/the-politics-of-section-230-reform-learning-from-fostas-mistakes. ↑
§ 230(c). ↑
Fair Hous. Council v. Roommates.com, LLC (9th Cir. 2008) 521 F.3d 1157, 1163. ↑
Zeran v. Am. Online, Inc (4th Cir. 1997) 129 F.3d 327. ↑
Michael Rustad & Thomas Koenig, “The Case for a CDA Section 230 Notice-and-Takedown Duty” (2023) 23 Nev.L.J. 533, 561-574. ↑
Danielle Keats Citron, “How to Fix Section 230” (2023) 103 B.U.L. Rev. 713, 727. ↑
E.g., John Lucas, “AG Moody Joins with Other Attorneys General to Urge Congress to Stop Protecting Illegal Activity on the Net,” Capitolist (May 23, 2019), https://thecapitolist.com/ag-moody-joins-with-other-attorneys-general-to-urge-congress-to-stop-protecting-illegal-activity-on-the-net. ↑
Lauren Feiner, “Lawmakers are tyring to repeal section 230 again” The Verge (Mar. 21, 2025), https://www.msn.com/en-us/politics/government/lawmakers-are-trying-to-repeal-section-230-again/ar-AA1BptAI?ocid=BingNewsVerp. ↑
Doe ex rel. Roe v. Snap, Inc. (2024) 144 S. Ct. 2493 (Thomas, J., dissenting from denial of certiorari). ↑
Calise v. Meta Platforms, Inc. (9th Cir. 2024) 103 F.4th 732, 747 (Nelson, J. concurring) (Calise). ↑
Ibid. ↑
See e.g. M.A. v. Vill. Voice Media Holdings (E.D.Mo. 2011) 809 F.Supp.2d 1041. ↑
Quinta Jurecic, “The politics of Section 230 reform: Learning from FOSTA’s mistakes (Mar. 1, 2022) Brookings, https://www.brookings.edu/articles/the-politics-of-section-230-reform-learning-from-fostas-mistakes/. ↑
Stop Enabling Sex Traffickers Act and the Allow States to Fight Online Sex Trafficking Act (SESTA/FOSTA) legislation package. (See P.L. 115-164, 113 Stat. 1253.) ↑
Discussed in Hearing
Assembly Standing Committee on Judiciary
Assembly Standing Committee on Privacy and Consumer Protection
Bill Author
Bill Co-Author(s):