SB 348: Department of Technology: artificial intelligence: strategic plans.
- Session Year: 2019-2020
- House: Senate
- Latest Version Date: 2019-06-27
|
Date
|
Status
|
|---|---|
| Aug 14, 2019 | August 14 set for first hearing canceled at the request of author. |
| Jul 3, 2019 | From committee: Do pass and re-refer to Com. on APPR. (Ayes 5. Noes 2.) (July 3). Re-referred to Com. on APPR. |
| Jun 27, 2019 | Read second time and amended. Re-referred to Com. on A. & A.R. |
| Jun 26, 2019 | From committee: Do pass as amended and re-refer to Com. on A. & A.R. with recommendation: To consent calendar. (Ayes 11. Noes 0.) (June 25). |
| Jun 6, 2019 | Referred to Coms. on P. & C.P. and A. & A.R. |
| May 24, 2019 | In Assembly. Read first time. Held at Desk. |
| May 23, 2019 | Read third time. Passed. (Ayes 37. Noes 0.) Ordered to the Assembly. |
| May 20, 2019 | Read second time. Ordered to third reading. |
| May 17, 2019 | From committee: Do pass as amended. (Ayes 6. Noes 0.) (May 16). |
| May 10, 2019 | Set for hearing May 16. |
| Apr 22, 2019 | April 22 hearing: Placed on APPR. suspense file. |
| Apr 11, 2019 | Set for hearing April 22. |
| Apr 9, 2019 | From committee: Do pass and re-refer to Com. on APPR. with recommendation: To consent calendar. (Ayes 16. Noes 0.) (April 9). Re-referred to Com. on APPR. |
| Mar 22, 2019 | Set for hearing April 9. |
| Feb 28, 2019 | Referred to Com. on G.O. |
| Feb 20, 2019 | From printer. May be acted upon on or after March 22. |
| Feb 19, 2019 | Introduced. Read first time. To Com. on RLS. for assignment. To print. |
|
Date
|
Description
|
Location
|
Votes
|
|
|---|---|---|---|---|
| Jul 3, 2019 | Do pass and be re-referred to the Committee on [Appropriations] | Assembly Standing Committee on Accountability and Administrative Review |
Passed |
|
| Jun 25, 2019 | Do pass as amended, and be re-referred to the Committee on [Accountability and Administrative Review] with recommendation: To Consent Calendar | Assembly Standing Committee on Privacy and Consumer Protection |
Passed |
|
| May 23, 2019 | Senate 3rd Reading SB348 Chang et al. | Senate Floor |
Passed |
|
| May 16, 2019 | Do pass as amended | Senate Standing Committee on Appropriations |
Passed |
|
| Apr 22, 2019 | Placed on suspense file | Senate Standing Committee on Appropriations |
Passed |
|
| Apr 9, 2019 | Do pass, but first be re-referred to the Committee on [Appropriations] with the recommendation: To Consent Calendar | Senate Standing Committee on Governmental Organization |
Passed |
This list shows positions taken on this bill by organizations on the date displayed, which is linked to the original source.
Positions by individuals are not included.
Date of Hearing: July 3, 2019
ASSEMBLY COMMITTEE ON ACCOUNTABILITY AND ADMINISTRATIVE REVIEW
Cottie Petrie-Norris, Chair
SBPCA Bill Id:SB 348
Author:(Chang) – As Amended Ver:June 27, 2019
SENATE VOTE: 38-0
SUBJECT: Department of Technology: artificial intelligence: strategic plans
SUMMARY: Requires the Director of the California Department of Technology (CDT) to develop a strategic plan to aid departments and agencies with incorporating artificial intelligence (AI) into state information technology (IT) operations, as specified, and encourages the appointment and designation of other state-level AI advisers and officers. Specifically, this bill:
- Charges the Director of CDT with devising a strategic plan that evaluates specified factors and is designed to aid departments and agencies with the incorporation of AI into state IT strategic plans, policies, standards, and enterprise architecture to improve state services.
- Allows the Director of CDT to seek input from experts in the field of AI when developing the strategic plan.
- Requires the Director of CDT, if AB 976 (Chau) establishing the AI in State Government Services Commission (AI Commission) is enacted, to consider findings from the AI Commission when developing the strategic plan.
- Encourages the Governor to appoint a special adviser on AI to coordinate with state agencies, local governments, and the federal government to devise a statewide strategic plan to utilize AI to improve state services and states that the plan should include an evaluation of specified factors.
- Encourages the Controller’s office, Treasurer’s office, Secretary of State’s office (SOS), the California State University, and the University of California to designate a chief AI officer.
EXISTING LAW establishes CDT with broad responsibility and authority over all aspects of IT and technology in California state government.
FISCAL EFFECT: Unknown
COMMENTS: This bill requires CDT’s Director to develop an AI-specific strategic plan to guide state entities in incorporating AI into their IT strategic plans, policies, standards, and enterprise architecture. The plan would be required to evaluate specified potential effects and impacts of utilizing AI to improve state services. Additionally, this bill encourages the Governor to appoint a special advisor on AI and various constitutional offices to designate a chief AI officer.
According to the author, “California has taken the leading role in AI development in the private sector but it is falling behind in implementation in state government. AI is already being utilized by some state departments to enhance their services but there is no comprehensive effort to ensure departments and agencies are developing a strategic plan to recognize and implement AI technology in an ethical way that improves internal and external functions.”
CDT is the state’s central IT organization. According to its 2018 Annual Report, it “supports transformation initiatives through…digital innovation [to] ensure that California has the most cutting-edge products available, including open source development, open data, web development, AI, blockchain, etc., and organized in a manner that allows any organization within the state to build, test and prove the value of digital services concepts.” The report notes that the SOS is the first state-level department or agency to use AI via a chatbot assistant to modernize and create efficiencies when providing services to customers.
In line with other state technology efforts, the Governor signed Executive Order N-11-19 on May 1, 2019, which recognizes California as a leader in innovation and technology development and establishes the Future of Work Commission (Work Commission) overseen by the Labor and Workforce Development Agency (Agency). In requesting funds to support the Work Commission, the Agency notes “California's economy is undergoing a fundamental shift as a result of advancements in technology [and] the automation of jobs and expanded AI capability will continue to have an impact on the type, quality, and number of jobs available in the 21st century economy.” Among other responsibilities, the Commission will be charged with developing tools to assess the impact of proposed technologies and evaluate their costs and benefits on workers, employers, the public and the state.
It appears that many of the objectives of this bill will be addressed through the newly-formed Work Commission and in conjunction with efforts currently underway at CDT. As a result, this bill could impose potentially duplicative requirements on state government.
RELATED LEGISLATION:
- AB 976 (Chau) would create the AI Commission and require it to provide specified recommendations to the Legislature and the Governor. AB 976 is pending in the Senate Appropriations Committee.
- AB 459 (Kiley) would have required the AB 976-proposed AI Commission to develop various minimum standards for the use of AI in state government. AB 459 was held on the Assembly Appropriations Committee Suspense File.
- AB 594 (Salas) would require the Director of CDT to appoint a Chief AI Officer within the department to evaluate the uses of AI in state government and advise the Director on incorporating AI into state IT strategic plans, policies, standards, and enterprise architecture. AB 594 is pending in the Senate Governmental Organization Committee.
- AB 1576 (Calderon) would require the Secretary of the Government Operations Agency to appoint participants to an AI working group and require the working group to report to the Legislature on the potential uses, risks, and benefits of the use of AI technology by California-based businesses. AB 1576 is pending in the Senate Judiciary Committee.
- SB 730 (Stern) would create the Commission on Tech Equity to develop policy recommendations regarding the development, deployment, and fair distribution of technology. SB 730 is pending in the Assembly Privacy and Consumer Protection Committee.
DOUBLE REFERRAL: This measure was previously heard in the Assembly Privacy and Consumer Protection Committee on June 25, 2019, with a vote of 11-0.
REGISTERED SUPPORT / OPPOSITION:
Support
Little Hoover Commission
Opposition
None on file.
Analysis Prepared by: Cassie Royce / A. & A.R. / (916) 319-3600
Date of Hearing: June 25, 2019
ASSEMBLY COMMITTEE ON PRIVACY AND CONSUMER PROTECTION
Ed Chau, Chair
SBPCA Bill Id:SB 348
Author:(Chang) – As Amended Ver:May 17, 2019
SENATE VOTE: 38-0
SUBJECT: Department of Technology: Department of Motor Vehicles: artificial intelligence: strategic plans
SUMMARY: This bill would, among other things, require the Director of the California Department of Technology (CDT) and the Director of the Department of Motor Vehicles (DMV) to each devise a strategic plan, as specified, to utilize artificial intelligence (AI) technology to improve state services. Specifically, this bill would:
- Require the strategic plans to evaluate both of the following:
- The potential effects of utilizing AI to improve state services on the department’s workforce and job classifications.
- How to minimize the impacts of utilizing AI to improve state services on the department’s workforce and job classifications.
- Authorize the Directors of CDT and the DMV to seek input from each office or other unit within their department, and from experts in the field of AI technology.
- State that the Legislature encourages the Governor to appoint a special adviser on AI to coordinate with state agencies, local governments, and the federal government in order to devise a statewide strategic plan to utilize AI to improve state services.
- Provide that the statewide strategic plan should evaluate, among other things, the following:
- The potential effects of utilizing AI to improve state services on the job responsibilities of state employees.
- How to mitigate the impacts of utilizing AI to improve state services on state employees.
- The impact of utilizing AI to improve state services on the privacy of citizens of this state.
- State that the Legislature encourages the Controller’s office, Treasurer’s office, Secretary of State’s office, the California State University, and the University of California to designate a chief AI officer.
EXISTING LAW:
- Establishes in the state government certain agencies, including the Government Operations Agency. (Gov. Code Sec. 12800.) Provides that each agency is under the supervision of an executive officer known as the secretary, appointed by, and holding office at the pleasure of, the Governor. The appointment of each secretary is subject to confirmation by the Senate. (Gov. Code Sec. 12801.)
- Establishes the California Department of Technology (CDT) within the Government Operations Agency in state government. (Gov. Code Sec. 11545(a)(1).) Provides that unless the context clearly requires otherwise, whenever the term “State Chief Information Officer” or “Secretary of California Technology” appears in any statute, regulation, or contract, or any other code, it shall be construed to refer to the Director of Technology. (Gov. Code Sec. 11545(a)(2).)
- Enumerates the duties of the Director of Technology, which includes, among other things:
- advising the Governor on the strategic management and direction of the State’s information technology (IT) resources;
- establishing and enforcing state IT strategic plans, policies, standards, and enterprise architecture, as specified;
- minimizing overlap, redundancy, and cost in state IT operations by promoting the efficient and effective use of information technology;
- providing technology direction to agency and department chief information officers to ensure the integration of statewide technology initiatives, compliance with IT policies and standards, and the promotion of the alignment and effective management of IT services;
- working to improve organizational maturity and capacity in the effective management of IT; and,
- establishing performance management and improvement processes to ensure state IT systems and services are efficient and effective. (Gov. Code Sec. 11545(b).)
- Establishes the California Department of Motor Vehicles (DMV) within the California Transportation Agency in state government. (Veh. Code Sec. 1500 et seq.)
FISCAL EFFECT: According to the Senate Appropriations Committee:
- Unknown, significant costs, likely in the hundreds of thousands of dollars, for the directors of CDT and the DMV to devise a strategic plan. (GF/special funds)
- Unknown, potential cost, in the hundreds of thousands of dollars, to create the position of special adviser on AI and for related resources necessary to devise a statewide strategic plan. (GF)
- Unknown, significant cost pressure, to adopt and implement a statewide strategic plan developed by the special adviser on AI.
- Unknown, potential cost, likely in the high hundreds of thousands of dollars, should the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California each designate a Chief AI officer. (GF)
COMMENTS:
- Purpose of the bill: This bill seeks to encourage a comprehensive effort to ensure state departments and agencies are utilizing AI technology to improve state services by requiring CDT and the DMV to develop AI-specific strategic plans, encouraging the governor to appoint a special advisor on AI, and encouraging various constitutional offices to designate a chief AI officer. This bill is author-sponsored.
- Author’s statement: According to the author:
Artificial intelligence is emerging technology that has the likelihood to have a great impact on California’s workforce. Other states are already creating commissions or developing strategic plans to address the implications of AI in the government. California has taken the leading role in AI development in the private sector but it is falling behind in implementation in state government. AI is already being utilized to by some state departments to enhance their services but there is no comprehensive effort to ensure departments and agencies are developing a strategic plan to recognize, and implement AI technology in an ethical way that improves internal and external functions.
This bill was created largely based off a report authored by the Little Hoover Commission. In Artificial Intelligence: A Roadmap for California, the Commission outlines the impact of AI on the workforce and outlines recommendations to the state government on how to best prepare for a future with AI.
- What is AI? AI is not a term that is heavily legislated at this time, though it continues to be a more frequent topic in public policy discussions. First coined by a Dartmouth professor, John McCarthy, in the 1950s, there does not appear to be any singular, consistent definition of AI in use today, over 60 years later. McCarthy described the process as “that of making a machine behave in ways that would be called intelligent if a human were so behaving.” (Kaplan, Artificial Intelligence: What Everyone Needs to Know (2016) p. 1 (internal citations omitted).) Today, there are many proposed definitions of AI, but most appear to be aligned around that same concept of creating computer programs or machines capable of “intelligent” behavior if exhibited by humans. (Id.)
- The opportunities and challenges of AI: Last spring, this Committee held a joint informational hearing with the Assembly Select Committee on Emerging Technologies & Innovation on the topic of AI, to begin a preliminary discussion of the promises and challenges presented by AI. The overarching goal of the hearing was to bring members and staff a greater understanding of AI to engender more thoughtful public policy in the future. As recognized in the committees’ background paper on AI, the opportunities and challenges posed by AI are significant, and in many ways still being uncovered.
Notably, at the same time that this Committee began this joint-endeavor to generate greater understanding of the opportunities and challenges of AI within the Legislature, the Little Hoover Commission (LHC) was simultaneously studying the same topic. The LHC began its process, which included both public hearings and roundtables, with a public hearing on January 25, 2018, entitled “Artificial Intelligence: Applications and Implications.” At that first hearing, the LHC indicated that it ultimately intended to produce a report and policy recommendations about how the State of California can approach AI.
Indeed, in November 2018, the LHC produced its report, Artificial Intelligence: A Roadmap for California, wherein it similarly recognized the possible benefits and potential misuses of AI in an opening “Letter from the Chair” by LHC Chairman, Pedro Nava:
Imagine using AI applications to predict where fires may occur, detect early-stage wildfires, or guide firefighters where best to fight a fire and save lives. Conceive of an environment where AI could promote biodiversity and water conservation, and protect endangered species. See educators using AI to improve student learning and increase graduation rates. Envision better detection of diseases, including cancer, and more finely-tuned effective treatments. Certainly, such visions must be tempered with appropriate privacy protections and robust laws aimed at preventing the misuse of data. In addition, this encouraging future, which is presently knocking at our door, will require not just foresight but insight, not just political will but political action, and not just one mind but a collaboration of minds in government, academia, and private industry. (See LHC Report #245, Artificial Intelligence: A Roadmap for California (Nov. 2018), p. 1; hereinafter “LHC Report.”)
This bill, SB 348, arises out of the LHC Report’s recommendations and would require the directors of two different departments, CDT and the DMV, to devise a strategic plan that encompasses each office or other unit within each department to utilize AI technology to improve state services, as specified. The bill would also encourage the Governor to appoint a special adviser on AI to coordinate with various entities in order to devise a statewide strategic plan to utilize AI to improve state services. Finally, the bill would encourage various constitutional offices to designate a chief AI officer. In support, the LHC notes that this bill would carry out three of the recommendations noted in the LHC Report and help California establish clear leadership focusing on the development and use of AI technology.
- Findings and recommendations made by Little Hoover Commission report on AI: The LHC Report begins by recognizing that “[AI] is already changing the structure of goods and services in the economy, and altering the nature of work. This has major implications for our workforce and opens critical questions about our human values like privacy. [… ] AI poses four key decisions for California: (1) how to support AI research and responsible AI use to grow the state’s economy; (2) how to take advantage of advances in AI to enhance services to Californians; (3) how to configure a new structure for lifelong education and training to respond to the inevitable disruption in the tasks or content of work; and (4) how to protect its values of privacy, transparency and accountability in this new economic era.” (Id. at p. 6.)
The LHC Report describes how California is currently unprepared to take the lead in a race to prepare for AI because it “lacks any single clear leadership and focus on the development and use of AI technology and applications to improve internal and external operations and services within an ethical framework.” The Report also warns that California has not begun “the necessary work to forecast and prepare for the inevitable changes the new technology will impose on the state’s workforce and economy. This void could leave California flatfooted in a highly competitive race for AI superiority where only the winner takes all.” (Id.)
To make the necessary decisions posed by AI and to fill this identified void, the LHC Report sets forth nine recommendations to the Governor and Legislature, which cover everything from state government infrastructure and planning, education and training, the collection of data, creation of an AI commission, and more. The recommendations, for example, include:
- The Governor should appoint an AI special advisor within the Governor’s cabinet, with certain suggested duties. (See Recommendation 1.)
- The Governor and Legislature should require each state agency or standalone department to designate a chief AI officer, with certain suggested duties. (See Recommendation 2.)
- The Governor and Legislature should require each state agency, which includes departments, boards, commissions and the like, to devise strategic plans that include the use and implementation of AI technology and applications to improve and enhance the agency’s internal and external operations and services within an ethical framework that promotes the use of AI for economic, social and environmental good. The strategic plan should also include strategies to minimize the impact of AI technology and applications on jobs and job classifications. (See Recommendation 4.)
This bill, SB 348, now seeks to partially adopt the recommendations noted above by:
- Requiring the directors of CDT and the DMV to devise strategic plans to utilize AI technology to improve state services, and require that each plan evaluate the potential effects of utilizing on the job responsibilities of department employees, and how to minimize the impacts of AI on the department’s workforce and job classifications.
- Encouraging the Governor to appoint a special advisor on AI to coordinate with state agencies, local governments, and the federal government in order to devise a statewide strategic plan to utilize AI to improve state services.
- Encouraging the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California each designate a chief AI officer.
In support, the Future of Life Institute writes, “[w]e are proud to support SB 348 for two major reasons. First, we believe the potential creation of a special adviser on AI by the Governor could fulfill a valuable role in overseeing the government-wide application of AI technologies. Such a position may be needed to ensure the application of consistent ethical standards for AI technology across many use cases. Likewise, the potential creation of chief artificial intelligence officers by varied state agencies could fulfill a similar role within the more specific domain of their respective agencies.”
- Numerous bills on AI this year: This bill is one of many bills on AI this year. For example, this Committee previously heard and approved AB 1576 (Calderon) which would require the Secretary of Government Operations to appoint participants to an AI working group, would define “AI” for these purposes, and would require the working group to report to the Legislature on the potential uses, risks, and benefits of the use of AI technology by California-based businesses. More relevant to SB 348, this Committee also approved three bills dealing specifically with the use of AI in state government. AB 976 (Chau), which is also supported by the LHC, would create the AI in State Government Services Commission (Commission) comprised of eight members with certain knowledge and expertise related to the field of AI and would require the Commission provide specified recommendations to the Legislature and the Governor. This Committee also approved AB 459 (Kiley) which would have required the AB 976-proposed Commission to develop various minimum standards for the use of AI in state government. Finally, this Committee approved AB 594 (Salas) which would require the director of CDT to appoint a Chief AI Officer within the department to evaluate the uses of AI in state government and to advise the Director of Technology on incorporating AI into state information technology strategic plans, policies, standards, and enterprise architecture.
Staff notes that there is a considerable amount of overlap in these bills, and should they each be signed into law, they could create duplicative and potentially conflicting obligations in state government. Furthermore, given the risks associated with AI, such as bias, discrimination, and potential displacement of the workforce, it would be prudent for any AI-specific strategic plans in state government to incorporate the most contemporary and relevant research available. To this point, writing in support of this bill, the Future of Life Institute notes that “the decisions made by chief intelligence officers regarding how to deploy AI technologies may be best informed by a Commission-like entity, such as that called for by AB-976, that can provide the officers with minimum standards for the ethical use of AI technologies in government services.”
Indeed, the AB 976 Commission seeks to compile research that is tailored specifically to how AI technology could be used to improve state services and will be comprised of eight individuals “with knowledge of, and expertise in, the field of AI from private industry, governments, nonprofit organizations, unions, and academia,” and would include the director of CDT specifically. The Commission would be required to submit its findings to the Governor and the Legislature by January 1, 2020. Arguably, these findings would provide valuable information to state departments and agencies as they endeavor to devise strategic plans on how AI may be used to improve state services while still minimizing the impact on workforce and job classifications, as required by this bill.
- CDT has a statutory responsibility to advise on the state’s information technology resources: The director of CDT has a statutory responsibility to advise the Governor on the strategic management and direction of the state’s information technology (IT) resources (many of which may be shaped or affected by uses of AI), to provide technology direction to agency and department chief information officers to ensure the integration of statewide technology initiatives, and to establish and enforce state IT strategic plans, policies, standards, and enterprise architecture. (See Gov. Code Sec. 11545(b).) This statutory obligation would naturally extend to providing AI-specific direction to the Director of the DMV, thereby calling into question the requirement that the Director of the DMV create a strategic plan independently of CDT.
Furthermore, encouraging state departments and agencies to rely on CDT expertise to devise AI-specific strategic plans is arguably appropriate not only because CDT houses the State’s existing expertise in statewide IT resources and IT-related solutions and initiatives, but it is also consistent with activities undertaken by CDT in recent years to cultivate AI expertise within its Office of Digital Innovation (ODI). CDT originally launched ODI in 2016 to define an approach to government technology innovation that would drive the department forward as a thought leader and technology innovator in state government. To that end, ODI already appears to be considering some applications of AI within state government.
Acknowledging these considerations, the author offers the following amendments to ensure that the strategic plans required by this bill will take into account the most relevant information and expertise available to state government. The amendments strike the requirement that the Director of the DMV devise a strategic plan, and would instead require that the Director of CDT take into account the findings generated by the AB 976-proposed Commission in devising a strategic plan designed to aid state departments and agencies in appropriately integrating AI into state services.
Author’s amendments:
- In Section 1 of the bill, Government Code Section 12897 is amended to read:
(a) The Director of Technology shall devise a strategic plan designed to aid departments and agencies with the incorporation of artificial intelligence into state information technology strategic plans, policies, standards, and enterprise architecture that encompasses each office or other unit within the Department of Technology to utilize artificial intelligence technology to improve state services. The strategic plan shall evaluate both of the following:
(1) The potential effects of utilizing artificial intelligence to improve state services on the job responsibilities of department employees.
(2) How to minimize the negative impacts of utilizing artificial intelligence to improve state services on the department’s workforce and job classifications.
(b) In devising a strategic plan required by subdivision (a), the director may seek input from each office or other unit within the department and from experts in the field of artificial intelligence technology.
(c) In devising a strategic plan required by subdivision (a), the director shall consider the findings of the Artificial Intelligence in State Government Services Commission. This subdivision shall become operative only if Assembly Bill 976 of the 2019–20 Regular Session is enacted and establishes the Artificial Intelligence in State Government Services Commission.
- In Section 1 of the bill, strike Government Code section 12897.1.
- Bill encourages, rather than mandates, the appointment and designation of other AI advisers and officers: This bill would provide that the Legislature encourages the Governor to appoint a special adviser on AI to coordinate with state agencies, local governments, and the federal government in order to devise a statewide strategic plan to utilize AI to improve state services. The bill would additionally provide that the Legislature encourages the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California each designate a Chief AI officer.
Encouraging, rather than mandating, the designation of chief AI officers in various state entities appears to be prudent as a matter of public policy because it would allow these entities to take into consideration the findings of the AB 976 Commission and the strategic plan of the director of CDT (see Comment 6, above). This information should not only be useful in selecting appropriate candidates for chief AI officers, but should also ensure that these officers, once designated, have clear direction in how to carry out the implementation of AI technology in their various spheres in a manner which should improve the economy, public health and safety, jobs, and the environment.
Similarly, encouraging rather than mandating the appointment of a special adviser to coordinate with various government entities in order to devise a statewide strategic plan to utilize AI to improve state services gives the Governor the flexibility to consider how the position of the special adviser may interact with other appointed positions in state government. Specifically, as noted above in Comment 6, the Director of CDT has a statutory responsibility to advise the Governor on the strategic management and direction of the state’s IT resources (many of which may be shaped or affected by uses of AI), to provide technology direction to agency and department chief information officers to ensure the integration of statewide technology initiatives, and to establish and enforce state IT strategic plans, policies, standards, and enterprise architecture. (See Gov. Code Sec. 11545(b).) Furthermore, in January of this year, the Governor announced plans to create a new Office of Digital Innovation within the Government Operations Agency (GovOps). At the time of this writing, the GovOps is seeking a Director who, with the support of GovOps, will coordinate with the departments responsible for the state’s technology backbone, hiring, and procurement, which also fall within the same agency.” (See <https://govops.forms.fm/ interest-form-director-of-the-california-office-of-digital-innovation/forms/6701> [as of Jun. 18, 2019].)
By encouraging the Governor to appoint a special adviser on AI, this bill gives the administration the appropriate flexibility to evaluate the roles of these different positions in a way that will benefit the State.
- Related legislation: AB 459 (Kiley) See Comment 6. This bill was held in the Assembly Appropriations Committee.
AB 976 (Chau) See Comment 6.
AB 594 (Salas) See Comment 6.
AB 1576 (Calderon) See Comment 6.
SB 730 (Stern) would establish the Commission on the Future of Work and the Commission of Tech Equity to research the impact of technology on workers, employers, and the economy of the state. This bill is currently in the Assembly Labor and Employment Committee.
- Double-referral: This bill is double-referred to the Committee on Accountability & Administrative Review.
REGISTERED SUPPORT / OPPOSITION:
Support
Future of Life Institute
Little Hoover Commission
Opposition
None on file
Analysis Prepared by: Nichole Rapier / P. & C.P. / (916) 319-2200
Office of Senate Floor Analyses (916) 651-1520 Fax: (916) 327-4478 | SB 348 |
THIRD READING
Bill No: SB 348
Amended: 5/17/19
SENATE GOVERNMENTAL ORG. COMMITTEE: 16-0, 4/9/19
AYES: Dodd, Wilk, Allen, Archuleta, Borgeas, Bradford, Chang, Galgiani, Glazer, Hill, Hueso, Jones, Nielsen, Portantino, Rubio, Wiener
SENATE APPROPRIATIONS COMMITTEE: 6-0, 5/16/19
AYES: Portantino, Bates, Bradford, Hill, Jones, Wieckowski
SUBJECT: State agencies: artificial intelligence: strategic plans
DIGEST: This bill requires the Director of the California Department of Technology (CDT) and the Director of the Department of Motor Vehicles (DMV) to each devise a strategic plan, as specified, to utilize artificial intelligence (AI) technology to improve state services.
ANALYSIS:
Existing law:
- Establishes various agencies within state government that are each under the supervision of an executive officer known as a secretary.
- Requires the Secretary of the Government Operations Agency to appoint a blockchain group to evaluate the use of the technology, as specified.
- Establishes, within the Government Operations Agency, CDT which is responsible and is the authority over all aspects of technology in California state government.
- Requires the Director of CDT to establish and enforce state information technology strategic plans, policies, standards, and enterprise architecture.
- Establishes DMV, which is under the control of a civil executive officer known as the Director of Motor Vehicles, and sets forth the power and duties of the department, including, but not limited to, vehicle registration and the issuance and renewal of driver’s licenses.
This bill:
- Requires the Director of CDT and the Director of the DMV to each devise a strategic plan, as specified, to utilize artificial AI technology to improve state services.
- Requires the strategic plans to include both of the following:
- The potential effects of utilizing AI to improve state services on the department’s workforce and job classifications.
- How to minimize the impacts of utilizing AI to improve state services on the department’s workforce and job classifications.
- Authorizes the directors of CDT and the DMV to seek input from each office, or other unit within their department and from experts in the field of AI technology.
- Encourages the Governor to appoint a special adviser on AI to coordinate with state agencies, local governments, and the federal government in order to devise a statewide strategic plan to utilize AI to improve state services.
- Encourages the following entities to designate a chief AI officer:
- The Controller’s office.
- The Treasurer’s office.
- The Secretary of State’s office.
- The California State University.
- The University of California.
Background
Purpose of the bill. According to the author’s office, “the strategic plans developed through SB 348 will help California to become the leader in AI implementation in state government. It is critical our state recognizes the benefits as well as risks of AI technology today and prepare for its proliferation and implementation in order to leverage its use to improve services.”
The author’s office further states that, “AI can be utilized in countless areas of public service, from fire detection to greater biodiversity to improving DMV services. It is time to begin modernizing our state services to better support all Californians.”
Artificial Intelligence. First coined in 1956, AI is a wide-ranging branch of computer science focused on building smart machines capable of performing tasks that typically require human intelligence. AI makes it possible for computers to learn from experience, adjust to new inputs and perform “human-like” tasks.
Using AI, computers can be “trained” to accomplish unique task by processing large amounts of data and recognizing patterns in that data. While many AI systems have the ability to learn over time, not all can do so. Some of the most well-known AI technologies include image recognition software, Siri, Alexa, and other personal assistants, and self-driving cars.
AI technology can also be used across a wide array of sectors including the public sector. For example, at the federal level, the Department of Veteran Affairs is using AI to better predict medical complications and improve treatment of combat wounds. Some cities are also beginning to leverage the type of responsive dispatching and routing used by ride-hailing services, and linking it with scheduling and tracking software for public transportation.
While AI has the potential to address some of humanity’s biggest challenges, a recent report by the National Science and Technology Council argues that, “use of AI to make consequential decisions about people, often replacing decisions made by human-driven bureaucratic processes, leads to concerns about how to ensure justice, fairness, and accountability.” Similarly, because AI depends solely on data input there are concerns that if the data used reflects past decisions that are biased, the results could also perpetuate that bias.
The use of AI technology also leads to concerns from workers that their jobs could be lost to computers that utilize AI technology. This bill requires that state agencies look at the impact on their workforce when developing the strategic plans required by this bill.
Little Hoover report. Late last year, the Little Hoover Commission released a report titled, “Artificial Intelligence: A Roadmap for California” which detailed how even though some state departments are collaborating with the private sector and academia to develop and use new AI technologies, the overwhelming majority of state departments are not developing or preparing any sort of strategic plans related to the use of AI technology.
The report further argued that while California has taken the lead in the use of AI in the private sector, it was falling behind in implementation in state government.
As such, the Little Hoover Commission recommended a number of actions including requiring state agencies to devise strategic plans similar to the strategic plans that are required in this bill. The report also recommended that the Governor appoint a special adviser.
Related/Prior Legislation
SB 730 (Stern, 2019) establishes the Commission on the Future of Work and the Commission of Tech Equity to conduct research to understand the impact of technology on workers, employers, and the economy of the state. (Pending on the Senate Floor)
AB 976 (Chau, 2019) establishes the Artificial Intelligence in State Government Services Commission as an advisory body in state government. (Pending on the Assembly Floor)
AB 1576 (Calderon, 2019) requires, until January 1, 2023, the Secretary of Government Operations to appoint an AI working group on or before July 1, 2020. (Pending on the Assembly Floor)
AB 459 (Kiley, 2019) would have required the Artificial Intelligence in State Government Services Commission (AI Commission) proposed to be created by AB 976 (Chau) of the 2018-2019 Legislative Session, to report to the Legislature on its recommended minimum standards for the use of AI in fostering accountability in state government services and prioritizing the safety and security of AI technologies used by state government. (Held in the Assembly Appropriations Suspense File)
AB 2596 (Cooley, 2018) would have required the Governor’s Office of Business and Economic Development to take the lead in preparing a California Economic Development Strategic Action Plan to identify economic challenges and provide a set of actions to address the shifting economic landscape, changing demographics, and unique strengths of California’s industries, businesses, workers, and entrepreneurs. (Vetoed by Governor Brown)
AB 2658 (Calderon, Chapter 875, Statutes of 2018) required the Secretary of the Government Operations Agency to appoint a blockchain group to evaluate the use of the technology.
AB 531 (Irwin, 2017) would have required the Office of Information Security (OIS), on or before July 1, 2019, to review information security technologies currently in place in state agencies to determine if there are sufficient policies, standards, and procedures in place to protect critical government information and prevent the compromise or unauthorized disclosure of sensitive digital content, as defined, inside or outside the firewall of state agencies. (Vetoed by Governor Brown)
FISCAL EFFECT: Appropriation: No Fiscal Com.: Yes Local: No
According to the Senate Appropriations Committee:
- Unknown, significant costs, likely in the hundreds of thousands of dollars, for the directors of CDT and the DMV to devise a strategic plan.
- In addition, unknown, potential cost, in the hundreds of thousands of dollars, to create the position of special adviser on artificial intelligence and for related resources necessary to devise a statewide strategic plan.
- Also, unknown, significant cost pressure, to adopt and implement a statewide strategic plan developed by the special adviser on artificial intelligence.
- Finally, unknown, potential cost, likely in the high hundreds of thousands of dollars, should the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California each designate a Chief Artificial Intelligence Officer.
The Future of Life Institute
Little Hoover Commission
OPPOSITION: (Verified 5/16/19)
None received
ARGUMENTS IN SUPPORT: According to the Little Hoover Commission, “in its 2018 Report, Artificial Intelligence: A Roadmap for California, the Commission noted strides made by California state government to use modern technology to improve internal and external operations and services, but concluded the government as a whole was ill-prepared for the inevitable brought by AI. SB 348 would help California establish clear leadership to focus on the development and use of AI technology.”
Prepared by: Felipe Lopez / G.O. / (916) 651-1530
5/20/19 11:26:22
**** END ****
SENATE COMMITTEE ON APPROPRIATIONS
Senator Anthony Portantino, Chair
2019 - 2020 Regular Session
SB 348 (Chang) - State agencies: artificial intelligence: strategic plans
Version: February 19, 2019 | Policy Vote: G.O. 16 - 0 |
Urgency: No | Mandate: No |
Hearing Date: May 16, 2019 | Consultant: Debra Cooper |
Bill Summary:
SB 348 would require the secretaries of specified state agencies to devise a strategic plan that would evaluate the potential effects of using artificial intelligence (AI) to improve state services and how to minimize the impacts of AI on the agency’s workforce.
*********** ANALYSIS ADDENDUM – SUSPENSE FILE ***********
The following information is revised to reflect amendments
adopted by the committee on May 16, 2019
Fiscal Impact:
- Unknown, significant costs, likely in the hundreds of thousands of dollars, for the directors of the Department of Technology and the Department of Motor Vehicles to devise a strategic plan (GF/special funds)
- Unknown, potential cost, in the hundreds of thousands of dollars, to create the position of special adviser on artificial intelligence and for related resources necessary to devise a statewide strategic plan. (GF)
- Unknown, significant cost pressure, to adopt and implement a statewide strategic plan developed by the special adviser on artificial intelligence.
- Unknown, potential cost, likely in the high hundreds of thousands of dollars, should the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California each designate a Chief Artificial Intelligence officer. (GF)
Author Amendments:
Limit the strategic plan requirements to the Director of Technology and the Director of Motor Vehicles.
-- END --
SENATE COMMITTEE ON APPROPRIATIONS
Senator Anthony Portantino, Chair
2019 - 2020 Regular Session
SB 348 (Chang) - State agencies: artificial intelligence: strategic plans
Version: February 19, 2019 | Policy Vote: G.O. 16 - 0 |
Urgency: No | Mandate: No |
Hearing Date: April 22, 2019 | Consultant: Debra Cooper |
Bill Summary:
SB 348 would require the secretaries of specified state agencies to devise a strategic plan that would evaluate the potential effects of using artificial intelligence (AI) to improve state services and how to minimize the impacts of AI on the agency’s workforce.
Fiscal Impact:
- Unknown, significant costs, likely in the millions of dollars, for the secretaries of the eight specified state agencies to devise a strategic plan (GF/special funds) (see Staff Comments)
- Unknown, potential cost, in the hundreds of thousands of dollars, to create the position of special adviser on artificial intelligence and related resources necessary to devise a statewide strategic plan. (GF)
- Unknown, significant cost pressure, to adopt and implement a statewide strategic plan developed by the special adviser on artificial intelligence.
- Unknown, potential cost, likely in the high hundreds of thousands of dollars, should the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California each designate a Chief Artificial Intelligence officer. (GF)
Background:
In November 2018, the Little Hoover Commission released a report titled, “Artificial Intelligence: A Roadmap for California” which detailed how even though some state departments are collaborating with the private sector and academia to develop and use new AI technologies, the overwhelming majority of state departments are not developing or preparing any sort of strategic plans related to the use of AI technology.
The report further argued that while California has taken the lead in the use of AI in the private sector, it was falling behind in implementation in state government. As such, the Little Hoover Commission recommended a number of actions including requiring state agencies to devise strategic plans similar to the strategic plans that are required in this bill. The report also recommended that the Governor appoint a special adviser.
Proposed Law:
This bill would require the secretaries of the Business, Consumer Services, and Housing; Transportation; California Environmental Protection; California Health and Human Services; Labor and Workforce Development; Natural Resources; Government Operations; and Corrections and Rehabilitation agencies to devise a strategic plan, as specified, that encompasses each department, office, or other unit within the agency to utilize AI technology to improve state services. This bill would encourage the Governor to appoint a special adviser on AI to coordinate with state agencies, local governments, and the federal government to devise a statewide strategic plan, as specified. This bill would also encourage the Controller’s office, the Treasurer’s office, the Secretary of State’s office, the California State University, and the University of California to designate a Chief Artificial Intelligence officer.
Related Legislation:
AB 459 (Kiley, 2019) would require the Artificial Intelligence in State Government Services Commission to report to the Legislature on the commission’s recommended minimum standards for the use of AI that includes specified information. That measure is pending in the Assembly Accountability and Administrative Review Committee.
AB 976 (Chau, 2019) would establish the Artificial Intelligence in State Government Services Commission comprised of eight members, as specified, and would require the advisory commission to convene a public process to gather input on how AI and data science could be used to improve state services. That measure is pending in the Assembly Appropriations Committee.
AB 1576 (Calderon, 2019) would require, until January 1, 2023, the Secretary of Government Operations to appoint an AI working group on or before July 1, 2020. That measure is pending in the Assembly Privacy and Consumer Protection Committee.
AB 2596 (Cooley, 2018) would have required the Governor’s Office of Business and Economic Development to take the lead in preparing a California Economic Development Strategic Action Plan to identify economic challenges and provide a set of actions to address the shifting economic landscape, changing demographics, and unique strengths of California’s industries, businesses, workers, and entrepreneurs. That measure was vetoed by Governor Brown.
AB 2658 (Calderon, Chapter 875, Statutes of 2018) required the Secretary of the Government Operations Agency to appoint a blockchain group to evaluate the use of the technology.
Staff Comments:
The cost for devising the strategic plans for each of the specified agencies will vary widely dependent on the agency’s needs. For instance, the Department of Motor Vehicles (DMV) falls under the purview of the California State Transportation Agency (CalSTA). There is a great potential for the use of AI within the DMV, and the subsequent impact would be significant. Evaluating that potential and impact would be complex and would require a significant increase in workload resources. CalSTA would additionally have to evaluate their other departments, offices, and units within the agency, therefore increasing the added workload needs.
If each of the specified agencies required just one additional full-time position to devise the strategic plan, the cost per agency would be in the low thousands of dollars. Using that assumption, the cumulative cost would fall in the low millions of dollars. Depending on the specific needs of each agency and their respective departments, offices, and units, some agencies would require even more personnel, thereby increasing the overall cost correspondingly.
-- END --
SENATE COMMITTEE ON GOVERNMENTAL ORGANIZATION
Senator Bill Dodd
Chair
2019 - 2020 Regular
Bill No: SB 348 Hearing Date: 4/9/2019
Author: | Chang, et al. | ||
Version: | 2/19/2019 Introduced | ||
Urgency: | No | Fiscal: | Yes |
Consultant: | Felipe Lopez | ||
SUBJECT: State agencies: artificial intelligence: strategic plans
DIGEST: This bill requires the secretaries of specified state agencies to devise a strategic plan that would evaluate the potential effects of utilizing artificial intelligence (AI) to improve state services and how to minimize the impacts of AI on the agency’s workforce.
ANALYSIS:
Existing law:
- Establishes various agencies within state government that are each under the supervision of an executive officer known as a secretary.
- Requires the Secretary of the Government Operations Agency to appoint a blockchain group to evaluate the use of the technology, as specified.
- Establishes the Business, Consumer Services and Housing Agency, which assists and educates consumers regarding the licensing, regulation, and enforcement of professionals and businesses in California.
- Establishes the Transportation Agency, which develops and coordinates the policies and programs of the state’s transportation entities to achieve the state’s mobility, safety, and air quality objectives from its transportation system.
- Establishes the California Environmental Protection Agency, which is tasked with restoring, protecting, and enhancing the environment, to ensure public health, environmental quality, and economic vitality.
- Establishes the California Health and Human Services Agency, which oversees departments and offices that provide a wide range of services in the areas of health care, mental health, public health, alcohol and drug treatment, income assistance, social services and assistance to people with disabilities.
- Establishes the Labor and Workforce Development Agency, which oversees seven major departments, boards, and panels that serve California businesses and workers.
- Establishes the Natural Resources Agency, which is tasked with restoring, protecting, and managing the state’s natural, historical and cultural resources for current and future generations using creative approaches and solutions based on science, collaboration and respect for all the communities and interests involved.
- Establishes the Government Operations Agency, which is responsible for improving management and accountability of government programs, increasing efficiency, and promoting better and more coordinated operational decisions.
- Establishes the Corrections and Rehabilitation Agency, which is responsible for enhancing public safety through safe and secure incarceration of offenders, effective parole supervision, and rehabilitative strategies to successfully reintegrate offenders into our communities.
This bill:
- Requires the secretary of each state agency, as defined, to devise a strategic plan that would encompass each department, office, or other unit within the agency to utilize AI technology to improve state services.
- Defines “state agency” to mean the following agencies:
- Business, Consumer Services, and Housing;
- Transportation;
- California Environmental Protection;
- California Health and Human Services;
- Labor and Workforce Development;
- Natural Resources;
- Government Operations; and
- Corrections and Rehabilitation.
- Requires the strategic plan to include both of the following:
- The potential effects of utilizing AI to improve state services on the agency’s workforce and job classifications.
- How to minimize the impacts of utilizing AI to improve state services on the agency’s workforce and job classifications.
- Authorizes the secretary of a state agency to seek input from each department, office, or other unit within their agency and from experts in the field of AI technology.
- Encourages the Governor to appoint a special adviser on AI to coordinate with state agencies, local governments, and the federal government in order to devise a statewide strategic plan to utilize AI to improve state services.
- Encourages the following entities to designate a chief AI officer:
- The Controller’s office.
- The Treasurer’s office.
- The Secretary of State’s office.
- The California State University.
- The University of California.
Background
Purpose of the bill. According to the author’s office, “the strategic plans developed through SB 348 will help California to become the leader in AI implementation in state government. It is critical our state recognizes the benefits as well as risks of AI technology today and prepare for its proliferation and implementation in order to leverage its use to improve services.”
The author’s office further states that, “AI can be utilized in countless areas of public service, from fire detection to greater biodiversity to improving DMV services. It is time to begin modernizing our state services to better support all Californians.”
Artificial Intelligence. First coined in 1956, AI is a wide-ranging branch of computer science focused on building smart machines capable of performing tasks that typically require human intelligence. AI makes it possible for computers to learn from experience, adjust to new inputs and perform “human-like” tasks.
Using AI, computers can be “trained” to accomplish unique task by processing large amounts of data and recognizing patterns in that data. While many AI systems have the ability to learn over time, not all can do so. Some of the most well-known AI technologies include image recognition software, Siri, Alexa, and other personal assistants, and self-driving cars.
AI technology can also be used across a wide array of sectors including the public sector. For example, at the federal level, the Department of Veteran Affairs is using AI to better predict medical complications and improve treatment of combat wounds. Some cities are also beginning to leverage the type of responsive dispatching and routing used by ride-hailing services, and linking it with scheduling and tracking software for public transportation.
While AI has the potential to address some of humanity’s biggest challenges, a recent report by the National Science and Technology Council argues that, “use of AI to make consequential decisions about people, often replacing decisions made by human-driven bureaucratic processes, leads to concerns about how to ensure justice, fairness, and accountability.” Similarly, because AI depends solely on data input there are concerns that if the data used reflects past decisions that are biased, the results could also perpetuate that bias.
The use of AI technology also leads to concerns from workers that their jobs could be lost to computers that utilize AI technology. This bill would require that state agencies look at the impact on their workforce when developing the strategic plans required by this bill.
Little Hoover report. Late last year, the Little Hoover Commission released a report titled, “Artificial Intelligence: A Roadmap for California” which detailed how even though some state departments are collaborating with the private sector and academia to develop and use new AI technologies, the overwhelming majority of state departments are not developing or preparing any sort of strategic plans related to the use of AI technology.
The report further argued that while California has taken the lead in the use of AI in the private sector, it was falling behind in implementation in state government.
As such, the Little Hoover Commission recommended a number of actions including requiring state agencies to devise strategic plans similar to the strategic plans that are required in this bill. The report also recommended that the Governor appoint a special adviser.
Prior/Related Legislation
AB 459 (Kiley, 2019) would require the Artificial Intelligence in State Government Services Commission to report to the Legislature on the commission’s recommended minimum standards for the use of AI that includes specified information. (Pending in the Assembly Privacy and Consumer Protection Committee)
SB 730 (Stern, 2019) would establish the Commission on the Future of Work and require the Commission to conduct research to understand the impact of technology on workers, employers, and the economy of the state. (Pending in Senate Labor, Public Employment and Retirement Committee)
AB 976 (Chau, 2019) would establish the Artificial Intelligence in State Government Services Commission comprised of eight members, as specified, and would require the advisory commission to convene a public process to gather input on how AI and data science could be used to improve state services. (Pending in the Assembly Privacy and Consumer Protection Committee)
AB 1576 (Calderon, 2019) would require, until January 1, 2023, the Secretary of Government Operations to appoint an AI working group on or before July 1, 2020. (Pending in the Assembly Privacy and Consumer Protection Committee)
AB 375 (Chau, Chapter 55, Statutes of 2018) provided consumers the right to access their personal information that is collected by a business, the right to delete it, the right to know what personal information is collected, the right to know whether and what personal information is being sold or disclosed, the right to stop a business from selling their information, and the right to equal service and price.
AB 2596 (Cooley, 2018) would have required the Governor’s Office of Business and Economic Development to take the lead in preparing a California Economic Development Strategic Action Plan to identify economic challenges and provide a set of actions to address the shifting economic landscape, changing demographics, and unique strengths of California’s industries, businesses, workers, and entrepreneurs. (Vetoed by Governor Brown)
AB 2658 (Calderon, Chapter 875, Statutes of 2018) required the Secretary of the Government Operations Agency to appoint a blockchain group to evaluate the use of the technology.
AB 531 (Irwin, 2017) would have required the Office of Information Security (OIS), on or before July 1, 2019, to review information security technologies currently in place in state agencies to determine if there are sufficient policies, standards, and procedures in place to protect critical government information and prevent the compromise or unauthorized disclosure of sensitive digital content, as defined, inside or outside the firewall of state agencies. (Vetoed by Governor Brown)
FISCAL EFFECT: Appropriation: No Fiscal Com.: Yes Local: No
SUPPORT:
Little Hoover Commission
OPPOSITION:
None received
ARGUMENTS IN SUPPORT: According to the Little Hoover Commission, “in its 2018 Report, Artificial Intelligence: A Roadmap for California, the Commission noted strides made by California state government to use modern technology to improve internal and external operations and services, but concluded the government as a whole was ill-prepared for the inevitable brought by AI. SB 348 would help California establish clear leadership to focus on the development and use of AI technology.”
Bill Author
Bill Co-Author(s):