ChatGPT May Leak Trade Secrets

Apr 19, 2023|

Companies using generative artificial intelligence such as ChatGPT may leak customer information and business secrets as a result, according to a new report from Israeli cybersecurity firm Team8.

  

The report said that the widespread adoption of new artificial intelligence chatbots and collaboration tools may expose some companies to data breaches and legal risks. They worry that hackers may use chatbots to obtain sensitive corporate information or launch attacks on businesses. In addition, the confidential information currently fed to chatbots may also be used by artificial intelligence companies in the future.

  

Large technology companies including Microsoft and Alphabet are scrambling to improve chatbots and search engines with generative artificial intelligence technology, using data obtained from the Internet to train their models, so as to provide users with a one-stop question-and-answer service. If the tools are fed with classified or private data, it will be difficult to remove the information in the future, the report said.

The report reads: “Sensitive information, intellectual property, source code, trade secrets and other data of enterprises using generative artificial intelligence may be obtained and processed by others through channels such as direct user input or API, including customer information. or private and confidential information." Team8 marked this risk as "high risk". They believe the risk is "manageable" if appropriate precautions are taken.

 

Microsoft corporate vice president Ann Johnson (Ann Johnson) participated in the drafting of the report. Microsoft invested billions of dollars in OpenAI, the developer of ChatGPT.

  

A Microsoft spokesperson said: "Microsoft encourages transparent discussions about cyber risks in the security and artificial intelligence fields."

  

The popularity of the ChatGPT chatbot developed by OpenAI has sparked calls for regulation. There are concerns that the innovation could also be used for nefarious purposes as companies try to use the technology to increase efficiency.

  

U.S. Federal Trade Commission (FTC) officials said on Tuesday that the agency will focus on companies that misuse artificial intelligence technology to violate anti-discrimination laws or engage in deceptive practices.

 

FTC Chairman Lina Khan and commissioners Rebecca Slaughter and Alvaro Bedoya attended a hearing in Congress where they were asked about their relationship with the Concerns about recent AI innovations. The technology could be used to create high-quality "deep fakes," which could lead to more deceptive scams, as well as other illegal activities.

  

Bedoya said that companies using algorithms or artificial intelligence must not violate civil rights laws, nor must they violate the regulations to take unfair or deceptive behavior. He stated that the black box cannot be an excuse for not being able to explain the algorithm.

Send Inquiry