Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesCopyBotsEarn
A new wave of black market chatbots emerges and thrives

A new wave of black market chatbots emerges and thrives

CryptopolitanCryptopolitan2024/09/04 16:00
By:By Enacy Mapakame

Share link:In this post: Illicit LLMs can make as much as $28,000 in two months for their creators. These are “powerhouses” of creating phishing emails and dodging spam detectors and antivirus software. According to a study, these also manipulate the legally registered LLMs.

Black market chatbots have become one of the latest trends emerging in the AI sector and are thriving as malicious large language models (LLMs) earn money for their creators.

An American study has found that there is a thriving AI black market where unregistered LLMs are making a killing selling their services underground. Registered and public-facing companies like OpenAI, Perplexity, and other large corporations offering the same services have regulatory prescriptions they follow.

The underground LLMs can dodge antiviruses

The study, which focused mainly on Malla, an ecosystem that thrives on bastardizing legal LLMs and AI platforms for profit, scrutinized 212 black-market LLMs listed on underground marketplaces between April and October 2023, assessing their attributes.

One of the authors, Zilong Lin from Indiana University, said:

“We found that most of the mala services on underground forums exist mainly to earn profit.”

The study also found that some platforms are making as much as $28,000 in two months from subscriptions and purchases from people who want to escape the confines of regulated AI.

Some, like DarkGPT and EscapeGPT, are just jailbreak derivatives of duly licensed LLMs that are being used legally.

A separate study has also shown that these illicit LLMs can be used for many tasks, like creating phishing emails. For instance, DarkGPT and EscapeGPT could create correct codes nearly 75% of the time, but antiviruses could not pick these codes.

See also Microsoft confirms Windows 11 Recall AI glitch in latest update

Another model known as WolfGPT was seen as a “powerhouse” for creating phishing emails and dodging spam detectors.

According to Andrew Hundt, an expert in computing innovation at Carnegie Mello University, the booming AI underground market should be a cause for concern.

He called for a legal requirement that compels companies developing LLMs to have robust systems that prevent replication by people with sinister motives.

“We also need legal frameworks to ensure that companies that create these models and provide services do so more responsibly in a way that mitigates the risks posed by malicious actors,” said Hundt.

Understanding how black market chatbots function is key

Professor Xiaofeng Wang from Indiana University, who was part of the study, said it is important to understand how these black market LLMs are working so that the solutions will be specific to the issues identified.

Professor Wang added that the manipulation of these LLMs could not be avoided, which creates scope for the sector to come up with strong guardrails to minimize potential harm executed through cyberattacks in all its forms.

“We believe now is a good stage to start to study these because we don’t want to wait until the big harm has already been done.”

Professor Wang.

According to the professor, every tech, including LLMs, comes in two ways: the good and the bad side.

See also Clearview AI faces a heavy fine in Netherlands for privacy violations

Cybersecurity experts are already calling on the AI industry to slow down in its race and reflect on the growing dangers of their technology being adulterated by anonymous internet communities.

A Forbes article published late last year said there should be a responsible introduction of new ideas, especially around LLMs. It also emphasized on the role of regulation in promoting responsible AI innovations unlike the misconception that regulation stifles development.

“Developers and providers of LLMs need to hit pause on a frantic arms race that aims to churn out ever more complex models and should instead work with regulators on adopting frameworks for the ethical design and use of generative AI applications,” read part of the report.

Now, with regulatory loopholes, the AI black market is also fast growing into a multimillion-dollar industry and may need extensive resources to contain, according to Fast Company.

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Locked for new tokens.
APR up to 10%. Always on, always get airdrop.
Lock now!

You may also like

What Will Happen in the Bitcoin Price in the Coming Days? Has the Peak Been Reached or Is There Still Room to Rise? Here are the Opinions of the Anal

What kind of price movements will Bitcoin, the world's largest cryptocurrency, experience in the coming days? Here are the opinions.

Bitcoinsistemi2024/11/29 07:00

This Artificial Intelligence Robot Keeps 40.000 Dollars in His Wallet: It Will Send It All To Whoever Convinces It

In the cryptocurrency world, different applications continue to emerge every day. This time, an artificial intelligence robot is on the agenda.

Bitcoinsistemi2024/11/29 07:00

How Much Will Bitcoin Price Be in 2026? Analyst Reveals Prediction on Live Stream

Cryptocurrency analyst Mark Palmer made a statement predicting the Bitcoin price for 2026. Here are the details.

Bitcoinsistemi2024/11/29 07:00