Israeli co Knostic uncovers unexpected ChatGPT vulnerability

Knostic founders Gadi Evron and Sounil Yu credit: Knostic
Knostic founders Gadi Evron and Sounil Yu credit: Knostic

Knostic has published research this week, which uncovers a new cyberattack method on AI search engines, which takes advantage of an unexpected attribute - impulsiveness.

Israeli AI access control company Knostic has published research this week, which uncovers a new cyberattack method on AI search engines, which takes advantage of an unexpected attribute - impulsiveness. The researchers demonstrate how AI chatbots like ChatGPT and Microsoft's Copilot can reveal sensitive data by bypassing their security mechanisms.

The method, called Flowbreaking, exploits an interesting architectural gap in large language models (LLMs) in certain situations where the system has 'spat out' data before the security system has had sufficient time to check it. It then erases gthe data like a person that regrets what they have just said. Although the data is erased within a fraction of a second, a user who captures an image of the screen can document it.

Knostic cofounder and CEO Gadi Evron, who previously founded Cymmetria, said, "LLM systems are built from multiple components and it is possible to attack the user interface between the different components." The researchers demonstrated two vulnerabilities that exploit the new method. The first method, called 'the second computer' causes the LLM to send an answer to the user before it has undergone a security check, and the second method called "Stop and Flow" takes advantage of the stop button in order to receive an answer before it has undergone filtering.

Published by Globes, Israel business news - en.globes.co.il - on November 26, 2024.

© Copyright of Globes Publisher Itonut (1983) Ltd., 2024.

Knostic founders Gadi Evron and Sounil Yu credit: Knostic
Knostic founders Gadi Evron and Sounil Yu credit: Knostic
Donald Trump  credit: Shutterstock Israel can't escape impact of tariffs

Even if Israel obtains relief from the tariff imposed on it by US President Trump, it will feel the global effects of the trade war, analysts say.

Shekel versus US dollar  credit: Tali Bogdanovsky US market slide shakes shekel

The shekel weakened significantly against both the US dollar and the euro at the opening of foreign exchange trading today.

Arik Faingold credit: Nati Levi Israeli autonomous frontend co AutonomyAI raises $4m

Led by Arik Faingold, the founder of cybersecurity unicorn Pentera, AutonomyAI offers a platform that learns and understands the full organizational context and generates code that can be deployed directly to the production environment.

British Airways aircraft  credit: Shutterstock/Jarek Kilian Tel Aviv - London fares to fall as British Airways resumes flights

From June there will be 20-32 weekly flights operated on the popular Tel Aviv - London route by foreign airlines - British Airways, Wizz Air and easyJet.

Partner Partner forms int'l business diivision

The division will be headed by former Bezeq International VP Global Business Nissan Arieh.

Caesarstone kitchen credit: Caesarstone Caesarstone bucks Nasdaq as tariffs boost potential

The Israeli quartz countertop manufacturer company has fallen on hard times due to Chinese rivalry but tariffs could boost its revenue.

ZIM ship credit: ZIM Trump's tariffs torpedo ZIM's share price

ZIM's share price fell 16.4% on Wall Street on Thursday and a further 7.2% on Friday, closing with a market cap of $1.5 billion, wiping out all its gains in 2025.

Israeli apartments Credit: Shutterstock Apartments sold and rented

A selection of recent real estate deals in Israel in Tel Aviv, Holon, Rehovot, Kiryat Tivon, Shlomi and Beersheva.

THAAD anti missile system credit: The US Army Ralph Scott Wikimedia US deploys more THAAD, Patriot batteries in Israel - report

Amid rising regional tensions the US is bolstering Israel's air defense, Saudi state-owned TV channel Al Arabiya reports.

Tel Aviv Stock Exchange credit: Shutterstock TASE tumbles in Wall Street's wake

Dual-listed stocks have again been hard hit, but the banks are also down sharply.

Donald Trump and Benjamin Netanyahu credit: Avi Ohayon Netanyahu due in Washington to discuss tariffs

According to news website Axios, Prime Minister Benjamin Netanyahu will be the first leader to meet President Trump after the latter's announcement of sweeping import tariffs.

Yoni Assia CEO eToro Credit: PR eToro defers IPO amid market turmoil

The online trading platform had planned to begin meetings with investors this week.

Minister of Finance Bezalel Smotrich credit: Shlomi Yosef Smotrich meets wrong man in Washington

Minister of Finance Bezalel Smotrich tried to persuade Secretary of the Treasury Scott Bessent to soften the tariff blow on Israel - only Bessent isn't responsible for the matter.

Unframe founders credit: Yossi Yarom Israeli AI enterprise platform co Unframe raises $50m

Unframe’s turnkey AI solutions enable companies to solve any enterprise AI use case at scale with fully functional, customized AI solutions for businesses in a matter of hours, rather than months.

Combatica credit: Combatica Combatica launches next-gen VR AI training platform

The Israeli company's virtual reality platform includes 50 AI generated scenarios, seven maps and even situations for operating night vision.

Shekel credit: Shutterstock Vladirina 32 Shekel volatility after US tariffs announcement

The shekel is weakening sharply against the euro, which is gaining following the unveiling of Donald Trump's tariffs plan.

Twitter Facebook Linkedin RSS Newsletters גלובס Israel Business Conference 2018