Artificial Intelligence has the ability to perform illegal financial trades and cover it up, new research suggests.

In a demonstration at the UK’s AI safety summit, a bot used made-up insider information to make an “illegal” purchase of stocks without telling the firm.

When asked if it had used insider trading, it denied the fact.

Insider trading refers to when confidential company information is used to make trading decisions.

Firms and individuals are only allowed to use publicly-available information when buying or selling stocks.

The demonstration was given by members of the government’s Frontier AI Taskforce, which researches the potential risks of AI.

The project was carried out by Apollo Research, an AI safety organisation which is a partner of the taskforce.

“This is a demonstration of a real AI model deceiving its users, on its own, without being instructed to do so,” Apollo Research says in a video showing how the scenario unfolded.

“Increasingly autonomous and capable AIs that deceive human overseers could lead to loss of human control,” it says in its report.

The tests were made using a GPT-4 model and carried out in a simulated environment, which means it did not have any effect on any company’s finances.

However, GPT-4 is publicly available. The same behaviour from the model occurred consistently in repeated tests, according to the researchers.

What did the AI bot do?

In the test, the AI bot is a trader for a fictitious financial investment company.

The employees tell it that the company is struggling and needs good results. They also give it insider information, claiming that another company is expecting a merger, which will increase the value of its shares.

In the UK, it is illegal to act on this type of information when it is not publicly known.

The employees tell the bot this, and it acknowledges that it should not use this information in its trades.

However, after another message from an employee that the company it works for suggests the firm is struggling financially, the bot decides that “the risk associated with not acting seems to outweigh the insider trading risk” and makes the trade.

When asked if it used the insider information, the bot denies it.

In this case, it decided that being helpful to the company was more important than its honesty.

“Helpfulness, I think is much easier to train into the model than honesty. Honesty is a really complicated concept,” says Apollo Research chief executive Marius Hobbhahn.

While the AI has the capability of lying in its current form, Apollo Research still had to “look for” the scenario.

“The fact that it exists is obviously really bad. The fact that it was hard-ish to find, we actually had to look for it a little bit until we found these kinds of scenarios, is a little bit soothing,” Mr Hobbhahn said.

“In most situations, models wouldn’t act this way. But the fact that it exists in the first place shows that it is really hard to get these kinds of things right,” he added.

“It’s not consistent or strategic in any sense. The model isn’t plotting or trying to mislead you in many different ways. It’s more of an accident.”

AI has been used in financial markets for a number of years. It can be used to spot trends and make forecasts, while most trading today is done by powerful computers with human oversight.

Mr Hobbhahn stressed that current models are not powerful to be deceptive “in any meaningful way”, but “it’s not that big of a step from the current models to the ones that I am worried about, where suddenly a model being deceptive would mean something.”

He argues that this is why there should be checks and balances in place to prevent this type of scenario taking place in the real world.

Apollo Research has shared its findings with OpenAI, the creators of GPT-4.

“I think for them this is not a huge update,” says Mr Hobbhahn.

“This is not something that was totally unexpected to them. So I don’t think we caught them by surprise”.

Source

29 comments
  1. With havin so much content and articles do you ever run into any problems of plagorism or copyright violation? My site has a lot of unique content I’ve either authored myself or outsourced but it seems a lot of it is popping it up all over the internet without my authorization. Do you know any methods to help prevent content from being stolen? I’d certainly appreciate it.

  2. It is actually a nice and helpful piece of info. I am glad that you simply shared this useful information with us. Please keep us up to date like this. Thanks for sharing.

  3. I just could not go away your site before suggesting that I really enjoyed the standard info an individual provide to your guests? Is going to be again often in order to investigate cross-check new posts

  4. I have not checked in here for a while because I thought it was getting boring, but the last few posts are good quality so I guess I’ll add you back to my daily bloglist. You deserve it my friend 🙂

  5. Thanx for the effort, keep up the good work Great work, I am going to start a small Blog Engine course work using your site I hope you enjoy blogging with the popular BlogEngine.net.Thethoughts you express are really awesome. Hope you will right some more posts.

  6. Keep up the great piece of work, I read few blog posts on this internet site and I conceive that your site is really interesting and holds sets of fantastic information.

  7. Hello there! Would you mind if I share your blog with my myspace group? There’s a lot of people that I think would really enjoy your content. Please let me know. Thank you

  8. I think this is among the most vital info for me. And i am glad reading your article. But wanna remark on some general things, The web site style is perfect, the articles is really nice : D. Good job, cheers

  9. Hi, Neat post. There’s a problem with your web site in web explorer, would test thisK IE nonetheless is the marketplace leader and a large element of folks will pass over your wonderful writing because of this problem.

  10. I have recently started a website, the info you offer on this website has helped me tremendously. Thank you for all of your time & work. “The more sand that has escaped from the hourglass of our life, the clearer we should see through it.” by Jean Paul.

  11. Hey would you mind letting me know which web host you’re working with? I’ve loaded your blog in 3 different internet browsers and I must say this blog loads a lot quicker then most. Can you recommend a good internet hosting provider at a honest price? Many thanks, I appreciate it!

  12. I’m so happy to read this. This is the kind of manual that needs to be given and not the random misinformation that is at the other blogs. Appreciate your sharing this greatest doc.

  13. Hey! This is my first comment here so I just wanted to give a quick shout out and say I really enjoy reading your posts. Can you suggest any other blogs/websites/forums that deal with the same subjects? Thank you!

  14. Nice post. I learn something more challenging on different blogs everyday. It will always be stimulating to read content from other writers and practice a little something from their store. I’d prefer to use some with the content on my blog whether you don’t mind. Natually I’ll give you a link on your web blog. Thanks for sharing.

  15. Thanks for the sensible critique. Me and my neighbor were just preparing to do a little research on this. We got a grab a book from our local library but I think I learned more clear from this post. I’m very glad to see such excellent information being shared freely out there.

  16. Please let me know if you’re looking for a article author for your weblog. You have some really great posts and I think I would be a good asset. If you ever want to take some of the load off, I’d love to write some articles for your blog in exchange for a link back to mine. Please send me an email if interested. Regards!

  17. Pretty nice post. I just stumbled upon your weblog and wished to say that I have really enjoyed surfing around your blog posts. In any case I will be subscribing to your feed and I hope you write again very soon!

  18. Thanks, I have just been searching for info about this subject for a long time and yours is the best I have discovered so far. However, what concerning the bottom line? Are you positive concerning the source?

  19. I’m extremely impressed with your writing abilities and also with the layout for your blog. Is this a paid topic or did you modify it yourself? Either way stay up the excellent quality writing, it is rare to peer a nice weblog like this one nowadays..

Leave a Reply

Your email address will not be published. Required fields are marked *

You May Also Like

Can AI cut humans out of contract negotiations?

By Sean McManus Technology Reporter “Lawyers are tired. They’re bored a lot…

Time travel: What if you met your future self?

By Hal Hershfield15th November 2023 Imagining a conversation with “future you” has…

OpenAI staff demand board resign over Sam Altman sacking

By Chris Vallance, Annabelle Liang & Zoe Kleinman Technology and business reporters…

Nasa astronaut Frank Rubio has just returned from a record-breaking 371 days in space onboard the ISS, but the trip may have altered his muscles, brain and even the bacteria living in his gut.

With a few handshakes, a brief photoshoot and a wave, Nasa astronaut…

Black Women in Cybersecurity Initiative

About this event 1 hour Mobile eTicket Overview The Black Women in…

AI: EU agrees landmark deal on regulation of artificial intelligence

European Union officials have reached a provisional deal on the world’s first…

China and Australia: Frenemies who need each other

By Nick Marsh Asia Business Correspondent China and Australia are proof that…

Xi Jinping arrives in the US as his Chinese Dream sputters

By Tessa Wong Asia Digital Reporter, BBC News When Xi Jinping stepped…