Sõpruse pst, 10615, Tallinn, Estonia +372-55650441

Announcements

No announcements yet

New blog posts

Completion of Workshop on Water Recling Simulation and Modelling: Unlocking the Future of Water Management
Completion of Workshop on Water Recling Simulation and Modelling: Unlocking the Future of Water Management

19 March, 2024 by Charlotte Lee

We are thrilled to announce the successful...

IJITIS Journal Meeting and SWOT Analysis at TULTECH
IJITIS Journal Meeting and SWOT Analysis at TULTECH

15 January, 2024 by Charlotte Lee

Greetings, TULTECH community! In our...

A Milestone Meeting for EIL: Shaping the Future of Environmental Industry Letters
A Milestone Meeting for EIL: Shaping the Future of Environmental Industry Letters

15 December, 2023 by Charlotte Lee

Dear TULTECH Community, We are delighted to...

View all blog entries →

Journals

Weather

Clear

13°C

Clear in Tallinn

Calendar of Events

Closest Events
All events on this day

Psychologists have shown that GPT-3 has the same level of reasoning ability as a college student

Posted on 4 August, 2023 by Charlotte Lee

Psychologists have shown that GPT-3 has the same level of reasoning ability as a college student

Summary:

Standardised test-like logic problems were no match for the artificial intelligence language model GPT-3, which performed as well as college students. The experiment's authors argue that their findings raise the question of whether the technology is emulating human thinking or employing a novel cognitive mechanism. To get an answer, you'd need to go inside the code that powers GPT-3 and other AI programmes.
 

UCLA psychologists have shown that the AI language model GPT-3 does as well as college freshmen when presented with the types of reasoning difficulties normally seen in IQ testing and standardised exams like the SAT. Nature Human Behaviour has published the study.
However, the authors of the publication state that the research prompts the following question: Is GPT-3 employing a fundamentally different form of cognitive process, or is it just a result of its large language training dataset that makes it behave like a human brain?
Since OpenAI, the business that developed GPT-3, is protecting its secretive inner workings, the scientists at UCLA cannot definitively comment on the nature of GPT-3's reasoning skills. They also note that despite GPT-3's impressive performance in some areas of reasoning, the widely used AI tool still falls short in others.
"It's important to emphasise that this system has major limitations," said Taylor Webb, the study's first author and a postdoctoral researcher in psychology at UCLA.
Forty first-year students at UCLA were given the identical issues to tackle by the researchers.
According to the study's principal author and UCLA psychology professor Hongjing Lu: "Surprisingly, not only did GPT-3 do about as well as humans but it made similar mistakes as well."
GPT-3 was successful at solving 80% of the questions, which is above the average score of slightly around 60% for human participants and within the range of the top human scores.
The only way to find out is to gain access to the programme and the data used to train the software, and then to give the software tests that it hasn't already been given, which is a daunting task. They claimed it would be the next stage in determining the proper direction for AI.

Webb said that "having the backend to GPT models would be very useful for AI and cognitive researchers." To paraphrase, "We're just doing inputs and getting outputs, and it's not as decisive as we'd like it to be."

 

source: sciencedaily.com/releases/2023/07/230731110750.htm


Today In History

Here are some interesting facts ih history happened on 2 July.

  1. French astrologer physician & prophet Nostradamus dies in Salon
  2. Battle of Marston Moor; Parliamentary forces defeat royalists.
  3. William Gascoigne introducer of telescopic sights is killed at 24
  4. Continental Congress passes resolution saying `these United Colonies Care & of right ought to be Free & Independent States'
  5. partial emancipation of Russian serfs.
  6. Pres Garfield shot by Charles J Guiteau a disappointed office-seeker Garfield died the following September
  7. Sherman Antitrust Act prohibits industrial monopolies.
  8. 1st flight of a Zeppelin (the LZ-1).
  9. Yanks win by forfeit for their 1st time
  10. US Army Air Corps created
  11. Carl Hubbell shutsout Cards 1-0 in 18 innings
  12. Amelia Earhart & Fred Noonan disappeared over the Pacific Ocean
  13. DiMaggio breaks Willie Keeler's 44 game hitting streak
  14. Lawrence Welk Show premiers on ABC television
  15. 1st sub powered by liquid metal cooled reactor completed-The Seawolf
  16. 1st submarine designed to fire guided missiles launched Grayback
  17. Maris hits his 29th & 30th of 61 homers
  18. Ernest Hemingway shot himself to death in Ketchum Idaho
  19. Pres Johnson signs the Civil Rights Act.
  20. Supreme Court ruled death penalty not inherently cruel or unusual
  21. Sweden's Bjorn Borg won Wimbeldon men's singles over Jimmy Connors
  22. Pitcher Ron Guidry sets Yankee record of 13-0 start
  23. Soyuz T-6 returns to Earth
  24. Proto launched on its way to Halley's Comet
  25. The Supreme Court upheld affirmative action in 2 rulings
  26. Chorus Line Director Michael Bennet dead of aids at 44
  27. Accused Nazi Karl Linnas died of heart failure in Russia