GPT-4, the latest version of the ChatGPT artificial intelligence chatbot, can pass high school tests and law exams with scores in the 90th percentile and has new processing capabilities that were not possible with the previous version.
The figures of the GPT-4 test results were shared on March 14 by the creator OpenAIrevealing that it can also convert image, audio, and video input to text, as well as handle “much more nuanced instructions” more creatively and reliably.
“Pass a mock bar exam with a score in the top 10% of the test takers,” adds OpenAI. “In contrast, the GPT-3.5 score was in the bottom 10%.”
The figures show that GPT-4 scored 163 in the 88th percentile on the LSAT, the test that college students must pass in the United States to be admitted to law school.
GPT4 score would put you in a good position for admission to a top 20 law school and he only lacks a few notes to reach the necessary scores to be admitted to such prestigious faculties as Harvard, Stanford, Princeton or Yale.
The previous version of ChatGPT only scored 149 points on the LSATwhich puts it in the bottom 40%.
GPT-4 also scored 298 out of 400 on the Uniform Bar Examination (UBE).a test taken by recently graduated law students that allows them to practice as lawyers in any jurisdiction in the United States.
The old version of ChatGPT struggled in this test, finishing in the bottom 10% with a score of 213 out of 400..
Looking at the SAT Evidence-Based Reading & Writing and SAT Math tests that US high school students take to measure their readiness for college, GPT-4 scored in the 93rd and 89th percentile, respectively.
The GPT-4 also excelled in the “hard” sciences, with scores well above average in AP Biology (85-100%), Chemistry (71-88%), and Physics 2 (66-84%)..
However, his AP Calculus score was fairly average, falling between the 43rd and 59th percentile.
Another area where GPT-4 was lacking was in the English Literature exams: it scored between the 8th and 44th percentile. in two different tests.
OpenAI said that GPT-4 and GPT-3.5 took these tests from the 2022-2023 practice exams, and that “no specific training” was taken by the language processing tools:
“We did not do any specific training for these exams. A minority of the problems in the exams were seen by the model during training, but we believe the results are representative.”
The results also sparked fear in the Twitter community..
Nick Almond, Founder of FactoryDAO, told them to his 14,300 Twitter followers on March 14 that GPT4 is going to “scare people” and “crash” the world’s education system.
Assessment theory was a big chunk of my life for several years. I was banging on about this day coming many years ago. I literally sounded like the resident crank at the time.
But… really this means that anything but invigilated assessment is over from this point on.
— drnick ️² (@DrNickA) March 14, 2023
Assessment theory was an important part of my life for several years. For many years I insisted that that day would come. He literally looked like the madman of the time. But… this really means that everything other than proctored evaluation is over from now on.
The former head of Coinbase Conor Grogan said he inserted a live Ethereum smart contract into GPT-4, and the chatbot instantly pointed out various “security vulnerabilities” and outlined how the code could be exploited.:
I dumped a live Ethereum contract into GPT-4.
In an instant, it highlighted a number of security vulnerabilities and pointed out surface areas where the contract could be exploited. It then verified a specific way I could exploit the contract pic.twitter.com/its5puakUW
— Conor (@jconorgrogan) March 14, 2023
I entered an active Ethereum contract on GPT-4. In an instant, it highlighted a number of security vulnerabilities and pointed to surface areas where the contract could be exploited. He then checked out a specific way he could exploit the contract pic.twitter.com/its5puakUW
Previous smart contract audits on ChatGPT found that its first version was also capable of detecting code errors to a reasonable degree.
Rowan Cheung, founder of AI newsletter The Rundown, shared a video of GPT transcribing a fake website hand-drawn on a piece of paper into code..
I just watched GPT-4 turn a hand-drawn sketch into a functional website.
This is insane. pic.twitter.com/P5nSjrk7Wn
— Rowan Cheung (@rowancheung) March 14, 2023
I’ve just seen GPT-4 turn a hand-drawn sketch into a working website. This is crazy. pic.twitter.com/P5nSjrk7Wn
Clarification: The information and/or opinions expressed in this article do not necessarily represent the views or editorial line of Cointelegraph. The information presented here should not be taken as financial advice or investment recommendation. All investment and commercial movement involve risks and it is the responsibility of each person to do their due research before making an investment decision.
Investments in crypto assets are not regulated. They may not be suitable for retail investors and the entire amount invested may be lost. The services or products offered are not directed or accessible to investors in Spain.