If all you want to have is the part that philosophizes and solves abstract problems and whatnot then you may not actually need all that much horsepower.
Just massive data centers requiring tons of energy and cooling, with a model developed by human brains and trained on all of human knowledge these developers can get their hands on, painstakingly labeled by vast teams of people so that the model can spit out seemingly correct answers.
ls the AI actually philosophizing and solving abstract problems or is it merely regurgitating philosophies and solutions that exist within its training set?
Still, it required humans to apply the finishing touches.
“The raw output of ChatGPT’s proof was actually quite poor. So it required an expert to kind of sift through and actually understand what it was trying to say,” Jared Lichtman, a mathematician at Stanford University whose doctoral thesis centered on one Erdős’s conjectures, told SciAm.
Just massive data centers requiring tons of energy and cooling, with a model developed by human brains and trained on all of human knowledge these developers can get their hands on, painstakingly labeled by vast teams of people so that the model can spit out seemingly correct answers.
ls the AI actually philosophizing and solving abstract problems or is it merely regurgitating philosophies and solutions that exist within its training set?
It’s actually solving abstract problems.
Also, local models are available that are quite good and run on a standard consumer-grade GPU.
One problem and…