AI marketing is a con - especially when it comes to CPUs

Date:
Sun, 20 Oct 2024 10:00:00 +0000

Description:
Look we get it, its the new buzz word but you dont need to strap it to everything

FULL STORY ======================================================================

Artificial intelligence is increasingly making its presence felt in more
areas of our lives, certainly since the launch of ChatGPT . Depending on your view, its that big bad bogeyman thats taking jobs and causing widespread copyright infringement, or a gift with the potential to catapult humanity
into a new age of enlightenment.

What many have achieved with the new tech, from Midjourney and LLMs to smart algorithms and data analysis, is beyond radical. Its a technology that, like most of the silicon-based breakthroughs that came before it, has a lot of potency behind it. It can do a lot of good, but also, many fear, a lot of
bad. And those outcomes are entirely dependent on how its manipulated, managed, and regulated.

Its not surprising then, given how rapidly AI has forced its way into the zeitgeist, that tech companies and their sales teams are equally leaning into the technology, stuffing its various iterations into their latest products, all in the aim of encouraging us to buy their hardware.

Check out this new AI powered laptop , that motherboard that utilizes AI to overclock your CPU to the limit, those new webcams featuring AI deep-learning tech. You get the point. You just know that from Silicon Valley to Shanghai, share-holders and company execs are asking their marketing teams How can we get AI into our products?" in time for the next CES or the next Computex, no matter how modest the value will actually be for us consumers.

My biggest bugbear comes in the form of the latest generation of CPUs being launched by the likes of AMD, Intel, and Qualcomm. Now, these arent bad products, not by a long shot. Qualcomm is making huge leaps and bounds in the desktop and laptop chip markets , and the performance of both Intel and AMDs latest chips is nothing if not impressive. Generation on generation, were seeing higher performance scores, better efficiency, broader connectivity, lower latencies, and ridiculous power savings (heres looking at you, Snapdragon), among a whole slew of innovative design changes and choices. To most of us mere mortals, its magic way beyond the basic 0s and 1s.

Despite that, we still get AI slapped onto everything regardless of whether
or not its actually adding anything useful to a product. We have new neural processing units (NPUs) added to chips, which are co-processors that are designed to accelerate low-level operations that can take advantage of AI. These are then put into low-powered laptops, allowing them to use advanced AI features such as Microsofts Copilot assistant to tick that AI checkbox, as if it makes a difference to a predominantly cloud-based solution.

The thing is though, CPU performance, when it comes to AI, is insignificant. Like seriously insignificant, to the point its not even mildly relevant. Its like trying to launch NASAs JWST space telescope with a bottle of Coke and some Mentos. Everythings an AI powered this or that these days (Image credit: Future) Emperor's new clothes?

Ive spent the last month testing a raft of laptops and processors, specifically in regard to how they handle artificial intelligence tasks and apps. Using ULs Procyon benchmark suite (makers of the 3D Mark series), you can run its Computer Vision inference test, and that can spit out a nice number for you, giving you a score for each component. Intel Core i9-14900K? 50. AMD Ryzen 9 7900X? 56. 9900X? 79 (thats a 41% performance increase, by
the way, gen-on-gen, seriously huge).

Heres the thing though: chuck a GPU through that same test, such as Nvidias RTX 4080 Super , and it scores 2,123. Thats a 2,587% performance increase compared to that Ryzen 9 9900X, and thats not even using Nvidias own TensorRT SDK, which scores even higher than that.

The simple fact of the matter is that AI demands parallel processing performance like nothing else, and nothing does that better than a graphics card right now. Elon Musk knows this hes just installed 100,000 Nvidia H100 GPUs in xAIs latest AI training system. Thats more than $1 billion worth of graphics cards in a single supercomputer. Obscured by clouds

To add insult to injury, the vast majority of popular AI tools today require cloud computing to fully function anyway.

LLMs (large language models) like ChatGPT and Google Gemini require so much processing power and storage space that its impossible to run them on a local machine. Even Adobes Generative Fill and AI smart filter tech in the latest versions of Photoshop require cloud computing to process images. Large language models just require too much processing power to function on your home rig, sorry (Image credit: Google)

Its just not feasible or possible to really run the vast majority of these AI programs that are so popular today on your own home machine. There are exceptions, of course; certain AI image-generation tools are far easier to operate on a solo machine, but still, youre far better off using cloud computing to process it in 99% of use cases.

The one big exception to this rule is localized upscaling and super-sampling. Things like Nvidias DLSS and Intels XeSS, and even to a lesser extent AMDs
own FSR (although this is predominantly based on deep-learning models,
applied via rasterization hardware, meaning you dont need AI componentry) are fantastic examples of a good use of localized AI. Otherwise though, youre basically out of luck.

Yet still, here we are. Another week, another AI-powered laptop, another AI chip, much of which, in my opinion, amounts to a lot of fuss about nothing.

You might also like... Google's AI Overviews goes global, hopefully without the rock-eating suggestions Has Meta finally broken the Google Glass curse with its next-gen Orion glasses? AI is not the problem but regulation might
be a big one according to one Godfather of AI



======================================================================
Link to news story: https://www.techradar.com/computing/artificial-intelligence/ai-marketing-is-a- con-especially-when-it-comes-to-cpus


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)