Windows Notepad is finally getting some new features
Microsoft wants to pack GPT technology into just about every service and app it owns these days, and other tech companies are eager to integrate GPT models into various services. But what happens when you put all of GPT-2 inside an Excel spreadsheet? Rather than a tool for performing tasks or coding, you end up with a teaching tool.
According to Ishan Anand, the software developer behind "spreadsheets are all you need," "if you can understand a spreadsheet, then you can understand AI!" Those aren't just empty marketing words either. Anand placed the entirety of GPT-2 inside an Excel spreadsheet to illustrate how AI functions. Specifically, GPT-2 small has been packed inside of Excel to teach how AI works.
As you would expect from a sheet that holds an entire GPT model, you may run into issues when navigating the spreadsheet. "Unfortunately, it is not unusual for Excel to lock up (but only on a Mac) while using this spreadsheet," said Anand. "It is highly recommended to use the manual calculation mode in Excel and the Windows version of Excel (either on a Windows directory or via Parallels on a Mac)."
Anand has a series of lessons that use the spreadsheet to illustrate how AI works. The videos break things down in a way that makes it much easier to stand how a model receives information, categorizes it, and then acts. You can download the spreadsheet used by Anand through GitHub.
The first lesson is a 10-minute video called Demystifying GPT with Excel. The video illustrates how GPT-2 processes information, providing insight into how models function and process information. The second lesson goes deeper into detail, including explaining the tokenization phase and the Byte Pair Encoding algorithm that's used in models like ChatGPT.
Anand has an extra lesson that goes even deeper to explain how he used Excel throughout his lessons.
GPT-2 is a precursor to more powerful GPT tech, such as GPT-4 Turbo that now powers the free version of Microsoft Copilot. GPT-2 was around before "chat" was added to a GPT model.
Via: Windows Central
