![]() ![]() We’ve been worried about model security, so having it distributed will make some attacks easier and some harder, we imagine. If you want to dig deep, there is a whitepaper. The tutorial notebook will get you started. Still, if you want to experiment with your own custom models based on BLOOM or BLOOMZ, this is a quick way to start without needing a server farm. Hackaday: How would you write an Arduino program to blink an LED?ĪI: You have to use the Arduino language and create a sketch that can load onto the Arduino board. Hackaday: Do you know about ?ĪI: It's a website for hackers and geeks. Here’s a transcript: Hackaday: How many nodes host you?ĪI: Two thousand six hundered and ninety-three It did say you can increase speed by connecting your GPU. Since the network processes tokens, a chat with the device is a little jerky, with a noticeable pause between words. ![]() If you just want to access the distributed network’s chatbot based on BLOOMZ-176B, you can do that online. You can install Petals in an Anaconda environment or run a Docker image if you don’t want to set up anything. Of course, if you are privacy-minded, that means that some amount of your data is going out to the public, but for your latest chatbot experiments, that might not be a big problem. You handle a small part of the model (about 8 gigabytes which is small compared to the 352 gigabytes required), and other people have other parts. The idea behind Petals is like BitTorrent. These AI language models are all the rage, but they take significant computer resources. Now Petals wants to use this same method with language models. ![]() The idea was you would download bits and pieces of a file from different places and, in theory, people would download bits and pieces that you have if they need them. But with the widespread use of computer audio and video, it was easy to swamp an FTP server so - eventually - BitTorrent was born. In the old days of the Internet, FTP was sufficient for downloading the occasional file. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |