CrowdGPT
A decentralized, open-source collaborative training project for large language models that uses the computing power of volunteers' personal computers worldwide to train models in a distributed manner. It commits to fully disclosing training data and model weights, releases code as open source on GitHub, and is governed by the community.
Timeline (last 90 days)
The poster offered two action suggestions: increase media exposure for CrowdGPT, and proactively contact journalists to point out that the community already has similar work.
Three weeks ago, user u/Vxtzq1 released CrowdGPT, an attempt to use idle GPUs for decentralized AI training.
Less than a week later, Microsoft filed a patent application almost identical to CrowdGPT, without mentioning the community.
The poster worries that Microsoft's patent could prevent CrowdGPT from continuing to exist, because the latter could constitute patent infringement.
CrowdGPT is an attempt to use volunteers or idle GPUs for distributed training, and its technical difficulties include node heterogeneity, limited bandwidth and communication overhead.
The goal of the CrowdGPT project is to create a large language model with no data center and no millions of dollars of investment, and it promises 100% public training data and model weights.
The model size of CrowdGPT at the current proof-of-concept stage is 1 billion parameters.
The CrowdGPT project open-sources its code on GitHub and provides more information on the website crowgpt.net.
CrowdGPT's differentiation lies in its fully transparent data pipeline and community governance.
Without a clear incentive design, most potential contributors may still wait and see, which is the weak point of the CrowdGPT project.
All Facts (9)
The poster offered two action suggestions: increase media exposure for CrowdGPT, and proactively contact journalists to point out that the community already has similar work.
50%UnverifiedCrowdGPT is an attempt to use volunteers or idle GPUs for distributed training, and its technical difficulties include node heterogeneity, limited bandwidth and communication overhead.
50%UnverifiedThe CrowdGPT project open-sources its code on GitHub and provides more information on the website crowgpt.net.
50%UnverifiedCrowdGPT's differentiation lies in its fully transparent data pipeline and community governance.
50%UnverifiedThe goal of the CrowdGPT project is to create a large language model with no data center and no millions of dollars of investment, and it promises 100% public training data and model weights.
50%UnverifiedThe model size of CrowdGPT at the current proof-of-concept stage is 1 billion parameters.
50%UnverifiedThe poster worries that Microsoft's patent could prevent CrowdGPT from continuing to exist, because the latter could constitute patent infringement.
50%UnverifiedLess than a week later, Microsoft filed a patent application almost identical to CrowdGPT, without mentioning the community.
50%UnverifiedThree weeks ago, user u/Vxtzq1 released CrowdGPT, an attempt to use idle GPUs for decentralized AI training.
50%