Anthropic plans to caution potential investors in its IPO that advanced AI could pose "catastrophic or existential risks to humanity," an extraordinary warning by a company seeking to profit from the same technology.

Anthropic has long positioned itself as the virtuous AI company. An early look at its IPO filing shows how it is creating a new "Founder LLC" vehicle aimed at serving the common good, while insulating its leaders from market forces.

Anthropic is making a massive bet that AI will transform the global economy more profoundly than industrialization, electricity and the internet, according to its IPO prospectus seen by Reuters. The public sale could value the startup at more than $2 trillion.