Cloudflare press release (2024.09.27) Cloudflare Cloudflare Announces Enhancements to AI Application Developer Platform Bigger scale with advanced “Workers AI”, “AI Gateway”, and “Vectorize” Deploy complex AI models and handle more complex AI tasks. (Announced in home country on September 26, 2024 at 6:00 PST) Cloudflare, the leading connectivity cloud company that makes it easy for everyone to connect, today announced the addition of faster, more powerful, and higher-performing AI to its serverless AI platform, Workers AI, and suite of AI application developer tools. We announced new features for building applications. Going forward, applications built with Workers AI will benefit from faster inference, larger models, improved performance analysis, and more. Workers AI will continue to be a developer platform where global AI applications can be built anywhere in the world and AI inference can be performed close to users.
https://prcdn.freetls.fastly.net/release_image/61678/78/61678-78-52664b46cc20da0401a5a6e0dac23c60-1999×1126.png
https://prcdn.freetls.fastly.net/release_image/61678/78/61678-78-cdc1da0810548ab5cc8b116ca91f88a7-1800×1098.png “When AI first started gaining traction, it was still a new and experimental technology, so network speeds were key to how it worked,” said Matthew Prince, co-founder and CEO of Cloudflare. However, as AI becomes more part of our daily lives, networks and speed in
milliseconds are becoming more important. As AI evolves and moves from the training stage to the inference stage, the performance of the network and its ability to function within its region will become an increasingly determining factor for AI. Cloudflare is the most global AI platform on the market, with GPUs located in cities around the world. And this fact will transform AI from just a toy to a part of our daily lives, just as faster internet speeds revolutionized smartphones.” I am. Cloudflare today introduced the following new features to its developer platform for building AI applications: Improved performance of “Workers AI” and enhanced support for large-scale models Cloudflare is introducing the Workers AI to upgrade AI inference performance and enable inference on much larger models such as the Llama 3.1 70B and Llama 3.2 model families (1B, 3B, 11B, and 90B). ” is expanding its global network with more powerful GPUs. With support for larger models, faster responses, and a larger context window, AI applications built on Workers AI will be able to handle more complex tasks efficiently and with a natural, Creates a seamless end-user experience. Improved monitoring and optimization of AI usage with AI Gateway persistent logs Persistent logging, a new feature in the open beta of AI Gateway, allows developers to store user prompts and model answers for long periods of time for analysis and
understanding application performance. . Persistent logging allows you to gain deeper insights into the user experience, such as the cost and duration of requests, which can help you improve your application. More than 2 billion requests have passed through AI Gateway since its launch last year. “Vectorize” fast and cheap queries Vector databases help AI models remember past inputs and apply machine learning to search, recommendation, and text generation use cases. As of August 2024, the vector database “Vectorize”, which has recently been released to the public, supports indexes of up to 5 million vectors (previously 200,000 vectors). Median query latency has decreased from 549ms previously to 31ms now. These improvements will allow AI applications to quickly find the information they need with less data processing, making them more affordable.
https://prcdn.freetls.fastly.net/release_image/61678/78/61678-78-497f11706b94bd63e8fb710fa1a54b94-1800×716.png For more information, please see the resources below. Cloudflare’s bigger, better, faster AI platform
https://blog.cloudflare.com/workers-ai-bigger-better-faster/ Making Workers AI faster and more efficient: Performance optimization with KV cache compression and speculative decoding
https://blog.cloudflare.com/making-workers-ai-faster/ Builder Day 2024: 18 big updates to the Workers platform
https://blog.cloudflare.com/builder-day-2024-announcements/
https://prcdn.freetls.fastly.net/release_image/61678/78/61678-78-971162ffb97a3c605aebe8053b327f3c-1999×1125.png About Cloudflare Cloudflare, Inc. (NYSE:NET /
https://www.cloudflare.com/ja-jp/ ) is a leading connectivity cloud company whose mission is to help build a better internet. Cloudflare’s Connectivity Cloud delivers full-featured, unified, industry-leading cloud-native products and developments that make every organization, person, application, and network around the world faster, more secure, and less complex and costly. We provide a user tool platform. As one of the world’s largest and most interconnected networks, Cloudflare blocks billions of threats online every day, from enterprises to startups, small businesses, nonprofits, humanitarian organizations, and government agencies. Trusted by millions of organizations around the world. For more information about
Cloudflare’s Connectivity Cloud
https://www.cloudflare.com/ja-jp/connectivity-cloud/ , for the latest internet trends and insights
https://radar.cloudflare.com Please take a look. Follow us: Blog https://blog.cloudflare.com/ X https://twitter.com/cloudflare LinkedIn
https://www.linkedin.com/company/cloudflare/ Facebook https://www.facebook.com/Cloudflare/ Instagram https://www.instagram.com/cloudflare Forward-looking statements This press release contains forward-looking statements (e.g., Section 27A of the U.S. Securities Act of 1933 and Section 21E of the U.S. Securities Exchange Act of 1934, as amended) that involve material risks. and includes uncertainties. Forward-looking statements include “may,” “will,” “will,” “should,” “anticipates,” “potential,” “plans,” and “anticipates.” ”, “may”, “intends”, “aim”, “estimate”, “consider”, “consider”, “estimate”, “predict”, may be identified by “potential”, “continue”, or the negative thereof, or other similar terms or expressions relating to Cloudflare’s expectations, strategies, plans, or intentions. However, not all forward-looking statements contain such words. Forward-looking statements, expressed or implied in this press release, include forward-looking statements regarding the performance and effectiveness of Workers AI, AI Gateway and Vectorize and their related features and Cloudflare’s other products and technologies; the benefits to Cloudflare customers from the use of Cloudflare and Cloudflare’s other products and technologies; Includes, but is not limited to, Cloudflare’s technology developments, future operations, growth, initiatives, strategies, and comments from Cloudflare’s CEO. The risks detailed in our Quarterly Report on Form 10-Q filed with the Securities and Exchange Commission (SEC) on August 1, 2024 and other documents we file from time to time with the SEC, including but not limited to: Actual results may differ materially from the results expressed or implied by the forward-looking statements above due to various factors, including the following: The forward-looking statements contained in this press release refer only to events as of the date of the statements. Cloudflare may update forward-looking statements to reflect events or circumstances after the date of this press release or to reflect new information or the occurrence of unanticipated events, unless required by law. No obligation. You should not place undue reliance on Cloudflare’s forward-looking statements, as the plans, intentions, and expectations disclosed by Cloudflare in such forward-looking statements may not actually be implemented or achieved. (C)2024 Cloudflare, Inc. All rights reserved. Cloudflare, the Cloudflare logo, and other Cloudflare marks are trademarks or registered trademarks of
Cloudflare, Inc. in the United States and other jurisdictions. Other trademarks and names mentioned herein may be the trademarks of their respective owners.