New Relic Inc.
New Relic strengthens relationship with AWS by offering AI monitoring New Relic AI Monitoring and Amazon Bedrock together help you build and run AI applications by optimizing performance, quality, and cost. ……
*This release is an abridged version of the press release announced in San Francisco, California, USA on November 14, 2023 (US local time). New Relic, Inc. (Headquarters: Minato-ku, Tokyo; President: Shinichiro Konishi; hereinafter referred to as “New Relic”), which provides an observability platform for digital businesses, is the industry’s first APM solution for AI applications. We announced that we are integrating New Relic AI Monitoring (AIM), one of our products, with Amazon Bedrock.
Amazon Bedrock is a service managed by Amazon Web Services, Inc. (AWS) that provides access via API to the leading AI companies’ foundational models (FM) to build and scale generative AI applications. AWS customers can now use New Relic to gain greater visibility and insight across their AI stack, making it easier to troubleshoot and optimize their applications for performance, quality, and cost.
AI is a game-changer for modern applications, but it also presents new challenges and complexities for organizations’ technology stacks. The AI technology stack includes new components such as large-scale language models (LLMs) and vector data stores, which generate additional telemetry to track things like quality and cost. AIM solves these new challenges by introducing APM into your AI stack. Similar to how engineers use New Relic APM to monitor their application stacks, AIM gives engineers complete visibility into all components of their AI stack. AIM troubleshoots, compares, and optimizes various LLM prompts and responses for quality issues such as performance, cost, tokens, hallucinations, bias, harm, and fairness for all models supported by Amazon Bedrock. Provides a single view for
AIM works with Amazon Bedrock to provide deep end-to-end
observability. AIM’s built-in integrations (such as LangChain) enable Amazon Bedrock customers to obtain metrics and traces across the entire lifecycle of LLM prompts and responses, from raw prompts to modified, business-aligned responses.
The main features and use cases are as follows.
Auto-instrumentation: New Relic agents have full AIM functionality, including full AI stack visualization, response tracing, model comparison, and more, and are quick and easy to configure.
Full-stack AI visibility: Holistic view across applications, infrastructure, and AI layers, including AI metrics like response quality and tokens and APM golden signals
Insight into detailed tracing of every LLM response: Track the lifecycle of complex LLM responses built with tools like LangChain and fix performance and quality issues such as bias, toxicity, and hallucinatory symptoms
Compare performance and cost: Track usage, performance, quality, and cost for all your models in a single view. Optimize your AI usage with insights into commonly used prompts, Chain of Thought, prompt templates and caching
Enable the responsible use of AI: Enable the safe use of AI by tagging responses appropriately to indicate they were generated by AI and verifying that they are free of bias, harm, and hallucinations. Monitor your AI ecosystem instantly: Supports 50 integrations and is the most comprehensive solution to monitor the entire stack of any AI ecosystem
Orchestration Framework: LangChain
Vector database: Pinecone, Weaviate, Milvus, FAISS, Zilliz
LLM: Amazon Bedrock (model from AI21 Labs, Amazon, Anthropic, Cohere) Machine learning service: Amazon SageMaker
Comments from New Relic Chief Product Officer Manav Khurana
“AI workloads are now part of organizations’ modern application architectures, and observability is essential for enterprises building AI applications. The collaboration between AIM and Amazon Bedrock builds on our deep integration with AWS. We will bring the power of observability to engineers and developers who are modernizing their technology stacks.We will also put our AI monitoring solution at the heart of AWS customers using leading LLMs like Anthropic. We will continue to work hard to ensure that all engineers can utilize it.” New Relic AIM is built on New Relic’s deep collaboration with AWS and adds to over 95 existing AWS integrations. AIM is available for early access to New Relic and AWS users worldwide. Users can sign up here to request early access. Included as part of New Relic’s simple and transparent pricing. See below for details.
web page
https://newrelic.com/jp/platform/ai-monitoring
blog
https://newrelic.com/jp/blog/how-to-relic/ai-monitoring
Press release about New Relic AI monitoring
https://newrelic.com/jp/press-release/20231206
■Click here for the URL of this press release.
https://newrelic.com/jp/press-release/20231206-1
■New Relic fact sheets and logos can be found below.
https://newrelic.com/jp/about/media-assets
■About New Relic
Founded in 2008, New Relic provides an observability platform that enables observability of all important digital business metrics. By making it possible to monitor not only the applications and
infrastructure that make up a digital business, but also the customer experience on the user side, companies can detect failures in digital services, detect degradation of customer experience, and identify potential problems and bottlenecks. Create DevOps teams that identify and resolve early. This enables companies to turn their digital transformation efforts into measurable strategies. New Relic has more than 16,000 customers worldwide, is used by more than half of the Fortune 100 companies, and supports hundreds of customers in Japan with their digital transformation. See why we support New Relic at newrelic.com.
■About observability platform “New Relic”
New Relic is the most powerful cloud-based observation platform built to help you create more complete software. Engineering teams around the world rely on New Relic to improve uptime and performance, increase scale and efficiency, and accelerate time to market. New Relic includes everything your organization needs to achieve observability.
・Telemetry Data Platform:
Collect and visualize data for any type of application or
infrastructure at petabyte scale. It is designed to be a single source of truth for all operational data.
・Full Stack Observability:
Easily analyze and troubleshoot your entire software stack across APM, infrastructure, logs, and digital customer experience in one connected experience.
*New Relic is a registered trademark of New Relic, Inc.
*All product and company names in this document may be trademarks of their registered holders.
Forward-looking statements
This material has been prepared solely for the purpose of disclosing related information and does not constitute a solicitation or offer to purchase or sell securities. This document has been carefully prepared to ensure accuracy, but its completeness is not guaranteed.
Furthermore, in creating this material, we have relied on third-party information available to us, but we do not represent or warrant the actual accuracy or completeness of such third-party information. Our company assumes no responsibility for any damage caused by relying on the descriptions in this document. The information in this document is subject to change without prior notice. This material contains forward-looking information regarding future expectations. These statements are based on current expectations, projections and assumptions that involve risks, including, but not limited to, general economic and industry or market conditions that may differ materially from actual results. There is a possibility. The Company does not undertake any obligation to update or revise any forward-looking statements in this document, whether as a result of new information, the occurrence of future events, or for any other reason.