New Relic transforms productivity with generative AI on AWS

New Relic transforms productivity with generative AI on AWS

New Relic transforms productivity with generative AI on AWS

https://aws.amazon.com/blogs/machine-learning/new-relic-transforms-productivity-with-generative-ai-on-aws/

Publish Date: 2026-02-09 11:45:00

Source Domain: aws.amazon.com

  • Challenge Faced: New Relic struggled with significant time consumption due to employees searching through fragmented documentation across multiple systems.

  • Solution Introduction: They developed New Relic NOVA, an AI-powered assistant built on AWS, to enhance employee productivity by facilitating efficient knowledge access.

  • AWS Services Used: NOVA is backed by AWS services including Amazon Bedrock, Amazon Kendra, Amazon S3, and Amazon DynamoDB, enhancing its functionality and scalability.

  • Integration and Accuracy: NOVA integrates with Confluence, GitHub, Salesforce, Slack, etc., and maintains 80% accuracy for both knowledge-based and transactional queries.

  • Technical Architecture: NOVA employs a three-layer agent architecture that includes a main agent for orchestration and different data source and agent layers to handle complex tasks and knowledge retrieval.

  • Advanced AI Techniques: NOVA uses Retrieval Augmented Generation (RAG) and other advanced techniques such as hierarchical chunking, context enrichment, metadata integration, and custom document processing for precise information retrieval.

  • Evaluation Metrics: NOVA incorporates a detailed evaluation framework using answer accuracy, context relevance, and response latency to ensure optimal performance.

  • Continuous Improvements: The solution includes observability features to collect and analyze user feedback through metrics and feedback mechanisms, ensuring ongoing enhancements based on user interactions.