Discovery AI
A natural-language query agent built by Orca Security on Amazon Bedrock that automatically converts everyday English questions into Sonar query statements. It uses a multi-stage processing pipeline to perform intent recognition, context compression and query generation.
Timeline (last 90 days)
Orca Security built a natural language query agent named Discovery AI based on Amazon Bedrock, automatically converting plain English questions into Sonar query statements.
Compared with the initial baseline approach, Discovery AI reduced query cost by 90%, cut the number of input tokens by 93%, and reduced latency by 75%.
The main source of the 93% reduction in input tokens is the context compression stage of Discovery AI, which extracts only the fields and a small number of examples most relevant to the current query type.
Discovery AI's cost reduction mainly comes from three directions: input token compression, model tiering (lightweight models for intent recognition and validation, large models only for query generation), and caching and reuse.
Sonar queries generated by Discovery AI undergo syntax validation and permission checks to ensure that no invalid or unauthorized queries are produced.
All Facts (5)
Orca Security built a natural language query agent named Discovery AI based on Amazon Bedrock, automatically converting plain English questions into Sonar query statements.
50%UnverifiedCompared with the initial baseline approach, Discovery AI reduced query cost by 90%, cut the number of input tokens by 93%, and reduced latency by 75%.
50%UnverifiedThe main source of the 93% reduction in input tokens is the context compression stage of Discovery AI, which extracts only the fields and a small number of examples most relevant to the current query type.
50%UnverifiedDiscovery AI's cost reduction mainly comes from three directions: input token compression, model tiering (lightweight models for intent recognition and validation, large models only for query generation), and caching and reuse.
50%UnverifiedSonar queries generated by Discovery AI undergo syntax validation and permission checks to ensure that no invalid or unauthorized queries are produced.
50%