Enhancement and Automation of Security Document Search and Countermeasures Recommendation Provision with RAG-Powered Solution

Company Name

Security Compass

Location

Global

Services

Security Testing Services

AI and ML Services

Client

Security Compass offers a proprietary library of compliance regulations, threats, and countermeasures to help speed up their end clients’ development by automating security processes.

Challenge

Given a list of technology components used in a software application, the current product uses a rules engine to identify the potential security threats or weaknesses in the design. It then recommends the set of countermeasures or requirements that should be implemented to mitigate the risks. With a GenAI-powered solution, this process can be improved in both speed and efficiency and provide more accurate results and applicable recommendations.

Solution

Leveraging Amazon Bedrock, DataArt helped the client build a RAG solution that recommends actions to take by identifying threats and recommending countermeasures. It then provides more detailed guidance that is personalized to a development team's tech stack and environment in a categorized and automated way. The enhanced speed and efficiency were achieved by optimizing the initial document dataset for the RAG search.

DataArt needed to come up with an optimal way to extract the specific required information in the expected schema from the client’s knowledge base. To overcome this, a retrieval-augmented solution with Bedrock models was implemented, and along with testing the best approach through various LLMs models, embedding strategies, and different prompts.

Technologies

Bedrock (Titan Embeddings model)

Bedrock (Anthropic LLM model)

Lambda

S3 storage

API Gateway

OpenSearch

ECR

DynamoDB

Outcomes

The achieved similarity of the generated results vs. the expected output ranges between 86% and 93%.
Recommendations are created on the basis of the generated search results.
Enhanced speed and efficiency of the whole process of recommendations provision.
The API is also suitable for internal use within Security Compass, aiding in clarifying doubts or serving as a tool for induction training

Please provide your contact details, and we will get back to you promptly.

First name*

Last name*

Email*

Job title

Company*

Phone

What would you like to discuss?*

How did you learn about DataArt?

What is your role?

I agree to receive DataArt's monthly marketing newsletter.

I have read and agree to the Privacy Policy*