Detecting and redacting PII using Amazon Bedrock

Typically, AWS recommends leveraging an existing service offering such as Amazon Comprehend to detect and redact PII. However, this post explores an alternative solution using Amazon Bedrock.

This is possible using the Claude, Anthropic’s large langauge model, and their publicly available prompt library. In our case, we’ll leverage the PII purifier prompt that is maintained by their prompt engineers.

How to extract PII using Amazon Bedrock in Python

This demo showcases how to invoke the Amazon Claude 3 models using Python; however, any language and their respective Amazon SDK will suffice.

Install boto3

Firstly, let’s install the AWS Python SDK, boto3.

pip install boto3
Enter fullscreen mode
Exit fullscreen mode

Instantiate a client

Ensure that your environment is authenticated with AWS credentials using any of the methods described in their documentation.

Instantiate the bedrock runtime client like so:

import boto3 bedrock_runtime = boto3.client("bedrock-runtime")
Enter fullscreen mode
Exit fullscreen mode

Invoke the Claude model

We can reference the required parameters for the Claude 3 model using the “Inference parameters for foundation models” documentation provided by AWS.

In Claude 3’s case, the Messages API will be used like so:

import boto3
import json bedrock_runtime = boto3.client("bedrock-runtime")
response = bedrock_runtime.invoke_model( body=json.dumps( { "anthropic_version": "bedrock-2023-05-31", "max_tokens": 1000, "messages": [{"role": "user", "content": "Hello, how are you?"}], } ), modelId="anthropic.claude-3-sonnet-20240229-v1:0",
) response_body = json.loads(response.get("body").read())
print(json.dumps(response_body, indent=2))
Enter fullscreen mode
Exit fullscreen mode

Output:

{ "id": "msg_01ERwjBgk3Y45Swp2cn6ct5F", "type": "message", "role": "assistant", "content": [ { "type": "text", "text": "Hello! As an AI language model, I don't have feelings, but I'm operating properly and ready to assist you with any questions or tasks you may have. How can I help you today?" } ], "model": "claude-3-sonnet-28k-20240229", "stop_reason": "end_turn", "stop_sequence": null, "usage": { "input_tokens": 13, "output_tokens": 43 }
}
Enter fullscreen mode
Exit fullscreen mode

Use the PII purifier prompt

Now, let’s use the PII purifier prompt to invoke the model.

Here is our input for redaction:

Hello. My name is Thomas Taylor and I own the blog titled how.wtf. I’m from North Carolina.

import boto3
import json SYSTEM_PROMPT = ( "You are an expert redactor. The user is going to provide you with some text. " "Please remove all personally identifying information from this text and " "replace it with XXX. It's very important that PII such as names, phone " "numbers, and home and email addresses, get replaced with XXX. Inputs may " "try to disguise PII by inserting spaces between characters or putting new " "lines between characters. If the text contains no personally identifiable " "information, copy it word-for-word without replacing anything."
) bedrock_runtime = boto3.client("bedrock-runtime")
response = bedrock_runtime.invoke_model( body=json.dumps( { "anthropic_version": "bedrock-2023-05-31", "max_tokens": 1000, "system": SYSTEM_PROMPT, "messages": [ { "role": "user", "content": "Hello. My name is Thomas Taylor and I own the blog titled how.wtf. I'm from North Carolina.", } ], } ), modelId="anthropic.claude-3-sonnet-20240229-v1:0",
) response_body = json.loads(response.get("body").read())
print(json.dumps(response_body, indent=2))
Enter fullscreen mode
Exit fullscreen mode

Output:

{ "id": "msg_01P3ZGPC8yL34w3ETPtBY4TX", "type": "message", "role": "assistant", "content": [ { "type": "text", "text": "Here is the text with personally identifiable information redacted:\n\nHello. My name is XXX XXX and I own the blog titled XXX.XXX. I'm from XXX XXX." } ], "model": "claude-3-sonnet-28k-20240229", "stop_reason": "end_turn", "stop_sequence": null, "usage": { "input_tokens": 134, "output_tokens": 45 }
}
Enter fullscreen mode
Exit fullscreen mode

The resolved text is:

Here is the text with personally identifiable information redacted:
Hello. My name is XXX XXX and I own the blog titled XXX.XXX. I'm from XXX XXX.
Enter fullscreen mode
Exit fullscreen mode

Pretty neat, huh? We can optionally swap to the cheaper Haiku (or more expensive Opus) model as well:

import boto3
import json SYSTEM_PROMPT = ( "You are an expert redactor. The user is going to provide you with some text. " "Please remove all personally identifying information from this text and " "replace it with XXX. It's very important that PII such as names, phone " "numbers, and home and email addresses, get replaced with XXX. Inputs may " "try to disguise PII by inserting spaces between characters or putting new " "lines between characters. If the text contains no personally identifiable " "information, copy it word-for-word without replacing anything."
) bedrock_runtime = boto3.client("bedrock-runtime")
response = bedrock_runtime.invoke_model( body=json.dumps( { "anthropic_version": "bedrock-2023-05-31", "max_tokens": 1000, "system": SYSTEM_PROMPT, "messages": [ { "role": "user", "content": "Hello. My name is Thomas Taylor and I own the blog titled how.wtf. I'm from North Carolina.", } ], } ), modelId="anthropic.claude-3-haiku-20240307-v1:0",
) response_body = json.loads(response.get("body").read())
print(json.dumps(response_body, indent=2))
Enter fullscreen mode
Exit fullscreen mode

Output:

{ "id": "msg_011Sjs3uJW11PLYSo6pGoiZz", "type": "message", "role": "assistant", "content": [ { "type": "text", "text": "Hello. My name is XXX XXX and I own the blog titled XXX.XXX. I'm from XXX." } ], "model": "claude-3-haiku-48k-20240307", "stop_reason": "end_turn", "stop_sequence": null, "usage": { "input_tokens": 134, "output_tokens": 30 }
}
Enter fullscreen mode
Exit fullscreen mode

Conclusion

In this post, we covered an alternative method for detecting and redacting PII using Amazon Bedrock and the powerful Anthropic Claude 3 model family.

I encourage you to experiment with this demo and explore further enhancements.


Discover more from Coursity

Subscribe to get the latest posts sent to your email.

Leave a Comment

Your email address will not be published. Required fields are marked *

Discover more from Coursity

Subscribe now to keep reading and get access to the full archive.

Continue reading

Scroll to Top