Google的Vision Api protobuf对Python字典的响应对象 [英] Google's Vision Api protobuf response object to Python dictionary

问题描述

我正在一个项目中，我需要使用Google的Vision API分析图像并将响应发布到Dynamodb表中.

I'm working on a project in which I need to analyze an image using Google's Vision API and post the response to a Dynamodb table.

我已经成功实现了Vision API，但无法将其响应转换为Python字典.

I have successfully implemented the Vision API, but not able to convert its response into Python Dictionary.

这是我尝试过的:

       if form.is_valid():
            obj = form
            obj.imageFile = form.cleaned_data['imageFile']
            obj.textFile = form.cleaned_data['textFile']
            obj.save()
            print(obj.imageFile)
            # Process the image using Google's vision API
            image_path = os.path.join(settings.MEDIA_ROOT, 'images/', obj.imageFile.name)
            print(image_path)
            image = vision_image_manager(image_path)
            text_path = os.path.join(settings.MEDIA_ROOT, 'texts/', obj.textFile.name)
            text = nlp_text_manager(text_path)
            # print(image)
            # print(text)
            results = {
                'imageResponse': image,
                'textResult': text
            }
            print(results.values())
            print(type(results))
            post_to_dynamo_db(image, text)

这是Vision API实现:

Here's the Vision api implementation:

def vision_image_manager(image_file):
    # Instantiates a client
    client = vision.ImageAnnotatorClient()
    file_name = str(image_file)
    with open(file_name, 'rb') as img_file:
        content = img_file.read()
    image = types.Image(content=content)
    response = client.label_detection(image=image)
    labels = response.label_annotations
    print('Labels:')
    for label in labels:
        print(label.description)
    return labels

这是post_to_dynamo_db函数:

def post_to_dynamo_db(image, text):
session = boto3.Session(
    aws_access_key_id=settings.AWS_SERVER_PUBLIC_KEY,
    aws_secret_access_key=settings.AWS_SERVER_SECRET_KEY
)
client = session.resource('dynamodb')
table = client.Table('basetbl')
result_dict = {
    'image': image,
    'text': text
}
json_dict = dict_to_item(result_dict)
# item = dict_to_item(result_dict)
table.put_item(
    Item={
        'id': int(generate_pid()),
        'response_obj': json_dict
    }
)

现在，它不会返回任何错误，但是response_obj不会发布在数据库表中，因为它不是对象的正确形式，这里的问题是Google的API返回的响应的<class 'google.protobuf.pyext._message.RepeatedCompositeContainer'>类型./p>

Now, It doesn't return any error but the response_obj is not posted in Database table because it's not the correct form of the object, the problem here is the <class 'google.protobuf.pyext._message.RepeatedCompositeContainer'> type of response returns from Google's API.

推荐答案

从Vision API获得正确的python友好响应的最佳方法是通过Google的Discovery服务使用此API.

The best way to get a proper python friendly response from Vision API is to use this API via the Google's Discovery service.

这是为您工作的方式:

def vision_image_manager(image_file):
    # Instantiates a client
    service = discovery.build('vision', 'v1', credentials=credentials)
    # text.png is the image file.
    file_name = str(image_file)
    with open(file_name, 'rb') as image:
        image_content = base64.b64encode(image.read())
        service_request = service.images().annotate(body={
            'requests': [{
                'image': {
                    'content': image_content.decode('UTF-8')
                },
                'features': [{
                    'type': 'LABEL_DETECTION',
                }]
            }]
        })
    response = service_request.execute()
    print(response['responses'])
    res_dict = dict(response)
    return res_dict

这篇关于Google的Vision Api protobuf对Python字典的响应对象的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！