正确使用aws创建数据集[aws cli] [英] Proper usage of aws create-data-set [aws cli]

问题描述

我已经设置了以下数据源:

I have setup a data-source with the following:

aws quicksight create-data-source --cli-input-json file://connection.json

cat connection.json:

cat connection.json:

{
    "AwsAccountId": "44455...",
    "DataSourceId": "abcdefg13asdafsad",
    "Name": "randomname",
    "Type": "S3",
    "DataSourceParameters": {
        "S3Parameters": {
            "ManifestFileLocation": {
                "Bucket": "cmunetcoms20",
                "Key": "asn-manifest.json"
            }
          }
        }
}

asn-manifest.json包含(并放置在相应的存储桶中):

asn-manifest.json contains (and is placed in the appropriate bucket):

{
    "fileLocations": [
        {
            "URIs": [
                "https://cmunetcoms20.s3.us-east-2.amazonaws.com/ASN_Scores.csv"
            ]
        },
        {
            "URIPrefixes": [
                "prefix1",
                "prefix2",
                "prefix3"
            ]
        }
    ],
    "globalUploadSettings": {
        "format": "CSV",
        "delimiter": ",",
        "textqualifier": "'",
        "containsHeader": "true"
    }
}

这成功创建了一个数据源，然后在我创建数据集时使用

This successfully creates a data-source and then when I go to create a data-set I use

aws quicksight create-data-set --cli-input-json file://skeleton

骨骼包含:

{
    "AwsAccountId": "44455...",
    "DataSetId": "generatedDataSetName",
    "Name": "test-asn-demo",
    "PhysicalTableMap": {
        "ASNs": {
            "S3Source": {
                "DataSourceArn": "arn:aws:quicksight:us-east-2:444558491062:datasource/cmunetcoms20162031",
                "InputColumns": [
                {
                "Name": "ASN",
                "Type": "INTEGER"
                },
                {
                "Name": "Score",
                "Type": "DECIMAL"
                },
                {
                "Name": "Total_IPs",
                "Type": "INTEGER"
                },
                {
                "Name": "Badness",
                "Type": "DECIMAL"
                }
                ]
            }
      }
    },
    "ImportMode": "SPICE"
}

引发以下错误:

"在调用CreateDataSet操作:物理表ASN中的输入列ASN具有无效的类型.S3物理表的允许类型为[String]"

"An error occurred (InvalidParameterValueException) when calling the CreateDataSet operation: Input column ASN in physical table ASNs has invalid type. Allowed types for S3 physical table are [String]"

如果将每个类型都更改为字符串"，则会引发以下错误:

If I change each Type to "String", it throws the following error:

调用时发生错误(LimitExceededException)CreateDataSet操作:SPICE容量不足

An error occurred (LimitExceededException) when calling the CreateDataSet operation: Insufficient SPICE capacity

该帐户上有很多SPICE，大约51 GB，利用率几乎为0.此外，我运行了数字，我认为应该用于此数据集的Spice总量约为0 GB.(大小为71,000行，4列，每列为一个字符串以填充我的计算).

There is plenty of SPICE on the account, something like 51 GB, and almost 0 utilization. Additionally, I ran the numbers and the total amount of Spice that I think should be used for this data set is approximately 0 GB. (size 71k rows, 4 columns, each column as a string to pad my calculation).

谢谢

推荐答案

让它成风.对我来说，解决方案是区域配置问题.我的s3存储桶在us-east-2中，而我的视野在us-east-1中.尝试在不是您的主要帐户的区域(即使您有企业)中创建数据集，也会导致香料错误，因为没有为替代区域提供任何香料平衡.

Got it fam. The solution for me was a regional configuration problem. My s3 bucket was in us-east-2 and my quicksight was in us-east-1. Trying to create a data set in a region that is not ur primary account (even though you have enterprise), causes a spice error since alternate regions are not given any spice balance to start out.

这篇关于正确使用aws创建数据集[aws cli]的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！