什么软件可用于数据质量检查 [英] What software is availible for data quality checking

问题描述

我正在寻找一些可能的软件选项，允许自定义规则操纵批量数据文件（.csv）例如，正确的大小写（允许状态保持资本和唯一姓氏），识别字数字段中的特定字词以及一些其他自定义规则。

解决方案

您可以使用Talend Open Studio执行此任务。它是用于数据操作和集成的Opensource ETL工具。你可以例如ImportCSV >> DATABASE >>执行转换>> ExportCSV。可能性是无穷无尽的。

您可以在这里找到： http://www.talend.com/products-data-integration/talend-open-studio.php

这听起来像是你可能想要创建一个数据的配置文件。为此，您可以使用Talend打开Profiler，他们最近添加了对平面文件（如.csv）的支持。

您可以在这里下载： http://www.talend.com/products-data-quality/talend-open-profiler.php

您可以在这里找到一些教程：http：//www.talendforge.org/tutorials/menu.php

在教程上选择数据质量选项卡，向下滚动到Talend打开Profiler

这是我在评估新数据集的数据质量的第一步。 / p>

I'm looking to identify some possible software options that will allow for custom rules to manipulate bulk data files (.csv) For example, proper capitalization (allowing for states to remain capital and unique surnames), identifying the word count of specific words in a field, and some other custom rules. Any guidance would be appreciated.

解决方案

You could use Talend Open Studio for this task. It is an Opensource ETL tool for data manipulation and integration. You can for example ImportCSV >> DATABASE >> perform transformations >> ExportCSV. The possibilities are endless.

You can find it here: http://www.talend.com/products-data-integration/talend-open-studio.php

It also sounds like you might be looking to create a profile of the data. For this you can use Talend Open Profiler, they recently added support for flat files such as your .csv. It is simple to use and you should be up and running in 30 mins.

You can find the download here: http://www.talend.com/products-data-quality/talend-open-profiler.php

You can find some tutorials here:http://www.talendforge.org/tutorials/menu.php

On the tutorials choose the Data Quality tab, and scroll down until 'Talend Open Profiler'

It is my first step in assessing data quality on a new dataset.

这篇关于什么软件可用于数据质量检查的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！