数据处理问题 [英] data handling issue

查看:72
本文介绍了数据处理问题的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

大家好,

我想就下列性能/设计给你一些意见

问题:


a记录系统每次产生大量记录,(大约

500k /天)

我需要将它们存储在一个巨大的Oracle RAC系统中

a Java Web应用程序连接到数据并执行查询

它们,主要是在最后输入的记录集上

对3个月前存储的信息的查询是相当的很少


首先猜测我设法将它们存储在一个由一个

主键索引的表中,让我们在表''LOGS'中说'

问题是桌子会变得非常大,


你有最佳实践的想法来更好地处理这种情况

方式?


我考虑过在''LOGS_ARCHIVE''表格中移动数据,

例如使用Oracle工作

是否有必要?

PS我不能使用Oracle标准文件存档支持,我需要数据来支付
留在桌子上


提前感谢

jc

Hi all,
I''d like to have you opinion about the following performance/design
issue:

a logging system is generating a lot of records every our,(about
500k/day)
I need to store them in a huge Oracle RAC system
a Java web application connects to the data and executes queries on
them, mainly on last entered set of records
queries on informations stored more then 3 months ago are quite rare

as first guess I managed to store them in a table indexed by a
primary key, let''s say in the table ''LOGS''
the problem is that table is going to grows very big,

have you got ''best practice'' ideas to handle the situation in a better
way?

I thought about moving data priodically in a ''LOGS_ARCHIVE'' table ,
for example using a Oracle job
is it necessary?
PS I can''t use Oracle standard file archiving support, I need data to
stay on tables

thanks in advance
jc

推荐答案



" curwen" <乔********** @ despammed.com>在消息中写道

新闻:cc ************************** @ posting.google.c om ...

"curwen" <jo**********@despammed.com> wrote in message
news:cc**************************@posting.google.c om...
大家好,
我想对您的以下性能/设计问题发表意见

一个日志记录系统正在生成一个我们每个人都有大量的记录,(约为500k /天)
我需要将它们存储在一个巨大的Oracle RAC系统中一个Java Web应用程序连接到数据并执行查询他们,主要是最后输入的一组记录
对3个月前存储的信息的查询非常罕见

首先猜测我设法将它们存储在一个由主键,让我们在表格中说''LOGS''
问题是表格会变得非常大,

你有最佳实践吗? 以更好的方式处理这种情况的想法?

我考虑过在''LOGS_ARCHIVE''表格中定期移动数据,例如使用Oracle作业
/>是否有必要?
PS我不能使用Oracle标准文件归档支持,我需要数据才能留在桌子上

提前感谢
jc
Hi all,
I''d like to have you opinion about the following performance/design
issue:

a logging system is generating a lot of records every our,(about
500k/day)
I need to store them in a huge Oracle RAC system
a Java web application connects to the data and executes queries on
them, mainly on last entered set of records
queries on informations stored more then 3 months ago are quite rare

as first guess I managed to store them in a table indexed by a
primary key, let''s say in the table ''LOGS''
the problem is that table is going to grows very big,

have you got ''best practice'' ideas to handle the situation in a better
way?

I thought about moving data priodically in a ''LOGS_ARCHIVE'' table ,
for example using a Oracle job
is it necessary?
PS I can''t use Oracle standard file archiving support, I need data to
stay on tables

thanks in advance
jc



我总觉得奇怪,我们看到这样的请求。按照我正在构建这个庞大的Oracle数据库这一行的各个方面排序,我不太了解关于Oracle的问题,但是......难道没有人能让项目中的人拥有一些关于Oracle的知识和专业知识吗?这让我非常奇怪。

Jim


I always find it strange that we see requests like this. Sort of along the
lines of "I am building this huge Oracle database and I don''t know much
about Oracle but..." Wouldn''t one get people on the project who have some
knowledge and expertise on Oracle? It just strikes me as very odd.
Jim


" Jim Kennedy" <柯**************************** @ attbi.net>在消息新闻中写道:<%Y3%b.56084
"Jim Kennedy" <ke****************************@attbi.net> wrote in message news:<%Y3%b.56084


Xp.266401@attbi_s54> ...

[]
Xp.266401@attbi_s54>...
[]
我总觉得奇怪,我们看到这样的要求。按照我正在构建这个庞大的Oracle数据库的方式排序,我对Oracle的了解不多,但是......难道没有人能让项目中的人对Oracle有一些知识和专业知识吗?这让我非常奇怪。
Jim
I always find it strange that we see requests like this. Sort of along the
lines of "I am building this huge Oracle database and I don''t know much
about Oracle but..." Wouldn''t one get people on the project who have some
knowledge and expertise on Oracle? It just strikes me as very odd.
Jim




我的猜测是经理得到最便宜的程序员并且

一直在问当他们被解雇时,他接管了更多知识渊博的人的责任。当然,经理

听说以更低的利率外包给印度,而且b $ b的模式再次开始。 8 ^)


但是说真的,我很困惑。

Ed



My guess is the manager gets the cheapest programmer available and
keeps asking him to take over responsibilities of the more
knowledgable folks as they are laid off. Of course then the manager
hears about outsourcing to India at even lower rates and the pattern
begins again. 8^)

But seriously, I''m as puzzled as you are.
Ed


这篇关于数据处理问题的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆