[rtg] RE: RTG Digest, Vol 27, Issue 12

[eji]

Matt,

I am maintaining the Yahoo rtg code base now which Bill
contributed a lot before with the buffering mechanism.
As he said, his publicly released version is separate
derived work and I tested the code and saw good
performance improvement. If possible, combining it into
the mainline would be nice.
Again, I am not sure about the progress of your
idea/improvement so it's my tentative thought.

Thanks,
Eric

-----Original Message-----
From: rtg-bounces at fireflynetworks.net
[mailto:rtg-bounces at fireflynetworks.net] On Behalf Of
rtg-request at fireflynetworks.net
Sent: Thursday, May 25, 2006 9:00 AM
To: rtg at fireflynetworks.net
Subject: RTG Digest, Vol 27, Issue 12

Send RTG mailing list submissions to
	rtg at fireflynetworks.net

To subscribe or unsubscribe via the World Wide Web,
visit
	http://fireflynetworks.net/mailman/listinfo/rtg
or, via email, send a message with subject or body
'help' to
	rtg-request at fireflynetworks.net

You can reach the person managing the list at
	rtg-owner at fireflynetworks.net

When replying, please edit your Subject line so it is
more specific
than "Re: Contents of RTG digest..."


Today's Topics:

   1. Re: buffering mechanism (bill fumerola)
   2. Re: buffering mechanism (Matt Provost)
   3. Designing a schema for targets in the DB (Steve
Scaffidi)

Message: 2
Date: Wed, 24 May 2006 16:07:16 -0700
From: Matt Provost <mprovost at termcap.net>
Subject: Re: [rtg] buffering mechanism
To: bill fumerola <billf at mu.org>
Cc: rtg at fireflynetworks.net
Message-ID: <20060524230716.GN61906 at admin00.powweb.com>
Content-Type: text/plain; charset=us-ascii

On Wed, May 24, 2006 at 11:58:54AM -0700, bill fumerola
wrote:
> i already did this for mysql and released it to the
public two years
> ago:
> 
> http://mu.org/~billf/yrtg/
> http://mu.org/~billf/yrtg/yrtg.patch
> 
> this work was never adopted into the rtg mainline.
original posts/reposts
> can be found at:
>
http://fireflynetworks.net/pipermail/rtg/2004-August/00
1151.html
>
http://fireflynetworks.net/pipermail/rtg/2005-August/00
1851.html
> 
> i'm sure the patch doesn't apply cleanly years later
and unfortunately
> i can't (well, i won't for free) split out just the
buffer work from the
> rest of the changes. if you look at rtgsqlbuf.c in
that patch you should
> be able to adopt whatever oracle hooks you want to
use.  the code was
> intended to be written in such a way that db
dependent and db agnostic
> parts of the code are seperate. i never did pgsql
support (ENOTIME) so
> that's not tested, but the groundwork is certainly
there.
> 
> also, there may be some freebsdisms in the code.
setproctitle() perhaps.
> 

Yeah I saw this before, but like you said it doesn't
patch cleanly
against the current source. The db stuff changed quite
a bit with the
new drivers. In any case, the buffering that I did
happens outside of
the db drivers so it will work with any of them. If I
had more time I'd
love to get some of your changes ported to the new
version, but I don't
at the moment.

Matt