On Monday 15 December 2008 23:56:08 Jonah H. Harris wrote:
> On Mon, Dec 15, 2008 at 3:26 PM, Josh Berkus <josh@agliodbs.com> wrote:
> > You can't compare DBT2 with TPCC. They're not the same benchmark.
>
> Agreed. Somewhere earlier in the thread I mentioned that the OSDL
> kits are non-spec-compliant, a little buggy, and sometimes give better
> results than the real tests.
Could we consolidate everyone's concerns into a project outline, if one is
necessary?
- Everyone would like to have a TPC-like benchmark kit.
- OSDL script are not compliant.
- OSDL scripts are outdated/appear unmaintained.
- OSDL scripts need POstgreSQL-specific improvements.
- EnterpriseDB is apparently maintaining their own fork.
What can we do?
I found the TPC-C spec on the web, so it's freely available for
implementation, it appears.