Wednesday, April 22, 2009

Where is the Calpont code?

Calpont has a talk on their MPP column-store storage engine for MySQL at 2PM today. The talk title is  Open Source Columnar Storage Engine. It sounds interesting, especially if the source will be available as many people can try it out. But the source isn't available today. Where is the source?

Note, Calpont doesn't mind that I am asking about this in public.

Other questions I have include:
  1. Does it implement the condition pushdown interface?
  2. Will it implement the batch key access interface?

3 comments:

Arjen Lentz said...

Yea there's a lot of vaporware and closed cool-pretence buzzing around the conf, I also see this from the spam marketing emails I get from the various vendors (who got mailing data from O'Reilly.
Briefings under embargo that contain no info, announcements about future stuff where the company thinks they're really cool, and so on.
Booooooring.

jtommaney said...

Mark,

Thanks for the comment and questions. We are working on establishing the right relationships for us to make the source available, and are striving for that to happen as soon as possible.

No, we don't currently use the condition pushdown interface, as we are interested in taking and executing in a distributed manner the conditions, joins, and aggregations. The best long term interface will be something close the the query fragment pushdown design, and we are tracking that. For now, we have our own hooks created with some experienced guidance from a number of MySQL people.

No, we don't currently use the BKA interface either. We execute hash join operations as we are optimized for larger data operations, and don't follow the NL or batched NL join behavior. We do have some rough comparisons of join rates (not on like hardware) for review. http://jtommaney.livejournal.com/

Mark Callaghan said...

What is stopping you from publishing the code now as GPL? You can setup a project on code.google.com or on launchpad. I don't mind if it isn't GPL, I mind that conference talk titles said it was GPL and the code isn't there (yet).

Post a Comment