[Mulgara-general] "Sweet spot" for model size?

[Life is hard, and then you die]

Looks like you never got a reply - sorry about that.

On Thu, Feb 14, 2008 at 10:30:46AM -0500, Eric Freese wrote:
> 
> I'm new to Mulgara and very impressed thus far.  My main question at
> this point centers around any tips the community might have as to the
> best way to organize models.
> 
> I'm trying to load the dbpedia (dbpedia.org) RDF datasets into
> mulgara.  The initial loads went pretty fast but they seem to be
> getting progressively slower as more and more triples are added.  What
> I'm wondering is if there is a suggested number of triples to have
> within a model or a suggested strategy for how models should be
> organized.

It doesn't really matter how many triples per model or how many models
you have, because mulgara stores everything as four-tuples with the
model the being the fourth element (i.e. "(s, p. o) in m" is stored as
"(s, p, o, m)") and because the indexes are fully symmetric and treat
all elements of the four-tuple equally.

How many triples are you loading and where do you start to see a
noticeable slow-down? Are you using "insert" or "load" to load the
triples, and are dong this in auto-commit mode or in separate
transactions?

Generally, loading as much as you can in a single transaction will be
fastest because there's some noticeable overhead on the commit.


  Cheers,

  Ronald