[Mulgara-general] Memory error during rdf load

[Bill OConnor]

2008-08-10 11:15:32,522 WARN  TripleWriteThread - Exception during abort of
TripleWriteThread:
/home/wto/Projects/dmoz/server1/xaStatementStore/xa.g_3120
java.lang.OutOfMemoryError
    at sun.misc.Unsafe.allocateMemory(Native Method)
    at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:117)
    at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:305)
    at org.mulgara.store.xa.Block.newInstance(Block.java:168)
    at org.mulgara.store.xa.IOBlockFile.allocateBlock(IOBlockFile.java:138)
    at org.mulgara.store.xa.IOBlockFile.readBlock(IOBlockFile.java:152)
    at
org.mulgara.store.xa.ManagedBlockFile$Phase.readBlock(ManagedBlockFile.java:382)
    at
org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriple(TripleAVLFile.java:857)
    at
org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriples(TripleAVLFile.java:706)
    at
org.mulgara.store.statement.xa.TripleWriteThread.run(TripleWriteThread.java:155)
2008-08-10 11:15:32,522 WARN  TripleWriteThread - Exception during abort of
TripleWriteThread:
/home/wto/Projects/dmoz/server1/xaStatementStore/xa.g_3201
java.lang.OutOfMemoryError
    at sun.misc.Unsafe.allocateMemory(Native Method)
    at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:117)
    at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:305)
    at org.mulgara.store.xa.Block.newInstance(Block.java:168)
    at org.mulgara.store.xa.IOBlockFile.allocateBlock(IOBlockFile.java:138)
    at org.mulgara.store.xa.IOBlockFile.readBlock(IOBlockFile.java:152)
    at
org.mulgara.store.xa.ManagedBlockFile$Phase.readBlock(ManagedBlockFile.java:382)
    at
org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriple(TripleAVLFile.java:857)
    at
org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriples(TripleAVLFile.java:706)
    at
org.mulgara.store.statement.xa.TripleWriteThread.run(TripleWriteThread.java:155)
2008-08-10 22:17:02,985 ERROR Parser - Error, 20364240, column 9: {E213}
Connection refused to host: 127.0.1.1; nested exception is:
    java.net.ConnectException: Connection refused
com.hp.hpl.jena.rdf.arp.ParseException: {E213} Connection refused to host:
127.0.1.1; nested exception is:
    java.net.ConnectException: Connection refused
    at com.hp.hpl.jena.rdf.arp.ARPFilter.parseWarning(ARPFilter.java:559)
Hello,

I have been experimenting with Mulgara by trying to load the dmoz open
directory project. I believe that I have fixed
most of the invalid URI problems I was experiencing. However after several
hours of loading a 2 Gig rdf it fails with the following stack.

The client side never returns with an error.

Anybody have any suggestion were I should go from here?


at com.hp.hpl.jena.rdf.arp.ARPFilter.parseWarning(ARPFilter.java:552)
    at
com.hp.hpl.jena.rdf.arp.ParserSupport.saxException(ParserSupport.java:183)
    at com.hp.hpl.jena.rdf.arp.RDFParser.saxEx(RDFParser.java:260)
    at com.hp.hpl.jena.rdf.arp.RDFParser.oneWhite(RDFParser.java:248)
    at com.hp.hpl.jena.rdf.arp.RDFParser.white1(RDFParser.java:172)
    at com.hp.hpl.jena.rdf.arp.RDFParser.white(RDFParser.java:137)
    at com.hp.hpl.jena.rdf.arp.RDFParser.zwhite(RDFParser.java:132)
    at com.hp.hpl.jena.rdf.arp.RDFParser.typedNode(RDFParser.java:985)
    at com.hp.hpl.jena.rdf.arp.RDFParser.description(RDFParser.java:429)
    at com.hp.hpl.jena.rdf.arp.RDFParser.obj(RDFParser.java:346)
    at com.hp.hpl.jena.rdf.arp.RDFParser.rdf(RDFParser.java:326)
    at com.hp.hpl.jena.rdf.arp.RDFParser.root(RDFParser.java:1371)
    at com.hp.hpl.jena.rdf.arp.RDFParser.embeddedFile(RDFParser.java:1364)
    at com.hp.hpl.jena.rdf.arp.ARPFilter.parse(ARPFilter.java:312)
    at com.hp.hpl.jena.rdf.arp.ARP.load(ARP.java:291)
    at org.mulgara.content.rdfxml.Parser.run(Parser.java:308)
2008-08-10 22:17:03,209 ERROR Parser - Fatal error, line -1, column -1:
{E300} Error recovery failed.
com.hp.hpl.jena.rdf.arp.ParseException: {E300} Error recovery failed.
    at com.hp.hpl.jena.rdf.arp.RDFParser.error_recovery(RDFParser.java:1961)
    at com.hp.hpl.jena.rdf.arp.RDFParser.description(RDFParser.java:437)
    at com.hp.hpl.jena.rdf.arp.RDFParser.obj(RDFParser.java:346)
    at com.hp.hpl.jena.rdf.arp.RDFParser.rdf(RDFParser.java:326)
    at com.hp.hpl.jena.rdf.arp.RDFParser.root(RDFParser.java:1371)
    at com.hp.hpl.jena.rdf.arp.RDFParser.embeddedFile(RDFParser.java:1364)
    at com.hp.hpl.jena.rdf.arp.ARPFilter.parse(ARPFilter.java:312)
    at com.hp.hpl.jena.rdf.arp.ARP.load(ARP.java:291)
    at org.mulgara.content.rdfxml.Parser.run(Parser.java:308)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mulgara.org/pipermail/mulgara-general/attachments/20080810/5bca2d32/attachment.htm>