[Mulgara-general] Memory error during rdf load

[Paul Gearon]

Do you know if you are running Mulgara in 32 bit or 64 bit mode? The
answers are different, depending on what mode you're in.

Regards,
Paul Gearon

On Mon, Aug 11, 2008 at 12:18 AM, Bill OConnor <wtoconnor at gmail.com> wrote:
> 2008-08-10 11:15:32,522 WARN  TripleWriteThread - Exception during abort of
> TripleWriteThread:
> /home/wto/Projects/dmoz/server1/xaStatementStore/xa.g_3120
> java.lang.OutOfMemoryError
>     at sun.misc.Unsafe.allocateMemory(Native Method)
>     at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:117)
>     at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:305)
>     at org.mulgara.store.xa.Block.newInstance(Block.java:168)
>     at org.mulgara.store.xa.IOBlockFile.allocateBlock(IOBlockFile.java:138)
>     at org.mulgara.store.xa.IOBlockFile.readBlock(IOBlockFile.java:152)
>     at
> org.mulgara.store.xa.ManagedBlockFile$Phase.readBlock(ManagedBlockFile.java:382)
>     at
> org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriple(TripleAVLFile.java:857)
>     at
> org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriples(TripleAVLFile.java:706)
>     at
> org.mulgara.store.statement.xa.TripleWriteThread.run(TripleWriteThread.java:155)
> 2008-08-10 11:15:32,522 WARN  TripleWriteThread - Exception during abort of
> TripleWriteThread:
> /home/wto/Projects/dmoz/server1/xaStatementStore/xa.g_3201
> java.lang.OutOfMemoryError
>     at sun.misc.Unsafe.allocateMemory(Native Method)
>     at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:117)
>     at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:305)
>     at org.mulgara.store.xa.Block.newInstance(Block.java:168)
>     at org.mulgara.store.xa.IOBlockFile.allocateBlock(IOBlockFile.java:138)
>     at org.mulgara.store.xa.IOBlockFile.readBlock(IOBlockFile.java:152)
>     at
> org.mulgara.store.xa.ManagedBlockFile$Phase.readBlock(ManagedBlockFile.java:382)
>     at
> org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriple(TripleAVLFile.java:857)
>     at
> org.mulgara.store.statement.xa.TripleAVLFile$Phase.syncAddTriples(TripleAVLFile.java:706)
>     at
> org.mulgara.store.statement.xa.TripleWriteThread.run(TripleWriteThread.java:155)
> 2008-08-10 22:17:02,985 ERROR Parser - Error, 20364240, column 9: {E213}
> Connection refused to host: 127.0.1.1; nested exception is:
>     java.net.ConnectException: Connection refused
> com.hp.hpl.jena.rdf.arp.ParseException: {E213} Connection refused to host:
> 127.0.1.1; nested exception is:
>     java.net.ConnectException: Connection refused
>     at com.hp.hpl.jena.rdf.arp.ARPFilter.parseWarning(ARPFilter.java:559)
> Hello,
>
> I have been experimenting with Mulgara by trying to load the dmoz open
> directory project. I believe that I have fixed
> most of the invalid URI problems I was experiencing. However after several
> hours of loading a 2 Gig rdf it fails with the following stack.
>
> The client side never returns with an error.
>
> Anybody have any suggestion were I should go from here?
>
>
> at com.hp.hpl.jena.rdf.arp.ARPFilter.parseWarning(ARPFilter.java:552)
>     at
> com.hp.hpl.jena.rdf.arp.ParserSupport.saxException(ParserSupport.java:183)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.saxEx(RDFParser.java:260)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.oneWhite(RDFParser.java:248)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.white1(RDFParser.java:172)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.white(RDFParser.java:137)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.zwhite(RDFParser.java:132)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.typedNode(RDFParser.java:985)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.description(RDFParser.java:429)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.obj(RDFParser.java:346)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.rdf(RDFParser.java:326)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.root(RDFParser.java:1371)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.embeddedFile(RDFParser.java:1364)
>     at com.hp.hpl.jena.rdf.arp.ARPFilter.parse(ARPFilter.java:312)
>     at com.hp.hpl.jena.rdf.arp.ARP.load(ARP.java:291)
>     at org.mulgara.content.rdfxml.Parser.run(Parser.java:308)
> 2008-08-10 22:17:03,209 ERROR Parser - Fatal error, line -1, column -1:
> {E300} Error recovery failed.
> com.hp.hpl.jena.rdf.arp.ParseException: {E300} Error recovery failed.
>     at com.hp.hpl.jena.rdf.arp.RDFParser.error_recovery(RDFParser.java:1961)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.description(RDFParser.java:437)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.obj(RDFParser.java:346)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.rdf(RDFParser.java:326)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.root(RDFParser.java:1371)
>     at com.hp.hpl.jena.rdf.arp.RDFParser.embeddedFile(RDFParser.java:1364)
>     at com.hp.hpl.jena.rdf.arp.ARPFilter.parse(ARPFilter.java:312)
>     at com.hp.hpl.jena.rdf.arp.ARP.load(ARP.java:291)
>     at org.mulgara.content.rdfxml.Parser.run(Parser.java:308)
>
>
> _______________________________________________
> Mulgara-general mailing list
> Mulgara-general at mulgara.org
> http://mulgara.org/mailman/listinfo/mulgara-general
>
>