Error while loading a large graph into virtuoso

Virtuoso Universal Server
,
1

Hi,
We are trying to load a large file(~100 GB) using the ld_dir function. However, On refreshing the SPARQL to check the number of triples, it’s getting increased. The log of virtuoso is showing below error.

04:55:42 ERROR: Write wait on column page 3265023.  Waits should be on the index leaf page, except when col page is held for read by background write
04:55:42 ERROR: Write wait on column page 4552709.  Waits should be on the index leaf page, except when col page is held for read by background write
04:55:55 ERROR: Write wait on column page 1487127.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 136883.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 3138489.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 3548418.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 3778058.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 4254760.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 4542346.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 4542348.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 4542350.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:19 ERROR: Write wait on column page 4542354.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:26 ERROR: Write wait on column page 4123419.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:26 ERROR: Write wait on column page 2537366.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:26 ERROR: Write wait on column page 2537417.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:34 ERROR: Write wait on column page 3003786.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:34 ERROR: Write wait on column page 4002375.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:34 ERROR: Write wait on column page 3689600.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:34 ERROR: Write wait on column page 1421217.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:34 ERROR: Write wait on column page 4214301.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2393755.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 3227432.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2615514.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 4090175.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 1222400.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2393783.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2424120.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 1222626.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2976562.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 4089688.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2720301.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 1304266.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2720422.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2424155.  Waits should be on the index leaf page, except when col page is held for read by background write
04:56:39 ERROR: Write wait on column page 2615307.  Waits should be on the index leaf page, except when col page is held for read by background write

Can you please let us know how to handle this error?
Also, We want to upgrade the current virtuoso open source edition 2017 to stable/7 version. Is there a procedure to do so without having to reload all the graphs in the existing system?

Regards,
Gopi

2

From my last comment in your previous post SPARQL query throwing compilation error - #8 by hwilliams , have you now Performance Tuned the Virtuoso instance for hosting large amounts of data ?

What is the triple format of this ~100 GB file, and are you actually loading it as a single file ? As generally it is recommended dataset files be split into sizes of about 1GB and loaded with multiple rdf_loader_run() processes depending on the number of cores on the machine for optimal loading for the dataset.

What does the output of running the status(); command run from the isql command line tool return when the dataset is loading ?

Please provide a copy of the virtuoso.ini and virtuoso.log files for review.

The Upgrading from VOS 7.2.X to VOS 7.2.7 document provides instructions on upgrading an existing open source version to the latest stable/7.