Harvesting first time out: less records than expected?

[davidWalker]

Sorry, new to PKP Harvester, and harvesting in general.

So I'm looking to harvest from this DSpace repository:

http://sjsu-dspace.calstate.edu/

It has 3,000+ records. But when I do a flush and an update (both from the web and command line) I only get 98 records. No dates or sets selected. Chose 'all sets' in the web interface. Still always 98.

And the ListRecords verb for the archive shows 98:

http://sjsu-dspace.calstate.edu/oai/req ... fix=oai_dc

Am I missing something obvious here?

[davidWalker]

I wonder if this is maybe a Dspace issue.

Reading around a bit in the DSpace docs, I see now why this initial response only contains 100 records. But shouldn't it include a resumption token?

Will ask on the Dspace list as well.

[davidWalker]

This was, in fact, a bug in DSpace 1.5.2. We have it working now.

For posterity, George Kozak from Cornell had this to say on the dspace-tech listserv:

"Yes, I did fix my problem. Stuart Lewis from the Auckland Library told me that my problem was caused by the 'harvest.includerestricted.oai = false' option in the dspace.cfg file. I guess there's a bug in 1.5.2 that's fixed in 1.6. All I did was comment out the line and the harvesting now works fine."