OJS OCS OMP OHS

You are viewing the PKP Support Forum | PKP Home Wiki



Harvester Throttle

Open Harvester Systems support questions and answers, bug reports, and development issues.

Moderators: jmacgreg, michael, John

Forum rules
Developer Resources:

Git: You can access our public Git Repository here. Comprehensive Git usage instructions are available on the wiki.

Bugzilla: You can access our Bugzilla report tracker here.

Search: You can use our Google Custom Search to search across our main website, the support forum, and Bugzilla.

Questions and discussion are welcome.

Harvester Throttle

Postby thornleyk » Mon May 07, 2007 9:16 pm

Hi All,

May I suggest a new Configuration parameter?

It seems as Digital Commons sites have a rather annoying "feature" where multiple requests by the same IP are denied if followed in quick succession.

This mainly occurs on the resumption token. I have got around this by adding:

usleep(2000000);

After the declaration of function handleResumptionToken in OAIHarvesterPlugin

It would make sense if this could be configured in the config.inc file and turned on or off

What do you guys think??

Cheers
Kris
thornleyk
 
Posts: 9
Joined: Tue Oct 03, 2006 1:00 pm
Location: CPIT, New Zealand

Postby asmecher » Tue May 08, 2007 9:04 am

Hi Kris,

Strange -- were you able to find that particular behavior documented anywhere? I'd rather work with Digital Commons to correct the problem, rather than adding a work-around to the Harvester.

Regards,
Alec Smecher
Public Knowledge Project Team
---
Don't miss the First International PKP Scholarly Publishing Conference
July 11 - 13, 2007, Vancouver, BC, Canada
http://ocs.sfu.ca/pkp2007/
asmecher
 
Posts: 9090
Joined: Wed Aug 10, 2005 12:56 pm

Postby thornleyk » Tue May 08, 2007 1:47 pm

To replicate try this:

In web browser go to:

http://digitalcommons.massey.ac.nz/cgi/ ... b=Identify

and then once displayed quickly press refresh. This will simulate what the harvester is presented with.

Cheers
Kris
thornleyk
 
Posts: 9
Joined: Tue Oct 03, 2006 1:00 pm
Location: CPIT, New Zealand

Postby asmecher » Tue May 08, 2007 4:21 pm

Hi Kris,

I see your point. I'll file an entry in Bugzilla for the next release recommending a throttle option in the configuration file.

Regards,
Alec Smecher
Open Journal Systems Team
asmecher
 
Posts: 9090
Joined: Wed Aug 10, 2005 12:56 pm

Re: Harvester Throttle

Postby asmecher » Fri Dec 12, 2008 2:20 pm

Hi all,

FYI, the bugzilla entry for this issue is at http://pkp.sfu.ca/bugzilla/show_bug.cgi?id=2822. The new feature will be released with the next version of the Harvester.

Regards,
Alec Smecher
Public Knowledge Project Team
asmecher
 
Posts: 9090
Joined: Wed Aug 10, 2005 12:56 pm


Return to Open Harvester Systems Support and Development

Who is online

Users browsing this forum: No registered users and 0 guests