Scheduled harvesting

Open Harvester Systems support questions and answers, bug reports, and development issues.

Moderators: jmacgreg, michael, John

Forum rules
The Public Knowledge Project Support Forum is moving to

This forum will be maintained permanently as an archived historical resource, but all new questions should be added to the new forum. Questions will no longer be monitored on this old forum after March 30, 2015.
Posts: 27
Joined: Fri Sep 14, 2007 10:47 am

Scheduled harvesting

Postby fredriley » Fri Nov 09, 2007 7:12 am

HI all

This is a Q I think I already know the answer for, but I'll try it anyway: is there a way to set Harvester to re-harvest/refresh selected archives on schedule? Looking at the documentation it appears that you can only re-harvest manually via the admin interface, or via the command line. I had a quick search on this forum for "harvesting" and there was a thread on "automated harvesting" ( but it wasn't relevant to the Q as far as I could see.

I strongly suspect that the answer is to set up a cron job to run the command on a daily/weekly/whatever basis, which if your sysadmin allows users to run cron jobs is simple enough. The problem arises when this is barred to ordinary users, as is the case at my university, or when Harvester is hosted on a Windoze box, as is the case with a test installation I've got going.



Posts: 10015
Joined: Wed Aug 10, 2005 12:56 pm

Re: Scheduled harvesting

Postby asmecher » Fri Nov 09, 2007 10:10 am

Hi Fred,

I'm afraid Cron is the answer -- you need to somehow invoke:

Code: Select all

php tools/harvest.php all from=last
Without some server-based periodic execution tool, you may be able to cobble together something in PHP, but I don't think it'll be very reliable. (There is a generic plugin called "acron" in the OCS2 CVS tree that you may be able to port over, but I haven't tried it myself.)

I'm sure there is something similar to Cron on the windows platform, but I'm not familiar enough with Windows administration to suggest where to find it.

Alec Smecher
Public Knowledge Project Team

Posts: 27
Joined: Fri Sep 14, 2007 10:47 am

Re: Scheduled harvesting

Postby fredriley » Mon Nov 12, 2007 4:39 am

Thanks, Alec - I figured that would likely be the case, but just wanted to be sure before I hassled our sysadmin.


Return to “Open Harvester Systems Support and Development”

Who is online

Users browsing this forum: No registered users and 3 guests