Harvest full pdf
Moderators: jmacgreg, michael, John
Forum rules
Developer Resources:
Git: You can access our public Git Repository here. Comprehensive Git usage instructions are available on the wiki.
Bugzilla: You can access our Bugzilla report tracker here.
Search: You can use our Google Custom Search to search across our main website, the support forum, and Bugzilla.
Questions and discussion are welcome.
Developer Resources:
Git: You can access our public Git Repository here. Comprehensive Git usage instructions are available on the wiki.
Bugzilla: You can access our Bugzilla report tracker here.
Search: You can use our Google Custom Search to search across our main website, the support forum, and Bugzilla.
Questions and discussion are welcome.
4 posts
• Page 1 of 1
Harvest full pdf
by sarangi » Mon Oct 29, 2007 9:03 am
Is is possible to harvest full pdf file from arxiv.org (or any other data provider) or can I only get summary of contents in the metadata ?
- sarangi
- Posts: 22
- Joined: Mon Oct 22, 2007 11:01 am
Re: Harvest full pdf
by asmecher » Mon Oct 29, 2007 9:31 am
Hi sarangi,
Harvester supports multiple metadata formats as plugins; if you harvest Arxiv using, for example, Dublin Core, the PDF isn't included, although a URL to the PDF should be. To get Harvester to fetch the PDFs as part of the harvesting process, I'd suggest writing a preprocessor plugin.
Regards,
Alec Smecher
Public Knowledge Project Team
Harvester supports multiple metadata formats as plugins; if you harvest Arxiv using, for example, Dublin Core, the PDF isn't included, although a URL to the PDF should be. To get Harvester to fetch the PDFs as part of the harvesting process, I'd suggest writing a preprocessor plugin.
Regards,
Alec Smecher
Public Knowledge Project Team
- asmecher
- Posts: 5925
- Joined: Wed Aug 10, 2005 12:56 pm
Re: Harvest full pdf
by sarangi » Mon Oct 29, 2007 10:10 am
Thanks for your help.
Where can I find help for preprocessor plugins ? maybe examples/samples?
Where can I find help for preprocessor plugins ? maybe examples/samples?
- sarangi
- Posts: 22
- Joined: Mon Oct 22, 2007 11:01 am
Re: Harvest full pdf
by asmecher » Mon Oct 29, 2007 10:46 am
HI sarangi,
Depending on your version, there may be several preprocessor plugins included. Check plugins/preprocessors in your installation. The CVS version of Harvester contains several examples, so if you don't find any in your install, check http://pkp.sfu.ca/cgi-bin/cvsweb.cgi/harvester2/plugins/preprocessors.
See also http://pkp.sfu.ca/harvester_documentation, particularly the Technical Reference.
Regards,
Alec Smecher
Public Knowledge Project Team
Depending on your version, there may be several preprocessor plugins included. Check plugins/preprocessors in your installation. The CVS version of Harvester contains several examples, so if you don't find any in your install, check http://pkp.sfu.ca/cgi-bin/cvsweb.cgi/harvester2/plugins/preprocessors.
See also http://pkp.sfu.ca/harvester_documentation, particularly the Technical Reference.
Regards,
Alec Smecher
Public Knowledge Project Team
- asmecher
- Posts: 5925
- Joined: Wed Aug 10, 2005 12:56 pm
4 posts
• Page 1 of 1
Return to Open Harvester Systems Support and Development
Who is online
Users browsing this forum: No registered users and 1 guest