Harvesting Cyrillic UTF-8 Archives

Open Harvester Systems support questions and answers, bug reports, and development issues.

Moderators: jmacgreg, michael, John

Forum rules
The Public Knowledge Project Support Forum is moving to http://forum.pkp.sfu.ca

This forum will be maintained permanently as an archived historical resource, but all new questions should be added to the new forum. Questions will no longer be monitored on this old forum after March 30, 2015.
Posts: 8
Joined: Sun Mar 19, 2006 1:31 pm

Harvesting Cyrillic UTF-8 Archives

Postby Imago » Sun Mar 19, 2006 2:13 pm

Dear Friends,

Cyrillic utf8 sites are getting problems while being harvested, say here

http://pkp.sfu.ca/harvester/viewarchive.php?id=268 (ISO encoding)

Using the last release of the Harvester, before installation all ISO charsets in the code have been replaced by UTF-8

Both programs, OJS and Harvester process Russian OK when entered directly, but harvested Cyrillic characters are not recognized, see here

http://meta.scindex.org/archives.php?id=1 (utf-8 encoding)

Both sites are on one and the same server using PHP 5.0.1 and MySQL 4.1.14

Russian e-Journal at http://www.slavica.org/index.php/bulrus has been successfully tested and accepted with http://www.openarchives.org/Register/ValidateSite and http://re.cs.uct.ac.za

It goes without sayng that all possible charset values in my.cnf are set to cp1251 in all possible sections, see here.

TIA for any help!
Last edited by Imago on Thu Nov 22, 2007 6:04 am, edited 1 time in total.

Posts: 10015
Joined: Wed Aug 10, 2005 12:56 pm

Postby asmecher » Tue Mar 21, 2006 12:53 pm

Hello Imago,

We're entering the testing phase of a new release of the PKP Harvester; whereas the current stable release of the Harvester uses Latin1, the new version will use UTF-8. It's a complete rewrite based on the OJS 2.x codebase. I've just added your archive to our testing deployment and it is displaying properly.

Alec Smecher
Open Journal Systems Team

Posts: 8
Joined: Sun Mar 19, 2006 1:31 pm

Postby Imago » Tue Mar 21, 2006 1:29 pm

That's a great news. And a great relief. I am looking forward to the release of the new PKP harvester.

Thank you for the excellent service you provide to the academic and scholarly community.

Return to “Open Harvester Systems Support and Development”

Who is online

Users browsing this forum: No registered users and 0 guests