You are viewing the PKP Support Forum | PKP Home Wiki

Harvesting Cyrillic UTF-8 Archives

Open Harvester Systems support questions and answers, bug reports, and development issues.

Moderators: jmacgreg, michael, John

Forum rules
Developer Resources:

Git: You can access our public Git Repository here. Comprehensive Git usage instructions are available on the wiki.

Bugzilla: You can access our Bugzilla report tracker here.

Search: You can use our Google Custom Search to search across our main website, the support forum, and Bugzilla.

Questions and discussion are welcome.

Harvesting Cyrillic UTF-8 Archives

Postby Imago » Sun Mar 19, 2006 2:13 pm

Dear Friends,

Cyrillic utf8 sites are getting problems while being harvested, say here

http://pkp.sfu.ca/harvester/viewarchive.php?id=268 (ISO encoding)

Using the last release of the Harvester, before installation all ISO charsets in the code have been replaced by UTF-8

Both programs, OJS and Harvester process Russian OK when entered directly, but harvested Cyrillic characters are not recognized, see here

http://meta.scindex.org/archives.php?id=1 (utf-8 encoding)

Both sites are on one and the same server using PHP 5.0.1 and MySQL 4.1.14

Russian e-Journal at http://www.slavica.org/index.php/bulrus has been successfully tested and accepted with http://www.openarchives.org/Register/ValidateSite and http://re.cs.uct.ac.za

It goes without sayng that all possible charset values in my.cnf are set to cp1251 in all possible sections, see here.

TIA for any help!
Last edited by Imago on Thu Nov 22, 2007 6:04 am, edited 1 time in total.
Posts: 8
Joined: Sun Mar 19, 2006 1:31 pm

Postby asmecher » Tue Mar 21, 2006 12:53 pm

Hello Imago,

We're entering the testing phase of a new release of the PKP Harvester; whereas the current stable release of the Harvester uses Latin1, the new version will use UTF-8. It's a complete rewrite based on the OJS 2.x codebase. I've just added your archive to our testing deployment and it is displaying properly.

Alec Smecher
Open Journal Systems Team
Posts: 9907
Joined: Wed Aug 10, 2005 12:56 pm

Postby Imago » Tue Mar 21, 2006 1:29 pm

That's a great news. And a great relief. I am looking forward to the release of the new PKP harvester.

Thank you for the excellent service you provide to the academic and scholarly community.
Posts: 8
Joined: Sun Mar 19, 2006 1:31 pm

Return to Open Harvester Systems Support and Development

Who is online

Users browsing this forum: No registered users and 1 guest