I'm responsible for OJS instalation at http://forumoswiatowe.pl. First journal issue was published recently. However, the website is still invisible to various web crawlers and bots. I've done some research and was perplexed to see that some services are reporting weird errors like no meta-tags.
For example, scanning the website here http://www.submitexpress.com/analyzer/ results with no basic meta tags (description, title, keywords) which isn't true as they appear in website's code. Also, a validator at http://validator.w3.org/ generates one error
- Code: Select all
Line 1, Column 1: end of document in prolog
I believe that website's invisibility in web search engines is caused by something blocking bots and crawlers from indexing it. So far I've checked the robots.txt file and .htaccess files in search of some errors with no success. Robots.txt disallow only /cache/ access and I have a wide list of bots excluded from the site in .htaccess file which I have also temporarily removed in order to check if it's not causing google bot or other services to stop indexing the website - it didn't.
Does anyone have a suggestion of what might be the cause of this problem?