View Full Version : Problems Getting Shop Window Indexed
I am using the AWin Shop Window API Toolset on several sites in a sub-directory called /shop/
However, Google is not indexing any of the pages on any of the sites due to it saying they are blocked by the Robots.txt file.
However, the file is not blocking the directory..
User-agent: *
Disallow:
I have changed the file to this now..
User-agent: *
Allow: /shop/
Disallow:
Does anyone know what, if anything, I'm doing wrong?
The robots.txt file will only get re-indexed by google when it sees fit, normally a couple of days.
1. check the robots.txt file in the root of your site
2. Make sure you don't have a robots.txt in your shop folder
3. try a blog ping service to ping your website and the robots.txt
4. In webmaster tools under labs tab, enter you shop directory and see if google can access that folder - try it with a few other folders/pages
I am having major issues with affiliatewindow and google at the moment, it has dropped all search results. I have removed shop-window as of today, so will see if it comes back.
ss
One thing that I've noticed, which might be causing the issue are the content of the following two files .. blocked_referees.txt and disabled_robots.txt
I've changed the content to pretty much delete everything to see what happens. Does anyone have any experience of this?
I've raised a ticket with Awin but have not had it answered yet.
Hi guys.
I have taken a look at some of the ShopWindow sites using V3 and it appears to not be a widespread problem so we can rule out the Google algorithm reducing the importance on ShopWindow sites for now.
@gadget - You are correct that the referees and robots are probably causing your issues. In your constants.inc.php file you will find a line such as:
define('BOUNCER_STATUS', 0);
If your status is set to '1' I suggest you turn it to '0'. This will allow the webcrawlers listed in your disabled_robots.txt to crawl your site.
The functionality here was introduced to the ShopWindow Client Software when we released V3 after a request by some affiliates to help reduce their ShopWindow API footprint. Along with advanced caching features in the client, it was decided that we would completely disable access to the software for some user-agents such as MJ12bot. We also allow optional disabling of some search engines located in the disabled_robots.txt via the config option listed above.
Our demo sites such as ShopWindow.com have definitely benefited from reduced API consumption whilst still retaining their visitor following.
I understand the WIKI could benefit from some more information on this subject and I will get onto our Tech Services team to ensure this is updated.
Any questions please shout
Cheers
Thanks Ollie. I will try that and report back.