Home Forum Advertise Contact Me About WPTavern WPWeekly Show Info

Go Back   WordPress Tavern Forum » WordPress » Plugins And Hacks

Plugins And Hacks Anything and everything related to plugins

Reply
 
Share LinkBack Thread Tools Display Modes
Old 07-02-2009, 08:44 AM
JohnM's Avatar
Big Tipper
 
About
Join Date: Feb 2009
Location: Norway
Posts: 314
Default

Why block bots ?

Because of the time factor to fix. You dont want robots to index while your site is compromised with spam links like CssTricks or malware redirection like the Ford Wordpress site.

However I dont know, maybe blocking bots have the same negative effect on PR/SERP.

CSS Tricks spam hacking:
http://diggingintowordpress.com/2009...ection-hacked/

Quote:
Although the spam wasn’t on my site for more than a few hours, someone has pointed out to me that my Google PageRank for the homepage has dropped from a reasonable and healthy PR 6 to ZERO. While PageRank is a very weird thing and it could be any number of things including a random inaccurate report from Google, it seems more likely this is a penalization from them for the spam. Many of my subpages, which get crawled far less frequently, still have their PageRank. It’s not just the PageRank, many searches that would have brought up the homepage (e.g. my own name) are now far down the SERP pages when they used to be #1. This of course will be seriously affecting my traffic until my PageRank is restored, if it ever is.
Reply With Quote
Old 07-02-2009, 10:17 AM
Otto's Avatar
Kegger
 
About
Join Date: Apr 2009
Location: Memphis, TN
Posts: 510
Default

Quote:
Originally Posted by Ryan View Post
Why block bots at all? Wouldn't it make more sense to just email the administrator so they can go in and clear the problem?

I would have thought that blocking bots would lead to a reduction in rankings anyway since it looks like you don't want your site indexed at all.
Having a spider grab your site while it's got spam links on it can be problematic. Blocking the spider temporarily is better in the long run. The spider doesn't have to know, especially if you send back some sort of transient error code to it, like a 503 error. Then it will basically ignore the result and spider you again later, hopefully after you've cleaned up the mess.
Reply With Quote
Old 07-02-2009, 10:26 AM
JohnM's Avatar
Big Tipper
 
About
Join Date: Feb 2009
Location: Norway
Posts: 314
Default

Yep, thats a good solution, Otto.

http://www.askapache.com/htaccess/50...available.html

Quote:
Send 503 only to Google Bots

Options +FollowSymLinks
RewriteEngine On
RewriteBase /

RewriteCond %{HTTP_USER_AGENT} ^.*(Googlebot|Googlebot|Mediapartners|Adsbot|Feedf etcher)-?(Google|Image)? [NC]
# or RewriteCond %{HTTP_USER_AGENT} ^.*google.* [NC]
RewriteRule .* /cgi-bin/error/503.php
Reply With Quote
Old 07-03-2009, 03:54 AM
Jeffro's Avatar
WPTavern Forum Admin
 
About
Join Date: Jan 2009
Location: Ohio
Posts: 1,702
Send a message via AIM to Jeffro Send a message via Skype™ to Jeffro
Default

I was going to publish the same information John did regarding CSS-Tricks and how their PageRank dropped suddenly after he realized the site was filled with Spam links.

Is it really getting to the point now where the same techniques I use on my desktop PC I need to translate to my blog? Like a AntiVirus program, spyware scanner, etc? Does anyone know of a post that has published performance results from WordPress sites with security plugins enabled? I think it'd be interesting. Specifically, speed/loading tests.
Reply With Quote
Old 07-03-2009, 09:49 AM
JohnM's Avatar
Big Tipper
 
About
Join Date: Feb 2009
Location: Norway
Posts: 314
Default

I`m not aware of any performance tests, but I may do some light testing on one of my testing servers. What kind of data are you interested in ?
Reply With Quote
Old 07-03-2009, 02:29 PM
Jeffro's Avatar
WPTavern Forum Admin
 
About
Join Date: Jan 2009
Location: Ohio
Posts: 1,702
Send a message via AIM to Jeffro Send a message via Skype™ to Jeffro
Default

I guess loading times with the plugins enabled and disabled. Much like antivirus programs on the PC would slow things down, I wonder if the same thing happens with WordPress.
Reply With Quote
Old 07-03-2009, 03:55 PM
JohnM's Avatar
Big Tipper
 
About
Join Date: Feb 2009
Location: Norway
Posts: 314
Default

I may some testing on sunday and PM you the results if you want to use it in an article.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -5. The time now is 08:07 PM.