Dreamhost server blocking Bingbot and Facebook bot


#1

Server access logs show Facebook externalhit bot (173.252.64.0 - 173.252.127.255) and Bingbot (157.54.0.0 - 157.60.255.255) are blocked with a 403.

157.56.93.72 - - [26/Apr/2014:09:24:45 -0700] "GET /example.html HTTP/1.1" 403 911 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"  

173.252.112.112 - - [26/Apr/2014:10:11:37 -0700] "GET /public/example.jpg HTTP/1.1" 403 910 "-" "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)" 

Hits from Facebook and Bingbot from other IP ranges are given access with a 200 OK.

I have nothing in my custom htaccess blocking either of these IP ranges or User Agents (tested with 3rd party tools.) My site is up and running and thousands of other requests are being fulfilled without issue. However, I do see some other unexplained 403s blocking random human visitors for no explained reason.

To the best of my knowledge, this has been occurring for about 12 hours.

I can only assume these IP ranges are being blocked somewhere at the server admin level. I have sent in a support ticket but have not received a reply.

This is very serious and will do significant damage to my site’s indexing at Bing, as well as hurt traffic from Facebook.

Can I get an admin to look into this ASAP? Thanks.

www.apassion4jazz.net


#2

[quote]Bing could not access this site. See below for more details:
URL http://apassion4jazz.net/
HTTP Error: Status Code 403. We did not receive a 200 (OK) response when requesting your page. Please make sure the URL exists and try again.[/quote]

I am *not" blocking this IP range nor am I blocking anything in this User Agent string.


#3

It miraculously corrected itself… without me doing anything. Another clue it was server admin related. I’m now wondering if anyone for DH is going to claim responsibility. Still haven’t heard a peep.


#4

This is very disappointing. Shame on you DH admins for not stepping up and being honest.