Current time: 04-18-2014, 08:40 AM Hello There, Guest! (LoginRegister)

googlebot crawl
05-03-2007, 04:10 PM
Post: #1
googlebot crawl
Hi all (anyone),

I have been searching everywhere for an answer and so I will try here.

Have recently tried to improve SOE and SEF (joomla) and through the diagnositics I notice that gogolebot has not trawlled my sit in 4 months!

http://www.lumieres.com.au

I have done a google serach of my URL and it comes up so that telles we it is not barred (I think that is right but I am a newbie)

I think I had soom errors in the head of my home page (which diverts to the joomla subdirectory.

Looking at the diagnostics, the joomla section of my domain is indexing fine.

What is strange is that the date of the last trwl is about the same time that I moved my domain from aust to the US.

Any clues on how to get googlebot to crawl my site again..

Thanks in advance
Find all posts by this user
05-03-2007, 04:20 PM
Post: #2
googlebot crawl
First of all sign up for google webmaster tools http://www.google.co.uk/intl/en/webmasters/ This will give some more direct information about what has been crawled as opposed to site stats.

If the address has remained the same I don't imagine that google would have stopped.

It might be worth creating a sitemap

Get$97 DISCOUNT with DISCOM97, No monthly setup with DISCNOSET > More Codes
Visit this user's website Find all posts by this user
05-03-2007, 04:53 PM
Post: #3
googlebot crawl
thnx monkeyboy7706,

Yep, I have wbemaster tools and submitted a site map (but that is for the joomla subdirectory - created by joomla component.

I have discovered several things:

1 - home page was missing 2nd <head> tag and had "meta='googlebot' name='noarchive'" in it. (Someone else did the page for me.

2. As a result of the move from my host in Aust to DH, and reworked my whole gallery component and as a result the 190+ url are coming up as not found in the diagnostics. (And these results are about a week old so it is active (??)

To have no trawl for 4-5 months infers that I may be on some 'list'.

Any other clues?

The investigation continues.

Once again thanks...
Find all posts by this user
05-05-2007, 05:53 PM
Post: #4
googlebot crawl
Is it possible that your joomla sitemap program is looking for new content in the wrong directory? Also, try resubmitting your sitemap in webmaster tools - that reset them for me.

http://www.jconnors.net - City Streets
Visit this user's website Find all posts by this user
05-05-2007, 06:33 PM
Post: #5
googlebot crawl
Thanks nalgene1080,

No idea why. I have resub'd sitemap, and still no web crawl since Nov 13, 2006
Find all posts by this user
05-05-2007, 06:38 PM
Post: #6
googlebot crawl
Wierd - has there been new content since then?

http://www.jconnors.net - City Streets
Visit this user's website Find all posts by this user
05-05-2007, 10:32 PM
Post: #7
googlebot crawl
Content has been added over the last few months.

Maybe it is a 'wait and see' now that the new sitemap has been submitted.
Find all posts by this user
05-05-2007, 10:36 PM
Post: #8
googlebot crawl
I did the same thing but googlebot hasn't been around for a few weeks despite new content - pings and sitemap resubmission.

Anyone else have other ideas? I'm guessing that the bot will come with time.

http://www.jconnors.net - City Streets
Visit this user's website Find all posts by this user
05-06-2007, 01:29 AM
Post: #9
googlebot crawl
Doing a site command through Google search shows a lot of problems. Try searching on Google using site:www.lumieres.com.au and you'll see what I mean. Not sure if you've changed some re-write rules or what, but as far as Google is concerned there are a lot of unreachable urls.

Web Hosting Reviews | Get Around The Net Directory
Visit this user's website Find all posts by this user
05-06-2007, 01:50 AM
Post: #10
googlebot crawl
thanks shonky,

Yeah, that is the problem.

I am guessing that I can get googlebot to trawl my site, that would be remedied as it is 'holding' old urls that no longer exist as a result of changes to content.

I need to, somehow, get it to trawl the site as the info it have is 4 months old.

Anyone got any clues?
Find all posts by this user


Forum Jump: