PDA

View Full Version : Mod Re-write Antiquated Or Even Bad?



Festus
12-04-2006, 12:00 AM
Ok, I'm am so !#&# confused...

In the past I have been an absolute freak demanding my ad pages be htm or html pages, and that the pages didn't have any stop characters such as an ampersand (&), equals sign (=), or question mark (?) in their URLs. These demands, of course, were to keep search engines happy.

Well, I keep a close eye on my site's stats (something I imagine we all do) and over the past couple of months I have been getting more and more confused while watching my stats.

Here's the deal. I own two versions of Geodesic classifieds software, Premier and Enterprise. I bought the Premier version first, I think about 2 1/2 years ago. The Premier writes URLs that don't end with "htm" and "html" and the URLs do have stop characters. When I first bought the Premier version I was aware of this problem and bought it anyway for a number of other reasons. When I first bought the Premier version NONE of the pages showed up in the search engines. Now (about 2 1/2 years later), all or virtually all of the pages are indexed with Google. I simply went to Google and typed in site:www.mysite.com/directory . Clearly, Google is indexing these pages without trouble.

So, about a year ago I bought the Enterprise version but did not launch it until April of this year, and not until the upgrade that uses mod-rewrite and an .htacess file to remove stop characters and that also makes the URLs end with htm. Then I moved an existing database of ads from another ad system into my Geo Entprise system. The users love the Geo system (and so do I) and I have way more ads now (2,000+) than I ever had with the other ad system. But...Google has been steadily indexing fewer of my Geo Enterprise pages. Currently, about 1/4 of my Enterprise pages are listed with Google.

It seems Google is preferring my "bad" pages made with Premier over my "good" pages made with Enterprise. I am so confused... I am currently working on a deeper sitemap.xml file to see how much of that is to blame. In my current sitemap.xml file all of my Premier pages are listed but only about 1/4 of my Enterprise pages. Hmm, this is the same ratio Google is indexing my pages from the two different versions. Coincidence? We'll find out when I get my new sitemap.xml file up. But I do know Google was finding all of my Premier pages before my sitemap.xml file even existed.

I'll post an update here after the new sitemap.xml file has been up a while. I almost feel like turning off the htm files in Enterprise so they go back to the "bad" pages with the stop characters but I'm not brave enough.

By the way, what has happened with this forum's layout that I now constantly have to scroll from left to right? That's new. Always before the width of the forum fit my screen but now it is way too wide.

Parked
12-04-2006, 03:28 AM
By the way, what has happened with this forum's layout that I now constantly have to scroll from left to right? That's new. Always before the width of the forum fit my screen but now it is way too wide.
Yea, I'm experiencing the same with IE6 and FF2.

jonyo
12-04-2006, 09:07 AM
By the way, what has happened with this forum's layout that I now constantly have to scroll from left to right? That's new. Always before the width of the forum fit my screen but now it is way too wide.
Yea, I'm experiencing the same with IE6 and FF2.

What is the screen resolution? I'll bring this up with our design person when they get in.

About the google indexing: Are you comparing indexing of the premeire software with enterprise software now? An older site will always get priority in search engines. When the premiere site was this far along, how did it's indexing compare with the Enterprise's indexing now?

Parked
12-04-2006, 04:29 PM
What is the screen resolution? I'll bring this up with our design person when they get in.
1024x768

Festus
12-04-2006, 05:24 PM
What is the screen resolution? I'll bring this up with our design person when they get in.
My screen resolution is 800 X 600. I think it may be the graphic at the top of the forum (logo_phpBB.gif, 65H X 600W). It seems like I had to start scrolling horizontally when a new graphic showed up.

You are correct in that the Premier version has been installed and running longer than the Enterprise version. However, they're both on the same website. My biggest concern is my sitemap.xml file. It lists all of my Premier version's listings and only about 1/4 of my Enterprise version's listings. Coincedentally, all of my Premier version listings are indexed at Google but only about 1/4 of my Enterprise listings.

In my reading on sitemap files I didn't think it would be a problem not having every listing from my Enterprise version in my sitemap.xml. I thought by having just some of the listings Google would use those as a jumping off point and find the other listings. This may actually be true, I don't know.

So...I'm building a much deeper sitemap.xml file to see what that does. This will probably take a couple of more days then I will upload it. I'll keep my eye on things and report back here on what the deeper sitemap file does for me.


When the premiere site was this far along, how did it's indexing compare with the Enterprise's indexing now?
When the Premier version was first up - and for a long time - none of the listings showed up in Google. I can't remember when but somewhere along the way Google started indexing it (and this was before I was using a sitemap.xml file). So I started at looking at other sites and noticed that Google was indexing their dynamic pages with stop characters, too. So, somewhere along the way as many people had been predicting, Google was figuring out how to handle those dynamic pages which is good news.

carstone
12-05-2006, 03:50 PM
From Google Webmaster Central Blog:

http://googlewebmastercentral.blogspot.com/2006/10/update-to-our-webmaster-guidelines.html

For what it is worth.

Festus
12-05-2006, 05:18 PM
Thank you, carstone. For me that was worth a lot. It was nice to see it in print straight from Google.

jgaulard
12-06-2006, 11:00 AM
Google was much more casual in indexing pages back in the day. Now, it is tougher to get everything indexed, whether it be dynamic or static (mod_rewrite). Your older pages may have gotten in before Google made its latest updates. Don't even think about it anymore. Just run your sitemaps once per week and get some sleep.

I have been running sites that been on a roller coaster with Google. My advice is to ignore it and get on with building your sites. If you react, you are more prone to making bad moves.

ivionday
12-07-2006, 05:45 PM
What is the screen resolution? I'll bring this up with our design person when they get in.
My screen resolution is 800 X 600. I think it may be the graphic at the top of the forum (logo_phpBB.gif, 65H X 600W). It seems like I had to start scrolling horizontally when a new graphic showed up.


Yeah guys, crop that banner graphic down to size. It has 300px of empty white space on the right side.