Q and A: If dynamically generated pages don't technically exist, how do they get indexed?
Dear Kalena...
I am puzzled about dynamically generated pages. Since they don't actually 'exist', how do they get indexed? (I know you can mod_rewrite their urls, but they still don't 'exist' anywhere, right?)
AP
Kalena's Answer:
Dear AP
Well technically, no they don't exist until the page is "called". But from what I understand, a search robot, when indexing a site, can create them on the fly, just like a browser can. That's how they get indexed and links between them are followed.
Most search spiders/robots won't index more than a few pages of a dynamic site because of the unknown number of pages they represent. That's why services such as Google Sitemaps and Yahoo Site Explorer have developed - so you can "tell" a search engine how many URLs your site has - dynamic or otherwise. You should create an XML sitemap and submit it to both services.
Mod_rewrite is good, but prob not necessary now that engines have better technical ability to process dynamically generated content.
---------------------------
[If you found this post helpful, you might benefit from downloading our free Search Engine Optimization lesson]
I am puzzled about dynamically generated pages. Since they don't actually 'exist', how do they get indexed? (I know you can mod_rewrite their urls, but they still don't 'exist' anywhere, right?)
AP
Kalena's Answer:
Dear AP
Well technically, no they don't exist until the page is "called". But from what I understand, a search robot, when indexing a site, can create them on the fly, just like a browser can. That's how they get indexed and links between them are followed.
Most search spiders/robots won't index more than a few pages of a dynamic site because of the unknown number of pages they represent. That's why services such as Google Sitemaps and Yahoo Site Explorer have developed - so you can "tell" a search engine how many URLs your site has - dynamic or otherwise. You should create an XML sitemap and submit it to both services.
Mod_rewrite is good, but prob not necessary now that engines have better technical ability to process dynamically generated content.
---------------------------
[If you found this post helpful, you might benefit from downloading our free Search Engine Optimization lesson]
Labels: dynamic pages, google sitemaps, yahoo site explorer
1 Comments:
Although the bots have become better with Dynamic pages but you have to make sure the session ids and everything is taken care
Post a Comment
<< Home