URL's some but not all showing up in sitemap
« on: February 11, 2008, 11:25:23 PM »
Hi,
I'm trying to create a site map for [ External links are visible to forum administrators only ] using this tool. I am running into a problem

im using Do not parse URLs: as follows

city_page.php?
view_details.php?id=
listings.php?action=
upgrade_preview_go.php?action=upgrade
add_listings.php?action=upgrade
gomylocal_icon1.php
community/
forum/
mediawiki/

im using Exclude URLs: as follows

city_page.php?zip=
view_details.php?id=
listings.php?action=
upgrade_preview_go.php?action=upgrade
add_listings.php?action=upgrade
gomylocal_icon1.php
gomylocal_state_map
community/
forum/
mediawiki/

The problem that i am getting is that it seems to get everything. except when i get to

city_page.php

it does retrieve files from CA(california) but doesn't retrieve any other states files and put them in the sitemap--see examples below

 <url>
       <loc>[ External links are visible to forum administrators only ]</loc>
       <priority>1.0</priority>
       <changefreq>daily</changefreq>
       <lastmod>2008-02-11T14:50:22+00:00</lastmod> 
  </url>

The links are generated from this page
[ External links are visible to forum administrators only ] - if you click on the state you will get to the page that should create the links [ External links are visible to forum administrators only ] ... like i said above the CA page is the only page being included in site map... I need all other states to be included also

or please see sitemap.xml

[ External links are visible to forum administrators only ]

Any help would be great on this thanks

Verk
[ External links are visible to forum administrators only ]



 

Re: URL's some but not all showing up in sitemap
« Reply #1 on: February 12, 2008, 01:08:23 AM »
Hello,

I see other states URLs in sitemap as well:
Code: [Select]
  <url>
       <loc>http://www.gomylocal.com/state_page.php?action=View&amp;State=ID</loc>
       <priority>1.0</priority>
       <changefreq>daily</changefreq>
       <lastmod>2008-02-11T14:50:22+00:00</lastmod> 
  </url>
  <url>
       <loc>http://www.gomylocal.com/state_page.php?action=View&amp;State=MT</loc>
       <priority>1.0</priority>
       <changefreq>daily</changefreq>
       <lastmod>2008-02-11T14:50:22+00:00</lastmod> 
  </url>
...
etc

Re: URL's some but not all showing up in sitemap
« Reply #2 on: February 12, 2008, 01:17:13 AM »
i waited sometime and tried again and it seemed to work.

I am having another issue that I have been banging my head against the wall about

the city_pages are the only pages that don't seem to be getting the Title and Meta Description...Please see html sitemap below

[ External links are visible to forum administrators only ]

Any help with this would be great

Verk
[ External links are visible to forum administrators only ]

P.S. this is a great piece of software --- well done



Re: URL's some but not all showing up in sitemap
« Reply #3 on: February 12, 2008, 05:15:33 AM »
i waited sometime and tried again and it seemed to work.

I am having another issue that I have been banging my head against the wall about

the city_pages are the only pages that don't seem to be getting the Title and Meta Description...Please see html sitemap below -- Sorry the Title is not there and it is a meta description that exist from another page (the meta description is totally wrong, If that makes any sense)

[ External links are visible to forum administrators only ]

Any help with this would be great

Verk
[ External links are visible to forum administrators only ]

P.S. this is a great piece of software --- well done




Re: URL's some but not all showing up in sitemap
« Reply #4 on: February 12, 2008, 10:43:58 PM »
Hello,

you have them added in "Do not parse" option. That greatly improves crawling speed, but since sitemap generator *doesn't* retrieve those pages, it cannot determine the title.
Re: URL's some but not all showing up in sitemap
« Reply #5 on: February 14, 2008, 08:08:18 AM »
IS there are way to only parse the Title and description?
Re: URL's some but not all showing up in sitemap
« Reply #6 on: February 14, 2008, 08:03:54 PM »
You can add this tag on those pages to disallow following the links on them:
Code: [Select]
<meta name="robots" content="index,nofollow">
Re: URL's some but not all showing up in sitemap
« Reply #7 on: March 03, 2008, 08:15:02 PM »
I have have run into the problem again -

these show upo in the site map

Atlanta-GA
Austin-TX
Baltimore-MD
Boston-MA
Charlotte-NC
Chicago-IL
Cincinnati-OH
Dallas-TX
Denver-CO
Detroit-MI
Honolulu-HI
Houston-TX
Indianapolis-IN
Kansas City-MO
Las Vegas-NV
Los Angeles-CA
Louisville-KY
Memphis-TN
Miami-FL
Milwaukee-WI
New Orleans-LA
New York-NY
Oakland-CA
Oklahoma City-OK
Orlando-FL
Philadelphia-PA
Phoenix-AZ
Sacramento-CA
Saint Louis-MO
San Antonio-TX
San Diego-CA
San Francisco-CA
San Jose-CA
Seattle-WA
Washington-DC

and all of

california
[ External links are visible to forum administrators only ]

but other states dont index?

Please help

LAst time i waited a few hours and it worked - i will try that again but maybe  you can have a look for me
Re: URL's some but not all showing up in sitemap
« Reply #9 on: April 04, 2008, 05:36:36 AM »
Ok i am having the same problem again trying to create my site map. can yo please help. I tried waiting a few hours and that didn't work?

[ External links are visible to forum administrators only ]

notice that only CITY-CA(California) are showing up - and the links to other cities in other states are the same type - the only difference is that CA is the first link

other cities and states??? this is the 3rd time i have had this problem and this time it doesnt seemd to be correctin it self


« Last Edit: April 04, 2008, 06:11:06 AM by imverk »