Too many pages... - Post ID 110528

User 70906 Photo


Registered User
77 posts

When running sitemapper I get a message that basically says I have a large amount of pages to

be read and suggests that I eliminate unnecessary urls.

I’m not savvy enough to know what I should eliminate, let alone know how to recognize them.

Any suggestions would be greatly appreciated.

Thanks
User 562592 Photo


Registered User
2,038 posts

I think that is a strange error. We know of an individual right now who has over 600,000 links on his site and sitemapper mapped them just fine. Do you have more than that?
The philosopher has not done philosophy until he has acted upon the mere conviction of his idea; for proof of the theory is in the act, not the idea.

My Web Development Company: http://www.innovatewebdevelopment.com (Created with Coffee Cup Software).

My Personal Website: http://www.EricSEnglish.com

User 70906 Photo


Registered User
77 posts

No. I believe that I have around 1,500 to 2,000 pages.

So, should I just ignore the message and let the mapper run it's course?
User 562592 Photo


Registered User
2,038 posts

I would, see what happens.
The philosopher has not done philosophy until he has acted upon the mere conviction of his idea; for proof of the theory is in the act, not the idea.

My Web Development Company: http://www.innovatewebdevelopment.com (Created with Coffee Cup Software).

My Personal Website: http://www.EricSEnglish.com

User 70906 Photo


Registered User
77 posts

I ran another sitemap scan this morning and this is what I got (see pix). http://b-binc.com/images/sitemapnotice.jpg

It apparently didn't finish the scan.

User 562592 Photo


Registered User
2,038 posts

I think you have to select ok for it to finish the scan. I think it is just a warning letting you know that it will take awhile to sitemap your whole site. It does give you a checkbox at the bottom in case you want to remove the message.
The philosopher has not done philosophy until he has acted upon the mere conviction of his idea; for proof of the theory is in the act, not the idea.

My Web Development Company: http://www.innovatewebdevelopment.com (Created with Coffee Cup Software).

My Personal Website: http://www.EricSEnglish.com

User 70906 Photo


Registered User
77 posts

It turns out that I had a little more urls than I thought. 5,678 as it turns out.

I don't know if there is a specific answer to this, but should it take 30 hours to scan? Or is that typical?
User 562592 Photo


Registered User
2,038 posts

I don't think it should take that long. There is one guy who now has over 1million and it took him two weeks, so I do not think that is proportional. I am wondering if part of it is your computer - does the virtual memory run slow at all?
The philosopher has not done philosophy until he has acted upon the mere conviction of his idea; for proof of the theory is in the act, not the idea.

My Web Development Company: http://www.innovatewebdevelopment.com (Created with Coffee Cup Software).

My Personal Website: http://www.EricSEnglish.com

User 562592 Photo


Registered User
2,038 posts

You may want to double check with support on how fast the program is supposed to run.
The philosopher has not done philosophy until he has acted upon the mere conviction of his idea; for proof of the theory is in the act, not the idea.

My Web Development Company: http://www.innovatewebdevelopment.com (Created with Coffee Cup Software).

My Personal Website: http://www.EricSEnglish.com

User 103173 Photo


VP of Software Development
0 posts

There are really a lot of factors that come into play, computer resources, bandwidth locally, bandwidth on your server, server resources on your computer, type of Web server that is running, amount of concurrent connections your Web server allows etc..

I have a pretty fast connection to my server and it took about 15 min to index around 8,000 pages.
Learn the essentials with these quick tips for Responsive Site Designer, Responsive Email Designer, Foundation Framer, and the new Bootstrap Builder. You'll be making awesome, code-free responsive websites and newsletters like a boss.

Have something to add? We’d love to hear it!
You must have an account to participate. Please Sign In Here, then join the conversation.