URL Limit? - Post ID 226445

User 453426 Photo


Registered User
64 posts

Is there a limit to how many urls the Sitemapper software can handle? Just wondering if 100,000 is too much for it. I've had the progam crash twice now after finding 36,000 urls and having 55,000 in the queue.

I have no doubt some people will see that number and phreak out, but it's a fairly large site. It's certainly no Wal-Mart or Amazon, but the site does have a lot of links to products and groups of products.
User 2147626 Photo


Ambassador
2,958 posts

Max limit is 50,000 pages.
http://www.coffeecup.com/forums/sitemapper/maximum-pages-scanned-limit/
Graphics for the web, email, blogs and more!
-------------------------------------
https://sadduck.com
User 453426 Photo


Registered User
64 posts

wow, thanks for the fast reply. i appreciate the help.
User 2147626 Photo


Ambassador
2,958 posts

Not a problem. Come on back any time! :cool:
Graphics for the web, email, blogs and more!
-------------------------------------
https://sadduck.com
User 103173 Photo


VP of Software Development
0 posts

Hey there!

That is the maximum amount of URL's allowed in a sitemap. This is according to the specifications set at http://www.sitemaps.org/faq.html

Q: How big can my Sitemap be?
Sitemaps should be no larger than 10MB (10,485,760 bytes) and can contain a maximum of 50,000 URLs. These limits help to ensure that your web server does not get bogged down serving very large files. This means that if your site contains more than 50,000 URLs or your Sitemap is bigger than 10MB, you must create multiple Sitemap files and use a Sitemap index file. You should use a Sitemap index file even if you have a small site but plan on growing beyond 50,000 URLs or a file size of 10MB. A Sitemap index file can include up to 1,000 Sitemaps and must not exceed 10MB (10,485,760 bytes). You can also use gzip to compress your Sitemaps.
Learn the essentials with these quick tips for Responsive Site Designer, Responsive Email Designer, Foundation Framer, and the new Bootstrap Builder. You'll be making awesome, code-free responsive websites and newsletters like a boss.
User 187934 Photo


Senior Advisor
20,181 posts

50 million. That might be enough.:lol:
I can't hear what I'm looking at.
It's easy to overlook something you're not looking for.

This is a site I built for my work.(RSD)
http://esmansgreenhouse.com
This is a site I built for use in my job.(HTML Editor)
https://pestlogbook.com
This is my personal site used for testing and as an easy way to share photos.(RLM imported to RSD)
https://ericrohloff.com

Have something to add? We’d love to hear it!
You must have an account to participate. Please Sign In Here, then join the conversation.