Does size matter?

Does size matter?Does size matter?

Assuming we're talking about the size of HTML, Javascript or images, then yes, it can have an effect.

This is only our opinion but it may be that if a page has over 100k of HTML that this may be fairly difficult to crawl. Our crawler can handle much larger pages because it's designed to do so but a page that size probably isn't that useful to users either so it's worth considering breaking the page down into smaller chunks if possible.

All of the main search engine crawlers have a lot of work to do in crawling billions of web pages. If a crawler comes across a site that's making it work hard perhaps it will move on to another site.

summary image