Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

How do I index multiple domains or sub-domains as one site (in spider mode)?

0
Posted

How do I index multiple domains or sub-domains as one site (in spider mode)?

0

You can specify multiple start points to begin indexing from in both spider mode and offline mode. This can be accessed by clicking on the “More” button next to the Start Spider URL or Start folder. In spider mode, this allows the spider to span across multiple websites or domains. With each of these additional URLs you can also specify a spidering option (“index page and follow links”, “index single page only”, “follow links only”, etc.), click on Help in this window for more information. You can also import or export these start points from a text file. More information in our PDF Users Guide. In offline mode, you can specify multiple folders that may be under different root paths to be indexed. Note that all folders under each Start directory are indexed unless they match a pattern in the Skip page or folder list.

Related Questions

What is your question?

*Sadly, we had to bring back ads too. Hopefully more targeted.