|
Spider your site to gather information about your web sites
structure, pages and links to outside pages. Why do this? Firstly, different
pages of your site may contain different types of information. Pages of
your web site contain links to outside sources, and the latter also need
to be indexed - this may diversify and increase your page's visibility
on search engines.
Usually it is the site's main page, as it contains links,
following which a visitor may get to any part of the website. Starting
from this page spider will index the rest of the site. You may want to
index external links on your web site. For this option select Use links
to external pages Define file extensions to index. You may select certain
file types to be indexed by checking appropriate check boxes in the Extensions
window. Set Maximum number of links and maximum number of levels to be
spidered. It is recommended that your site should not contain files that
are not within two clicks of the mouse, i. e. two levels. This software Simulates a Search Engine by displaying the contents of a webpage exactly how a Search Engine would see it. It also displays the hyperlinks that will be followed (crawled) by a Search Engine when it visits the specified webpage.
Search engine spider emulator features:
- Program show broken links on your site
- Support Robot.Txt file
- Support tag noindex
- Program requires HTTP and HTTPS connections. Direct internet connection
or connnection through a proxy server are required.
As a registered customer, you are entitled to:
- Free updates that will be released within 1 year from the date of
purchase;
- Information on updates and new products;
- Free technical support. Technical Support for all products provided
by e-mail.
For more information about Search engine spider emulator,
contact support@promotion-soft.com.
|