Support Center > Forum > General > Search engine spidering
Search engine spidering
Your forum will be spidered (indexed) by search engines if it is linked to a page that the search engine can get to. For example, you should place your forum link somewhere on your website so that the search engine can follow that link and then index your forum.
Forums generally get very high rankings on search engines because they are filled with content all related to the same general topic. Search engines love this because it is exactly what they are looking for. Forums will typically help boost your website's ranking in the search engines as well since there is a link to your website on your forum.
Additionally, Website Toolbox forums have been developed with search engine optimization concepts in mind. For example, topic URLs contain the keywords used in the topic title, increasing the changes that a search engine will find those keywords relevant to that page.
Be sure to customize your forum domain name to match your website. That will allow your main website to receive full credit for all the valuable content on your forum. Search engines will not be able to tell that your forum is hosted on Website Toolbox.
Search engines love content. If your forum is new, create as many helpful topics as you can. That will give the search engines something to index and will help bring people searching for that content to your forum. The topics should be relevant to the general theme of your forum and should be valuable to the reader. Toward the end of your post, encourage readers to ask questions or give their feedback so you can turn readers into posters and help your forum grow. The more useful content you post, the more search engines will refer users to your forum.
Create more quality links on the Internet pointing to your forum. When other websites link to a page, search engines considers that like a vote for the page. The links should preferably contain the keywords you are trying to get a higher ranking for.
Target long-tail keywords rather than short highly competitive keywords. For example, forum would be a highly competitive keyword that would be very difficult to rank well for. However, it would be significantly easier to target a long-tail keyword such as create a website forum.
Use the keywords that you are targeting in your forum titles, forum descriptions, and posts. Search engines will only think those keywords are relevant to your forum if they see them being mentioned.
Also, be sure to add meta tags to your forum.
You can prevent your entire forum or specific forums from getting spidered by turning on password protection or by forcing guests to login before allowing access to the forum. Another way to prevent your entire forum from getting spidered is to insert the following HTML code into the Forum Head Tag HTML Code text box in the Appearance -> HTML section of your Website Toolbox account:
If all of the pages in your forum are not being indexed, it may be due to the following:
If some of the pages in your forum are not being indexed, it may be due to the following:
Pages viewed by a search engine while indexing your forum are counted as page views.