Crawler/Spider Considerations

Discussion in 'SEO' started by Vaador, Oct 23, 2017.

  1. Vaador

    Vaador New Member

    Joined:
    Oct 23, 2017
    Messages:
    8
    Trophy Points:
    1
    Gender:
    Male
    Also, consider technical factors. If a site has a slow connection, it might time-out for the crawler. Very complex pages, too, may time out before the crawler can harvest the text. If you have a hierarchy of directories at your site, put the most important information high, not deep. Some search engines will presume that the higher you placed the information, the more important it is. And crawlers may not venture deeper than three or four or five directory levels. Above all remember the obvious - full-text search engines such index text. You may well be tempted to use fancy and expensive design techniques that either block search engine crawlers or leave your pages with very little plain text that can be indexed. Don’t fall prey to that temptation.
     
  2. JJohansson

    JJohansson New Member

    Joined:
    Jul 10, 2017
    Messages:
    19
    Trophy Points:
    1
    Gender:
    Female
    Ok, Got It, Very Interesting topic sharing.
     

Share This Page