Dicussion | HomeBusiness Websites.com

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

HomeBusiness Websites

DoFollow links and https:

Posted By: Scott S. (c-24-9-91-242.hsd1.co.comcast.net)
Date: Thursday, 4 December 2008, at 6:46 p.m.

Is it possible for a SE spider to crawl a site that is password protected? As in an https:www.domain.com. Will it be blocked by the https: or does it require a robot.txt file to block the spider?

Scott S.

Password:

Messages In This Thread

  • DoFollow links and https:
    Scott S. (c-24-9-91-242.hsd1.co.comcast.net) -- Thursday, 4 December 2008, at 6:46 p.m.

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

HomeBusiness Websites is maintained by Administrator with WebBBS 5.12.