fcsurplus.ca
robots.txt
Robots Exclusion Standard data for fcsurplus.ca
Resource Scan
Scan Details
Site Domain | fcsurplus.ca |
Base Domain | fcsurplus.ca |
Scan Status | Ok |
Last Scan | 2024-09-23T15:00:28+00:00 |
Next Scan | 2024-09-30T15:00:28+00:00 |
Last Scan
Scanned | 2024-09-23T15:00:28+00:00 |
URL | https://fcsurplus.ca/robots.txt |
Redirect | https://www.fcsurplus.ca/robots.txt |
Redirect Domain | www.fcsurplus.ca |
Redirect Base | fcsurplus.ca |
Domain IPs | 104.21.64.118, 172.67.183.175, 2606:4700:3035::ac43:b7af, 2606:4700:3037::6815:4076 |
Redirect IPs | 104.21.64.118, 172.67.183.175, 2606:4700:3035::ac43:b7af, 2606:4700:3037::6815:4076 |
Response IP | 104.21.64.118 |
Found | Yes |
Hash | d46d54aff30d2900cce12a7278811fee93aab26a7ef875667770689436d38f9b |
SimHash | e7b77aa3c5d3 |
Groups
*
googlebot
googlebot-image
bingbot
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler
ia_archiver
duckduckbot
exabot
facebot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /main_images/ |
Disallow | /stats/ |
Disallow | /forum/ |
Disallow | /subscribe/ |
Disallow | /webalizer/ |
Disallow | /clients/ |
Disallow | /awstats/ |
Disallow | /DB/ |
Disallow | /data/ |
Disallow | /aspnet_client/ |
Disallow | /emailstuff/ |
Disallow | /sspace/ |
Disallow | /searchenginebuttons/ |
Disallow | /_vti_cnf/ |
Disallow | /_vti_log/ |
Disallow | /_vti_pvt/ |
Disallow | /shopping2/ |
Disallow | /shopping3/ |
Disallow | /shopping4/ |
Disallow | /shopping5/ |
Disallow | /shopping6/ |
Disallow | /shopping7/ |
Disallow | /shopping8/ |
Disallow | /shopping9/ |
Disallow | /oldshopping/ |
Disallow | /shoppingtest/ |
Disallow | /vpasp7001plus_bak/ |
Disallow | /vote/ |
Disallow | /test/ |
Disallow | /searchenginebuttons/ |
Disallow | /shopping/main_images/ |
Disallow | /cgi-bin |
Disallow | /main_images |
Disallow | /stats |
Disallow | /forum |
Disallow | /subscribe |
Disallow | /webalizer |
Disallow | /clients |
Disallow | /awstats |
Disallow | /DB |
Disallow | /data |
Disallow | /aspnet_client |
Disallow | /emailstuff |
Disallow | /sspace |
Disallow | /searchenginebuttons |
Disallow | /_vti_cnf |
Disallow | /_vti_log |
Disallow | /_vti_pvt |
Disallow | /shoppingtest |
Disallow | /shopping2 |
Disallow | /shopping3 |
Disallow | /shopping4 |
Disallow | /shopping5 |
Disallow | /shopping6 |
Disallow | /shopping7 |
Disallow | /shopping8 |
Disallow | /shopping9 |
Disallow | /oldshopping |
Disallow | /vpasp7001plus_bak |
Disallow | /vote |
Disallow | /test |
Disallow | /searchenginebuttons |
Disallow | /shopping/main_images |
Other Records
Field | Value |
---|---|
sitemap | https://www.fcsurplus.ca/shopping/google/sitemap.xml |
Comments