saabnet.com
robots.txt

Robots Exclusion Standard data for saabnet.com

Resource Scan

Scan Details

Site Domain saabnet.com
Base Domain saabnet.com
Scan Status Ok
Last Scan2024-09-25T20:50:22+00:00
Next Scan 2024-10-02T20:50:22+00:00

Last Scan

Scanned2024-09-25T20:50:22+00:00
URL https://saabnet.com/robots.txt
Redirect https://www.saabnet.com/robots.txt
Redirect Domain www.saabnet.com
Redirect Base saabnet.com
Domain IPs 75.53.11.93
Redirect IPs 75.53.11.93
Response IP 75.53.11.93
Found Yes
Hash 7081b1e326f44e24fdbacab5adcfcf63c7bf304324f87f7cba8238564f057078
SimHash 413d46e0ced1

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

daum

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /aas/

baiduspider/2.0

Rule Path
Disallow /aas/

blexbot

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /tsn/faq/buddy/index.html?show=full
Disallow /tsn/bb/general/index.html?bID=294824
Disallow /tsn/members/email.html
Disallow /cgi-bin/em/hidem.cgi
Disallow /tsn/bb/sharebyemail.php
Disallow /tsn/class/classmail2.php3
Disallow /cgi-bin/ad/*
Disallow /tsn/bb/bbmail.php3
Disallow /tsn/class/classmail2.php3
Disallow /tsn/members/login.html

amazonbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1