wascotrib.com
robots.txt

Robots Exclusion Standard data for wascotrib.com

Resource Scan

Scan Details

Site Domain wascotrib.com
Base Domain wascotrib.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-16T09:47:22+00:00
Next Scan 2024-12-15T09:47:22+00:00

Last Successful Scan

Scanned2024-02-20T09:45:05+00:00
URL https://wascotrib.com/robots.txt
Redirect https://www.wascotrib.com/robots.txt
Redirect Domain www.wascotrib.com
Redirect Base wascotrib.com
Domain IPs 50.112.150.139
Redirect IPs 50.112.150.139
Response IP 50.112.150.139
Found Yes
Hash 0eb759226f205056976ddd32d5eea2ccc66dee0eb6c9ae9018c6b59beba6f6b2
SimHash 222f5de14611

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ezoicbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

cloudflare-alwaysonline

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot-udiscovery

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.wascotrib.com/sitemap_index.xml