adsl-bc.org
robots.txt

Robots Exclusion Standard data for adsl-bc.org

Resource Scan

Scan Details

Site Domain adsl-bc.org
Base Domain adsl-bc.org
Scan Status Ok
Last Scan2024-05-25T04:55:31+00:00
Next Scan 2024-06-01T04:55:31+00:00

Last Scan

Scanned2024-05-25T04:55:31+00:00
URL https://adsl-bc.org/robots.txt
Redirect https://forum.adsl-bc.org/robots.txt
Redirect Domain forum.adsl-bc.org
Redirect Base adsl-bc.org
Domain IPs 104.26.12.97, 104.26.13.97, 172.67.68.5, 2606:4700:20::681a:c61, 2606:4700:20::681a:d61, 2606:4700:20::ac43:4405
Redirect IPs 104.26.12.97, 104.26.13.97, 172.67.68.5, 2606:4700:20::681a:c61, 2606:4700:20::681a:d61, 2606:4700:20::ac43:4405
Response IP 104.26.13.97
Found Yes
Hash 7e7b142dc9024b411dc9f3cc56da0f7d75efdd4beaea8c8d7635a63b19d5867e
SimHash e20c5882eb90

Groups

*

Rule Path
Disallow /login.php
Disallow /ucp.php
Disallow /post.php
Disallow /posting.php

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /login.php
Disallow /post.php
Disallow /posting.php

Other Records

Field Value
crawl-delay 15

mediapartners-google*

Rule Path
Disallow

gigabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

nutch

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /