aderesex.com
robots.txt

Robots Exclusion Standard data for aderesex.com

Resource Scan

Scan Details

Site Domain aderesex.com
Base Domain aderesex.com
Scan Status Ok
Last Scan2024-06-07T04:01:19+00:00
Next Scan 2024-07-07T04:01:19+00:00

Last Scan

Scanned2024-06-07T04:01:19+00:00
URL https://aderesex.com/robots.txt
Redirect https://www.aderesex.com/robots.txt
Redirect Domain www.aderesex.com
Redirect Base aderesex.com
Domain IPs 104.21.58.196, 172.67.206.240, 2606:4700:3034::6815:3ac4, 2606:4700:3035::ac43:cef0
Redirect IPs 104.21.58.196, 172.67.206.240, 2606:4700:3034::6815:3ac4, 2606:4700:3035::ac43:cef0
Response IP 104.21.58.196
Found Yes
Hash 83964139990cde4da2c00ece16c8ac40d4e7cf7501f8c87cf24f178334e676ef
SimHash 4810d2f2c313

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12

*

Rule Path
Allow /

*

Rule Path
Disallow /go.php$

baiduspider

Rule Path
Disallow /

baidu

Rule Path
Disallow /