area51manado.com
robots.txt

Robots Exclusion Standard data for area51manado.com

Resource Scan

Scan Details

Site Domain area51manado.com
Base Domain area51manado.com
Scan Status Ok
Last Scan2024-09-18T10:43:31+00:00
Next Scan 2024-10-18T10:43:31+00:00

Last Scan

Scanned2024-09-18T10:43:31+00:00
URL https://area51manado.com/robots.txt
Redirect https://www.area51manado.com/robots.txt
Redirect Domain www.area51manado.com
Redirect Base area51manado.com
Domain IPs 104.21.80.2, 172.67.172.83, 2606:4700:3032::6815:5002, 2606:4700:3037::ac43:ac53
Redirect IPs 104.21.80.2, 172.67.172.83, 2606:4700:3032::6815:5002, 2606:4700:3037::ac43:ac53
Response IP 172.67.172.83
Found Yes
Hash f15632178fd8a97777612f1e6047eacc94d1a3a8e8b6596813aa7613a3d9c93b
SimHash 6040c8917337

Groups

*

Rule Path
Disallow /

googlebot
googlebot-image
googlebot-mobile
msnbot
bingbot
slurp
yahoo-mmcrawler

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

alexabot

Rule Path
Disallow