arifrohman.com
robots.txt

Robots Exclusion Standard data for arifrohman.com

Resource Scan

Scan Details

Site Domain arifrohman.com
Base Domain arifrohman.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-23T18:42:45+00:00
Next Scan 2024-10-21T18:42:45+00:00

Last Successful Scan

Scanned2024-03-03T11:22:42+00:00
URL https://arifrohman.com/robots.txt
Redirect https://www.arifrohman.com/robots.txt
Redirect Domain www.arifrohman.com
Redirect Base arifrohman.com
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.175.121, 2404:6800:4003:c1a::79
Response IP 74.125.200.121
Found Yes
Hash adbc918fdf29e3cce7dc7a668db236eaa28363ce2c39742d1484d7c26aed6372
SimHash 6904de504792

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.arifrohman.com/sitemap.xml