present-fan.com
robots.txt

Robots Exclusion Standard data for present-fan.com

Resource Scan

Scan Details

Site Domain present-fan.com
Base Domain present-fan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-19T02:48:44+00:00
Next Scan 2026-01-18T02:48:44+00:00

Last Successful Scan

Scanned2025-09-20T11:39:15+00:00
URL http://present-fan.com/robots.txt
Domain IPs 208.91.197.46
Response IP 208.91.197.46
Found Yes
Hash f746e6bb107cdcef4d19a5903b1491098eedfcedd21f68bcdbc12311206c8195
SimHash 28187013c193

Groups

*

Rule Path
Disallow /fcmedianet.js
Disallow /__media__/js/templates.js
Disallow /cmedianet
Disallow /cmdynet
Disallow /mediamainlog.php

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

*

Rule Path
Disallow /