ie.widowsmeetwidowers.com
robots.txt

Robots Exclusion Standard data for ie.widowsmeetwidowers.com

Resource Scan

Scan Details

Site Domain ie.widowsmeetwidowers.com
Base Domain widowsmeetwidowers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-15T07:03:24+00:00
Next Scan 2025-02-13T07:03:24+00:00

Last Successful Scan

Scanned2024-07-19T07:02:17+00:00
URL https://ie.widowsmeetwidowers.com/robots.txt
Domain IPs 104.18.201.180, 104.18.202.180, 104.18.203.180, 104.18.204.180, 104.18.205.180, 2606:4700::6812:c9b4, 2606:4700::6812:cab4, 2606:4700::6812:cbb4, 2606:4700::6812:ccb4, 2606:4700::6812:cdb4
Response IP 104.18.201.180
Found Yes
Hash bc5468eae17628e26101112f155a210cbcce1037364537683fa10066907f0a65
SimHash 0d30e2166f90

Groups

mediapartners-google

Rule Path
Disallow

*

Product Comment
* directed to all robots
Rule Path
Disallow /api/
Disallow /assets/
Disallow /member/
Disallow /help/shared_network.cfm
Allow /assets/template/premium/scripts/pageswitch.min.js

Comments

  • $Id$