instasent.com
robots.txt

Robots Exclusion Standard data for instasent.com

Resource Scan

Scan Details

Site Domain instasent.com
Base Domain instasent.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-09T21:36:33+00:00
Next Scan 2024-11-08T21:36:33+00:00

Last Successful Scan

Scanned2024-06-19T11:39:24+00:00
URL https://instasent.com/robots.txt
Redirect https://www.instasent.com/robots.txt
Redirect Domain www.instasent.com
Redirect Base instasent.com
Domain IPs 104.26.10.76, 104.26.11.76, 172.67.73.30, 2606:4700:20::681a:a4c, 2606:4700:20::681a:b4c, 2606:4700:20::ac43:491e
Redirect IPs 104.26.10.76, 104.26.11.76, 172.67.73.30, 2606:4700:20::681a:a4c, 2606:4700:20::681a:b4c, 2606:4700:20::ac43:491e
Response IP 172.67.73.30
Found Yes
Hash 121524a6050857c35be1abbf36246c0256ca7db109a6a0a6d88b85ce4dc63d49
SimHash 700180402f32

Groups

*

Rule Path
Disallow /newsletter-subscription
Disallow *%26
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449