suntransfers.com
robots.txt

Robots Exclusion Standard data for suntransfers.com

Resource Scan

Scan Details

Site Domain suntransfers.com
Base Domain suntransfers.com
Scan Status Ok
Last Scan2025-02-14T05:19:44+00:00
Next Scan 2025-03-16T05:19:44+00:00

Last Scan

Scanned2025-02-14T05:19:44+00:00
URL https://suntransfers.com/robots.txt
Redirect https://www.suntransfers.com/robots.txt
Redirect Domain www.suntransfers.com
Redirect Base suntransfers.com
Domain IPs 52.209.139.53, 54.74.72.4
Redirect IPs 52.209.139.53, 54.74.72.4
Response IP 52.209.139.53
Found Yes
Hash f79eec1dda705e48ec31442e71fc6a1633827e6daf130cbbe90728294380641d
SimHash 63155070c7d3

Groups

*

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 8

bot-traffic,bottraffic,trafficbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.suntransfers.com/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449