eurosender.com
robots.txt

Robots Exclusion Standard data for eurosender.com

Resource Scan

Scan Details

Site Domain eurosender.com
Base Domain eurosender.com
Scan Status Ok
Last Scan2024-05-02T00:04:49+00:00
Next Scan 2024-06-01T00:04:49+00:00

Last Scan

Scanned2024-05-02T00:04:49+00:00
URL https://eurosender.com/robots.txt
Redirect https://www.eurosender.com/robots.txt
Redirect Domain www.eurosender.com
Redirect Base eurosender.com
Domain IPs 13.33.88.104, 13.33.88.16, 13.33.88.64, 13.33.88.80
Redirect IPs 13.33.88.104, 13.33.88.16, 13.33.88.64, 13.33.88.80
Response IP 13.33.88.64
Found Yes
Hash 8fb34a924ca6f225f201f607cc186a2cae91caf63ee269c2e85dc2968b0e8d4a
SimHash 29381955c1d3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /log/
Disallow /*?mod
Disallow /manager
Disallow /api/v1
Disallow /api/v2
Disallow /etc

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /
Disallow /log/
Disallow /*?mod
Disallow /manager
Disallow /api/v1
Disallow /api/v2
Disallow /etc
Disallow /*/search

Other Records

Field Value
sitemap https://www.eurosender.com/sitemap.xml