refersion.com
robots.txt

Robots Exclusion Standard data for refersion.com

Resource Scan

Scan Details

Site Domain refersion.com
Base Domain refersion.com
Scan Status Ok
Last Scan2025-10-15T09:46:00+00:00
Next Scan 2025-11-14T09:46:00+00:00

Last Scan

Scanned2025-10-15T09:46:00+00:00
URL https://refersion.com/robots.txt
Redirect https://www.refersion.com/robots.txt
Redirect Domain www.refersion.com
Redirect Base refersion.com
Domain IPs 104.18.22.158, 104.18.23.158, 2606:4700::6812:169e, 2606:4700::6812:179e
Redirect IPs 104.18.22.158, 104.18.23.158, 2606:4700::6812:169e, 2606:4700::6812:179e
Response IP 104.18.22.158
Found Yes
Hash cf0c9a5c3d4e50806bc89998d99df3b19c5b0a218ee96d1eebf830a98b2739b2
SimHash 6c048c556993

Groups

*

Rule Path
Disallow /github.php
Disallow /closed.php
Disallow /google*.html

Other Records

Field Value
sitemap https://www.refersion.com/sitemap.xml