findtransfers.com
robots.txt

Robots Exclusion Standard data for findtransfers.com

Resource Scan

Scan Details

Site Domain findtransfers.com
Base Domain findtransfers.com
Scan Status Ok
Last Scan2025-09-04T02:47:28+00:00
Next Scan 2025-10-04T02:47:28+00:00

Last Scan

Scanned2025-09-04T02:47:28+00:00
URL https://findtransfers.com/robots.txt
Redirect https://www.findtransfers.com/robots.txt
Redirect Domain www.findtransfers.com
Redirect Base findtransfers.com
Domain IPs 104.26.10.165, 104.26.11.165, 172.67.73.9, 2606:4700:20::681a:aa5, 2606:4700:20::681a:ba5, 2606:4700:20::ac43:4909
Redirect IPs 104.26.10.165, 104.26.11.165, 172.67.73.9, 2606:4700:20::681a:aa5, 2606:4700:20::681a:ba5, 2606:4700:20::ac43:4909
Response IP 104.26.10.165
Found Yes
Hash c4a8c1059432ac65ec0d3330e9ab43f13911a21fb757e6552652dc46ab1ec60d
SimHash 6c545210d593

Groups

applebot

Rule Path
Disallow /cdn-cgi/
Allow /

baiduspider

Rule Path
Disallow /cdn-cgi/
Allow /

bingbot

Rule Path
Disallow /cdn-cgi/
Allow /

facebot

Rule Path
Disallow /cdn-cgi/
Allow /

googlebot

Rule Path
Disallow /cdn-cgi/
Allow /

msnbot

Rule Path
Disallow /cdn-cgi/
Allow /

naverbot

Rule Path
Disallow /cdn-cgi/
Allow /

seznambot

Rule Path
Disallow /cdn-cgi/
Allow /

slurp

Rule Path
Disallow /cdn-cgi/
Allow /

teoma

Rule Path
Disallow /cdn-cgi/
Allow /

twitterbot

Rule Path
Disallow /cdn-cgi/
Allow /

uptimerobot

Rule Path
Disallow /cdn-cgi/
Allow /

yandex

Rule Path
Disallow /cdn-cgi/
Allow /

yeti

Rule Path
Disallow /cdn-cgi/
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.findtransfers.com/sitemap.xml