cdn.xfire.com
robots.txt

Robots Exclusion Standard data for cdn.xfire.com

Resource Scan

Scan Details

Site Domain cdn.xfire.com
Base Domain xfire.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-10T17:00:41+00:00
Next Scan 2024-06-09T17:00:41+00:00

Last Successful Scan

Scanned2024-03-19T16:51:39+00:00
URL https://cdn.xfire.com/robots.txt
Redirect https://www.xfire.com/robots.txt
Redirect Domain www.xfire.com
Redirect Base xfire.com
Domain IPs 172.66.40.66, 172.66.43.190, 2606:4700:3108::ac42:2842, 2606:4700:3108::ac42:2bbe
Redirect IPs 172.66.40.66, 172.66.43.190, 2606:4700:3108::ac42:2842, 2606:4700:3108::ac42:2bbe
Response IP 172.66.40.66
Found Yes
Hash 01163a48ee529e1ae64578a79d7f86f66aadc88f68f456fc7e91d1a166f77a09
SimHash 4a3008686823

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /*/?s=
Disallow /search/
Disallow /search?
Disallow *?replytocom
Disallow /*preview%3Dtrue
Disallow /*theme_preview%3Dtrue

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ahrefsbot
alexibot
mj12bot
screaming frog seo spider
yaanibot
turnitinbot
npbot
slysearch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.xfire.com/sitemap_index.xml