crossfireforum.org
robots.txt

Robots Exclusion Standard data for crossfireforum.org

Resource Scan

Scan Details

Site Domain crossfireforum.org
Base Domain crossfireforum.org
Scan Status Ok
Last Scan2024-09-20T18:01:43+00:00
Next Scan 2024-09-27T18:01:43+00:00

Last Scan

Scanned2024-09-20T18:01:43+00:00
URL https://crossfireforum.org/robots.txt
Redirect https://www.crossfireforum.org/robots.txt
Redirect Domain www.crossfireforum.org
Redirect Base crossfireforum.org
Domain IPs 104.21.67.220, 172.67.182.11, 2606:4700:3031::ac43:b60b, 2606:4700:3034::6815:43dc
Redirect IPs 104.21.67.220, 172.67.182.11, 2606:4700:3031::ac43:b60b, 2606:4700:3034::6815:43dc
Response IP 172.67.182.11
Found Yes
Hash 01196e5a4aac97df853fb28330dbd74a55d4d5735cf6dd96f2c5e7c5431a9387
SimHash 084d9c4341f3

Groups

gptbot

Rule Path
Disallow /

googleother

Rule Path
Disallow /

*

Rule Path
Disallow /forum/sendmessage.php
Disallow /forum/search.php
Disallow /forum/esp_search.php
Disallow /forum/members/
Disallow /forum/login.php
Disallow /forum/post_thanks.php
Disallow /forum/members/list/
Disallow /forum/tags.php

Other Records

Field Value
sitemap https://www.crossfireforum.org/forum/sitemap_index.xml.gz