xakertop.net
robots.txt

Robots Exclusion Standard data for xakertop.net

Resource Scan

Scan Details

Site Domain xakertop.net
Base Domain xakertop.net
Scan Status Ok
Last Scan2024-05-04T05:26:16+00:00
Next Scan 2024-06-03T05:26:16+00:00

Last Scan

Scanned2024-05-04T05:26:16+00:00
URL https://xakertop.net/robots.txt
Domain IPs 104.21.70.31, 172.67.218.208, 2606:4700:3031::ac43:dad0, 2606:4700:3037::6815:461f
Response IP 104.21.70.31
Found Yes
Hash 982ad83b2cce1710ba18390ac85542d3dd5682efb534d1ba90f86a89b037e06c
SimHash 6c04d053cb35

Groups

*

Rule Path
Disallow
Allow /feed.rss.xml/
Allow /feed1.rss.xml/
Allow /feed2.rss.xml/
Allow /favicon.ico/

googlebot

Rule Path
Disallow
Allow /feed.rss.xml/
Allow /feed1.rss.xml/
Allow /feed2.rss.xml/
Allow /favicon.ico/

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow
Allow /feed.rss.xml/
Allow /feed1.rss.xml/
Allow /feed2.rss.xml/
Allow /favicon.ico/

Other Records

Field Value
sitemap https://xakertop.net/index.php?app=core&module=global&section=sitemap&sitemap=sitemap_core_core.xml.gz
sitemap https://xakertop.net/index.php?app=core&module=global&section=sitemap&sitemap=sitemap_core_forums.xml.gz
sitemap https://xakertop.net/index.php?app=core&module=global&section=sitemap&sitemap=sitemap_core_topics.xml.gz
sitemap https://xakertop.top/sitemap.xml

Warnings

  • `host` is not a known field.