foot11.com
robots.txt

Robots Exclusion Standard data for foot11.com

Resource Scan

Scan Details

Site Domain foot11.com
Base Domain foot11.com
Scan Status Ok
Last Scan2024-11-12T03:20:25+00:00
Next Scan 2024-11-19T03:20:25+00:00

Last Scan

Scanned2024-11-12T03:20:25+00:00
URL https://foot11.com/robots.txt
Domain IPs 104.18.10.9, 104.18.11.9, 2606:4700::6812:a09, 2606:4700::6812:b09
Response IP 104.18.10.9
Found Yes
Hash dc1c7ba265af8ae28952b3af26f340e661a9c1b39eb203970cd730e7194c2bbf
SimHash 7f335c2a6ebb

Groups

*

Rule Path
Disallow /trackback/
Disallow /api/
Disallow /?s=

aspiegelbot
blexbot
barkrowler
dotbot
mauibot
nimbostratus-bot
petalbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /trackback/
Disallow /api/
Disallow /?s=

Other Records

Field Value
crawl-delay 180

Other Records

Field Value
sitemap https://foot11.com/sitemaps/sitemap_index.xml

Warnings

  • 1 invalid line.