Log In Sign Up

setkaprod.com
robots.txt

Robots Exclusion Standard data for setkaprod.com

Resource Scan

Scan Details

Site Domain setkaprod.com
Base Domain setkaprod.com
Scan Status Ok
Last Scan2026-02-03T16:32:42+00:00
Next Scan 2026-02-10T16:32:42+00:00

Last Scan

Scanned2026-02-03T16:32:42+00:00
URL https://setkaprod.com/robots.txt
Domain IPs 162.0.217.16
Response IP 162.0.217.16
Found Yes
Hash c596cc445ea10471a52d8adf36bb0740b7b64ec8f167aa851b7d375403c71f72
SimHash e9007a116637

Groups

*

Rule Path
Allow /
Allow /assets/
Allow /game/
Allow /tool/
Allow /news/
Disallow /admin/
Disallow /admin_tools/
Disallow /includes/
Disallow /blocks/

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://setkaprod.com/sitemap.xml
Back to top

Comments

  • Robots.txt for SETKA PRODUCTION
  • Allow all public pages, disallow admin and tools
  • Crawl delay (in seconds) - adjust based on server capacity
  • Allow Google Image Search
  • Sitemap location
Back to top