Log In Sign Up

aldim.az
robots.txt

Robots Exclusion Standard data for aldim.az

Resource Scan

Scan Details

Site Domain aldim.az
Base Domain aldim.az
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-22T20:25:53+00:00
Next Scan 2026-04-22T20:25:53+00:00

Last Successful Scan

Scanned2023-07-01T05:19:55+00:00
URL https://aldim.az/robots.txt
Domain IPs 104.21.83.39, 172.67.211.40, 2606:4700:3031::ac43:d328, 2606:4700:3035::6815:5327
Response IP 104.21.83.39
Found Yes
Hash 1096427e1255aa9076905d3d9594433ed41e5c2a3f8f8c835b4f457cc0850cff
SimHash aa842c8d7c50

Groups

*

Rule Path
Disallow /api/
Back to top

Other Records

Field Value
sitemap http://aldim.az/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top