camlist.ae
robots.txt

Robots Exclusion Standard data for camlist.ae

Resource Scan

Scan Details

Site Domain camlist.ae
Base Domain camlist.ae
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-02-21T22:50:53+00:00
Next Scan 2026-05-22T22:50:53+00:00

Last Successful Scan

Scanned2023-07-15T05:37:15+00:00
URL https://camlist.ae/robots.txt
Redirect https://www.camlist.ae/robots.txt
Redirect Domain www.camlist.ae
Redirect Base camlist.ae
Domain IPs 104.21.80.97, 172.67.177.40, 2606:4700:3034::ac43:b128, 2606:4700:3035::6815:5061
Redirect IPs 104.21.80.97, 172.67.177.40, 2606:4700:3034::ac43:b128, 2606:4700:3035::6815:5061
Response IP 172.67.177.40
Found Yes
Hash 9c07ea77f7540d8d87a84c6939528dc455caab357bf31de745903c4d50566730
SimHash d3009821c782

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.camlist.ae/sitemap.xml
sitemap https://www.camlist.ae/cats-uae.xml
sitemap https://www.camlist.ae/dogs-uae.xml

Warnings

  • 2 invalid lines.