ar-translator.com
robots.txt

Robots Exclusion Standard data for ar-translator.com

Resource Scan

Scan Details

Site Domain ar-translator.com
Base Domain ar-translator.com
Scan Status Ok
Last Scan2024-10-07T19:52:46+00:00
Next Scan 2024-10-14T19:52:46+00:00

Last Scan

Scanned2024-10-07T19:52:46+00:00
URL https://ar-translator.com/robots.txt
Domain IPs 172.66.40.108, 172.66.43.148, 2606:4700:3108::ac42:286c, 2606:4700:3108::ac42:2b94
Response IP 172.66.43.148
Found Yes
Hash d2ab95b1a8c802c01de686b51d8fe43e9d412f5bf4e6b9050dc8951e23606a83
SimHash 8b15c01a4b9a

Groups

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /