thabet.biz
robots.txt

Robots Exclusion Standard data for thabet.biz

Resource Scan

Scan Details

Site Domain thabet.biz
Base Domain thabet.biz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-04T19:16:16+00:00
Next Scan 2024-10-02T19:16:16+00:00

Last Successful Scan

Scanned2024-02-13T19:14:49+00:00
URL https://thabet.biz/robots.txt
Redirect https://thabet.ca/robots.txt
Redirect Domain thabet.ca
Redirect Base thabet.ca
Domain IPs 104.21.67.194, 172.67.180.34, 2606:4700:3030::6815:43c2, 2606:4700:3031::ac43:b422
Redirect IPs 104.21.19.218, 172.67.190.61, 2606:4700:3033::ac43:be3d, 2606:4700:3036::6815:13da
Response IP 104.21.19.218
Found Yes
Hash 0c90ad6e8591b966e2a5ed9d82b8ebedc1c16e1875bae0b81acaea0915aeab67
SimHash 2a148800da93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow */attachment/*
Disallow /author/
Disallow /page/
Allow /*.js$
Allow /*.css$

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thabet.biz/sitemap_index.xml