asgharfurniture.ae
robots.txt
Robots Exclusion Standard data for asgharfurniture.ae
Resource Scan
Scan Details
Site Domain | asgharfurniture.ae |
Base Domain | asgharfurniture.ae |
Scan Status | Ok |
Last Scan | 2024-09-24T07:33:45+00:00 |
Next Scan | 2024-10-01T07:33:45+00:00 |
Last Scan
Scanned | 2024-09-24T07:33:45+00:00 |
URL | https://asgharfurniture.ae/robots.txt |
Domain IPs | 104.21.67.197, 172.67.180.37, 2606:4700:3031::6815:43c5, 2606:4700:3037::ac43:b425 |
Response IP | 104.21.67.197 |
Found | Yes |
Hash | 72bd62da6d1b14923ea4d92854de7954a3451a83989439d4b6fac4636d8a3abb |
SimHash | ebc05f42a30b |
Groups
*
Rule | Path |
---|---|
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/themes/asgharfurniture |
Allow | /wp-content/plugins |
Disallow | /wp-admin |
Disallow | /readme.html |
Disallow | /refer |
Disallow | /cgi-bin |
Disallow | /Cart |
Disallow | /my-account |
Disallow | /checkout |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Other Records
Field | Value |
---|---|
sitemap | http://cdn.attracta.com/sitemap/6187213.xml.gz |
sitemap | https://asgharfurniture.ae/sitemap_index.xml |
sitemap | http://cdn.attracta.com/sitemap/6187213.xml.gz |
Warnings
- 2 invalid lines.
Comments