abujan.com
robots.txt
Robots Exclusion Standard data for abujan.com
Resource Scan
Scan Details
Site Domain | abujan.com |
Base Domain | abujan.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2025-06-14T00:04:52+00:00 |
Next Scan | 2025-06-28T00:04:52+00:00 |
Last Successful Scan
Scanned | 2025-05-29T23:57:54+00:00 |
URL | https://abujan.com/robots.txt |
Redirect | https://www.abujan.com/public/robots.txt |
Redirect Domain | www.abujan.com |
Redirect Base | abujan.com |
Domain IPs | 2a02:4780:39:5765:aa82:9a7f:257d:acc5, 84.32.84.207 |
Redirect IPs | 2a02:4780:84:5b87:5357:d6bd:7638:5de7, 84.32.84.206 |
Response IP | 77.37.66.205 |
Found | Yes |
Hash | da779b9e6be80e13c201913abb83b27cbe6040ec66069a121ee8e6a6c35e329a |
SimHash | 994488160793 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Allow | / |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /ajax/ |
Disallow | /js/ |
Disallow | /vendor/ |
Disallow | /main.php |
Disallow | /mix-manifest.json |
Other Records
Field | Value |
---|---|
sitemap | https://abujan.test/pk/sitemaps.xml |
sitemap | https://abujan.test/sa/sitemaps.xml |
sitemap | https://abujan.test/ae/sitemaps.xml |