tabacstop.be
robots.txt
Robots Exclusion Standard data for tabacstop.be
Resource Scan
Scan Details
Site Domain | tabacstop.be |
Base Domain | tabacstop.be |
Scan Status | Ok |
Last Scan | 2025-08-02T03:57:39+00:00 |
Next Scan | 2025-08-16T03:57:39+00:00 |
Last Scan
Scanned | 2025-08-02T03:57:39+00:00 |
URL | https://tabacstop.be/robots.txt |
Domain IPs | 104.21.51.26, 172.67.219.88, 2606:4700:3032::6815:331a, 2606:4700:3033::ac43:db58 |
Response IP | 104.21.51.26 |
Found | Yes |
Hash | 2321a981d19cec8db27bda0eda90da1b7ac7bc9440f7897541f4e8efeb873006 |
SimHash | 60009270e355 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/wp-admin/ |
Disallow | /admin/wp-includes/ |
Disallow | /admin/wp-content/plugins/ |
Disallow | /admin/wp-content/themes/ |
Disallow | /admin/wp-content/cache/ |
Disallow | /admin/xmlrpc.php |
Disallow | /admin/readme.html |
Disallow | /admin/license.txt |
Allow | /admin/wp-json/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |