tabakstop.be
robots.txt
Robots Exclusion Standard data for tabakstop.be
Resource Scan
Scan Details
Site Domain | tabakstop.be |
Base Domain | tabakstop.be |
Scan Status | Ok |
Last Scan | 2025-08-29T08:06:51+00:00 |
Next Scan | 2025-09-12T08:06:51+00:00 |
Last Scan
Scanned | 2025-08-29T08:06:51+00:00 |
URL | https://tabakstop.be/robots.txt |
Domain IPs | 104.21.90.111, 172.67.156.92, 2606:4700:3031::ac43:9c5c, 2606:4700:3034::6815:5a6f |
Response IP | 172.67.156.92 |
Found | Yes |
Hash | 50f58b17f956054ebfb55e20958d1816200a457b682e3f6077e72a2acebdb57b |
SimHash | 84491051a361 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/wp-admin/ |
Disallow | /admin/wp-includes/ |
Disallow | /admin/wp-content/plugins/ |
Disallow | /admin/wp-content/themes/ |
Disallow | /admin/wp-content/cache/ |
Disallow | /admin/xmlrpc.php/ |
Disallow | /admin/?s=* |
Disallow | /admin/?* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://tabakstop.be/sitemap.xml |
Comments