wikikuwait.net
robots.txt
Robots Exclusion Standard data for wikikuwait.net
Resource Scan
Scan Details
Site Domain | wikikuwait.net |
Base Domain | wikikuwait.net |
Scan Status | Ok |
Last Scan | 2024-09-20T03:43:50+00:00 |
Next Scan | 2024-09-27T03:43:50+00:00 |
Last Scan
Scanned | 2024-09-20T03:43:50+00:00 |
URL | https://wikikuwait.net/robots.txt |
Domain IPs | 104.21.67.250, 172.67.183.139, 2606:4700:3030::6815:43fa, 2606:4700:3036::ac43:b78b |
Response IP | 172.67.183.139 |
Found | Yes |
Hash | 8305634f5855582a18a613b4942976b1b45fd21182ade5d0da637006e46895fd |
SimHash | d869ccc0a41a |
Groups
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Disallow | /wp-json/ |
Disallow | /?rest_route= |
Other Records
Field | Value |
---|---|
sitemap | https://wikikuwait.net/sitemap_index.xml |
Comments