obrienmedia.co.uk
robots.txt
Robots Exclusion Standard data for obrienmedia.co.uk
Resource Scan
Scan Details
Site Domain | obrienmedia.co.uk |
Base Domain | obrienmedia.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-28T17:51:35+00:00 |
Next Scan | 2024-09-29T17:51:35+00:00 |
Last Scan
Scanned | 2024-09-28T17:51:35+00:00 |
URL | https://obrienmedia.co.uk/robots.txt |
Domain IPs | 172.66.40.114, 172.66.43.142, 2606:4700:3108::ac42:2872, 2606:4700:3108::ac42:2b8e |
Response IP | 172.66.43.142 |
Found | Yes |
Hash | d9ab7beba4027ff3eb7c3a0644f5b2aec37cd6326ffa92bb1af70b65863dcb8c |
SimHash | ce15c4337d80 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-json/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /?s=* |
Disallow | /search/* |
Disallow | /*.pdf$ |
Disallow | /cdn-cgi/bm/cv/ |
Disallow | /cdn-cgi/challenge-platform/ |
Other Records
Field | Value |
---|---|
sitemap | https://obrienmedia.co.uk/sitemap.xml |
Comments