birketts.co.uk
robots.txt
Robots Exclusion Standard data for birketts.co.uk
Resource Scan
Scan Details
| Site Domain | birketts.co.uk |
| Base Domain | birketts.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-06-04T16:41:23+00:00 |
| Next Scan | 2024-07-04T16:41:23+00:00 |
Last Scan
| Scanned | 2024-06-04T16:41:23+00:00 |
| URL | https://birketts.co.uk/robots.txt |
| Domain IPs | 104.21.85.63, 172.67.203.13, 2606:4700:3034::6815:553f, 2606:4700:3037::ac43:cb0d |
| Response IP | 172.67.203.13 |
| Found | Yes |
| Hash | 7ac92d7b542b23968c39de6a3f26bcbcd93a596b8b8171b7120327bdca78e73a |
| SimHash | 2099eb705c3b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /? |
| Disallow | */wp- |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | *?themes= |
| Disallow | *?feed= |
| Disallow | *?ftag= |
| Disallow | /search/ |
| Disallow | /users/ |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */embed |
| Disallow | /xmlrpc.php |
| Disallow | */?service-id= |
| Disallow | *%26service-id%3D |
| Disallow | */?post_letter= |
| Disallow | */?sector= |
| Disallow | *%26sector%3D |
| Disallow | */?title= |
| Disallow | */width%3D |
| Disallow | *?ExcludePageBreak= |
| Disallow | *?practice-area= |
| Disallow | *?industry= |
| Disallow | *?location= |
| Disallow | *?trk= |
| Disallow | *%26sdata%3D |
| Disallow | *posts?page= |
| Disallow | *aspx?ext= |
| Disallow | *?mode=* |
| Disallow | *%26mode%3D* |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.pdf |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | *?dyslexia=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.birketts.co.uk/sitemap_index.xml |