geograph.org.uk
robots.txt
Robots Exclusion Standard data for geograph.org.uk
Resource Scan
Scan Details
| Site Domain | geograph.org.uk |
| Base Domain | geograph.org.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-16T16:50:34+00:00 |
| Next Scan | 2024-11-23T16:50:34+00:00 |
Last Scan
| Scanned | 2024-11-16T16:50:34+00:00 |
| URL | https://geograph.org.uk/robots.txt |
| Redirect | https://www.geograph.org.uk/robots.txt |
| Redirect Domain | www.geograph.org.uk |
| Redirect Base | geograph.org.uk |
| Domain IPs | 87.239.17.212 |
| Redirect IPs | 2a05:d018:fcc:be00:9965:8490:288:f497, 2a05:d018:fcc:be01:4644:ed54:f6eb:9752, 2a05:d018:fcc:be02:4a04:c7b2:dc27:34a3, 34.246.99.116, 34.247.238.253, 54.155.70.77 |
| Response IP | 54.155.70.77 |
| Found | Yes |
| Hash | 5aec2fc3f56af6bb242812771ffd0a449e01c3abfb1b2af9775d1d3dc425f66f |
| SimHash | 785c27c5c3d4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /stuff/canonical.php |
| Disallow | /browser/ |
| Disallow | /photo/*?style |
| Disallow | /photo/*.kml |
| Disallow | /mapbrowse.php |
| Disallow | /map/ |
| Disallow | /mapper/ |
| Disallow | /maplarge.php |
| Disallow | /mapprint.php |
| Disallow | /mapfixer.php |
| Disallow | /admin/ |
| Disallow | /search.php |
| Disallow | /full-text.php |
| Disallow | /finder/ |
| Disallow | /chwilio/?q= |
| Disallow | /explore/wordnet.php |
| Disallow | /explore/calendar.php |
| Disallow | /showmap.php |
| Disallow | /places.php |
| Disallow | /explore/places.php |
| Disallow | /usermsg.php |
| Disallow | /statistics/breakdown.php |
| Disallow | /statistics/groupby.php |
| Disallow | /submit.php |
| Disallow | /submit2.php |
| Disallow | /submit_popup.php |
| Disallow | /map_frame.php |
| Disallow | /discuss/ |
| Disallow | /mapsheet.php |
| Disallow | /kml.php |
| Disallow | /gpx.php |
| Disallow | /reuse.php |
| Disallow | /stamp.php |
| Disallow | /more.php |
| Disallow | /editimage.php |
| Disallow | /browse.php |
| Disallow | /hectad.php |
| Disallow | /location.php |
| Disallow | /gridref/ |
| Disallow | /ecard.php |
| Disallow | /related.php |
| Disallow | /show_exif.php |
| Disallow | /export. |
| Disallow | /tile.php |
| Disallow | /auth.php |
| Disallow | /feed/userid/ |
| Disallow | /feed/results |
| Disallow | /export.excel.xml.php |
| Disallow | /export.csv.php |
| Disallow | /_scripts/ |
| Disallow | /sitemap/ |
| Disallow | /stuff/conversion.php |
| Disallow | /stuff/tagmap.php |
| Disallow | /stuff/searchmap.php |
| Disallow | /stuff/routemap.php |
| Disallow | /stuff/post.php |
| Disallow | /article/edit.php |
| Disallow | /article/history.php |
| Disallow | /article/source.php |
| Disallow | /article/diff.php |
| Disallow | /content/syndicator.php |
| Disallow | /content/index.php |
| Disallow | /squares.php |
| Disallow | /tags/ |
| Disallow | /tagged/*exclude%3D |
| Disallow | /tagged/*photo%3D |
| Disallow | /faq- |
googlebot
slurp
yandex
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /stuff/canonical.php |
| Disallow | /browser/? |
| Disallow | /browser/ |
| Disallow | /profile/*/map |
| Disallow | /photo/*?style |
| Disallow | /photo/*.kml |
| Disallow | /mapbrowse.php? |
| Disallow | /map/ |
| Disallow | /mapper/ |
| Disallow | /maplarge.php |
| Disallow | /mapprint.php |
| Disallow | /mapfixer.php |
| Disallow | /admin/ |
| Disallow | /search.php? |
| Disallow | /full-text.php? |
| Disallow | /finder/ |
| Disallow | /chwilio/?q= |
| Disallow | /explore/wordnet.php |
| Disallow | /explore/calendar.php?*Year |
| Disallow | /showmap.php |
| Disallow | /places.php |
| Disallow | /explore/places.php |
| Disallow | /usermsg.php |
| Disallow | /statistics/breakdown.php |
| Disallow | /statistics/groupby.php |
| Disallow | /statistics/leaderboard.php?*when |
| Disallow | /statistics/leaderboard.php?*myriad |
| Disallow | /statistics/moversboard.php?*when |
| Disallow | /statistics/*?*csv |
| Disallow | /submit.php |
| Disallow | /submit2.php |
| Disallow | /submit_popup.php |
| Disallow | /map_frame.php |
| Disallow | /discuss/ |
| Disallow | /mapsheet.php |
| Disallow | /kml.php? |
| Disallow | /photo/*.kml |
| Disallow | /gpx.php? |
| Disallow | /reuse.php |
| Disallow | /stamp.php |
| Disallow | /more.php |
| Disallow | /editimage.php |
| Disallow | /browse.php? |
| Disallow | /hectad.php? |
| Disallow | /location.php |
| Disallow | /gridref/*/ |
| Disallow | /gridref/*? |
| Disallow | /ecard.php |
| Disallow | /related.php |
| Disallow | /show_exif.php |
| Disallow | /export. |
| Disallow | /tile.php |
| Disallow | /auth.php |
| Disallow | /feed/userid/ |
| Disallow | /feed/results |
| Disallow | /export.excel.xml.php |
| Disallow | /export.csv.php |
| Disallow | /_scripts/ |
| Disallow | /stuff/conversion.php |
| Disallow | /stuff/tagmap.php |
| Disallow | /stuff/searchmap.php |
| Disallow | /stuff/routemap.php |
| Disallow | /article/edit.php |
| Disallow | /article/history.php |
| Disallow | /article/source.php |
| Disallow | /article/diff.php |
| Disallow | /syndicator.php?key= |
| Disallow | /stuff/kmltest |
| Disallow | /content/syndicator.php?*q= |
| Disallow | /content/?*q= |
| Disallow | /content/index.php |
| Disallow | /squares.php |
| Disallow | /*?*apikey |
| Disallow | /api/*apikey |
| Disallow | /sitemap/ |
| Disallow | /tags/ |
| Disallow | /tagged/*exclude%3D |
| Disallow | /tagged/*photo%3D |
| Disallow | /faq- |
| Allow | /tags/$ |
| Allow | /tags/prefix.php |
| Allow | /tags/primary.php |
| Allow | /finder/recent.php |
| Allow | /mapper/scenicness.php |
| Allow | /mapper/photomap.php |
Warnings
- `clean-param` is not a known field.
Comments