vam.ac.uk
robots.txt
Robots Exclusion Standard data for vam.ac.uk
Resource Scan
Scan Details
Site Domain | vam.ac.uk |
Base Domain | vam.ac.uk |
Scan Status | Ok |
Last Scan | 2024-10-29T18:48:17+00:00 |
Next Scan | 2024-11-28T18:48:17+00:00 |
Last Scan
Scanned | 2024-10-29T18:48:17+00:00 |
URL | https://vam.ac.uk/robots.txt |
Redirect | https://www.vam.ac.uk/robots.txt |
Redirect Domain | www.vam.ac.uk |
Redirect Base | vam.ac.uk |
Domain IPs | 52.50.131.88 |
Redirect IPs | 13.33.30.29, 13.33.30.30, 13.33.30.33, 13.33.30.7 |
Response IP | 13.33.30.7 |
Found | Yes |
Hash | f94f3d075bf6eb9fba2f66ac8773d20fc6f2c853cd44336d4f726d7d96e480c2 |
SimHash | 6946dc314a66 |
Groups
*
Rule | Path |
---|---|
Disallow | /users/comment/ |
Disallow | /contentapi/search/ |
Disallow | /contentapi/logotron/ |
Disallow | /blogs/ |
Disallow | /uploads/ |
Disallow | /alby100pib |
Disallow | /tags/ |
Disallow | /users/ |
Disallow | /archives/ |
Disallow | /*q%3D* |
Disallow | /*hstc%3D |
Disallow | /*hssc%3D |
Disallow | /*hsfp%3D |
Disallow | /*utm_source%3D |
Disallow | /*utm_medium%3D |
Disallow | /*utm_content%3D |
Disallow | /*utm_campaign%3D |
Disallow | /*page%3D |
Disallow | /*p%3D |
Disallow | /blog/tag/ |
Disallow | /blog/20*/ |
Disallow | /*gclid%3D |
Disallow | /whatson/20*/**/**/m* |
Disallow | /whatson/20*/**/**/w* |
Disallow | /shop/whatson/ |
Disallow | /shekou/tag/ |
Disallow | /__data/assets/pdf_file/0003/178536/new-director-announcement.pdf |
Disallow | /__data/assets/pdf_file/0017/235115/hlf_announcement_exhibition_road.pdf |
Disallow | /__data/assets/pdf_file/0009/254529/V-and-ADirectorofDesignFuturePlanAnnouncement.pdf |
Disallow | /directories/ |
Disallow | /membership/user |
Disallow | /info/va-newsletter |
Disallow | /content/email/existing-subscriber |
Disallow | /content/email/confirmation |
Disallow | /moc/e-newsletter-signup-confirmation |
Disallow | /*cgid%3D* |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.vam.ac.uk/sitemap_index.xml |
sitemap | https://www.vam.ac.uk/mused/sitemap_index.xml |