soton.ac.uk
robots.txt

Robots Exclusion Standard data for soton.ac.uk

Resource Scan

Scan Details

Site Domain soton.ac.uk
Base Domain soton.ac.uk
Scan Status Ok
Last Scan2024-11-16T12:24:54+00:00
Next Scan 2024-11-30T12:24:54+00:00

Last Scan

Scanned2024-11-16T12:24:54+00:00
URL https://www.soton.ac.uk/robots.txt
Redirect https://www.southampton.ac.uk/robots.txt
Redirect Domain www.southampton.ac.uk
Redirect Base southampton.ac.uk
Domain IPs 152.78.118.51
Redirect IPs 152.78.118.52
Response IP 152.78.118.52
Found Yes
Hash 3c9de410a15ba4b0477bb945fcaea2728829f927970dbbdf972eebc2ca836b49
SimHash c31702a099ed

Groups

*

Rule Path
Disallow /per/about/team.page
Disallow /profileview/edit
Disallow /profileview/
Disallow /brand
Disallow /ux-testing/
Disallow /connects
Disallow /offerholder
Disallow /offerholder/
Disallow /open-days/postgraduate/on-demand
Disallow /open-days/july
Disallow /open-days/july/*
Disallow /virtual-open-day/
Disallow /virtual-open-day
Disallow /virtual-visits
Disallow /virtual-visits/
Disallow /visit-day
Disallow /visit-day/
Disallow /inf/portal/agresso_fin.html
Disallow /inf/portal/agresso_pprod.html
Disallow /inf/portal/irms_unavailable.html
Disallow /inf/portal/jobs.html
Disallow /inf/portal/marks_release.html
Disallow /inf/portal/marks_release_highload.html
Disallow /inf/portal/marks_release_unavailable.html
Disallow /inf/portal/myview_unavailable.html
Disallow /inf/portal/oracle_crm_unavailable.html
Disallow /inf/portal/pams_unavailable.html
Disallow /inf/portal/planon_unavailable.html
Disallow /inf/portal/selfserv_outage.html
Disallow /inf/portal/sharepoint.html
Disallow /inf/portal/unavailable.html
Disallow /inf/portal/web_payments.html
Disallow /isolutions/outage-pages/
Disallow /devschool/
Disallow /devcorporate/
Disallow /devcentre/
Disallow /devservice/
Disallow /content-design/
Disallow /blog/sussed-news
Disallow /~re1u06/
Disallow /working-with-us
Disallow /working-with-us/campuses
Disallow /working-with-us/campuses/highfield
Disallow /working-with-us/campuses/boldrewood
Disallow /working-with-us/campuses/avenue
Disallow /working-with-us/campuses/general-hospital
Disallow /working-with-us/campuses/waterfront
Disallow /working-with-us/campuses/winchester
Disallow /working-with-us/cities
Disallow /working-with-us/cities/southampton
Disallow /working-with-us/cities/winchester
Disallow /working-with-us/benefits
Disallow */preview
Disallow /student-life/accommodation/rooms
Disallow /student-life/accommodation/rooms*
Disallow /campaigns
Disallow /campaigns/
Disallow /open-days/september-talks
Disallow /open-days/october-talks
Allow /~astra/
Allow /~ccu2015/
Allow /~ceb/
Allow /~ecoreg/
Allow /~fangohr/
Allow /~gjl/
Allow /~hglewis/
Allow /~imw/
Allow /~jtc/
Allow /~lopsoc/
Allow /~manix/
Allow /~msa/
Allow /~msweb/
Allow /~muvis/
Allow /~pasr1/
Allow /~sjc/raspberrypi/
Allow /~wpwt/
Allow /campaigns/digital-recruitment

gptbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /brand
Disallow /visit-day
Disallow /visit-day/
Disallow /connects
Disallow /offerholder
Disallow /offerholder/
Disallow /open-days/postgraduate/on-demand
Disallow /open-days/july
Disallow /open-days/july/*
Disallow /virtual-open-day/
Disallow /virtual-open-day
Disallow /virtual-visits
Disallow /virtual-visits/
Disallow /ux-testing/
Disallow /inf/portal/agresso_fin.html
Disallow /inf/portal/agresso_pprod.html
Disallow /inf/portal/irms_unavailable.html
Disallow /inf/portal/jobs.html
Disallow /inf/portal/marks_release.html
Disallow /inf/portal/marks_release_highload.html
Disallow /inf/portal/marks_release_unavailable.html
Disallow /inf/portal/myview_unavailable.html
Disallow /inf/portal/oracle_crm_unavailable.html
Disallow /inf/portal/pams_unavailable.html
Disallow /inf/portal/planon_unavailable.html
Disallow /inf/portal/selfserv_outage.html
Disallow /inf/portal/sharepoint.html
Disallow /inf/portal/unavailable.html
Disallow /inf/portal/web_payments.html
Disallow /isolutions/outage-pages/
Disallow /devschool/
Disallow /devcorporate/
Disallow /devcentre/
Disallow /devservice/
Disallow /content-design/
Disallow /blog/sussed-news
Disallow /~re1u06/
Disallow /working-with-us
Disallow /working-with-us/campuses
Disallow /working-with-us/campuses/highfield
Disallow /working-with-us/campuses/boldrewood
Disallow /working-with-us/campuses/avenue
Disallow /working-with-us/campuses/general-hospital
Disallow /working-with-us/campuses/waterfront
Disallow /working-with-us/campuses/winchester
Disallow /working-with-us/cities
Disallow /working-with-us/cities/southampton
Disallow /working-with-us/cities/winchester
Disallow /working-with-us/benefits
Disallow */preview
Disallow /student-life/accommodation/rooms
Disallow /student-life/accommodation/rooms*
Disallow /campaigns
Disallow /campaigns/
Disallow /open-days/september-talks
Disallow /open-days/october-talks
Allow /~astra/
Allow /~ccu2015/
Allow /~ceb/
Allow /~ecoreg/
Allow /~fangohr/
Allow /~gjl/
Allow /~hglewis/
Allow /~imw/
Allow /~jtc/
Allow /~lopsoc/
Allow /~manix/
Allow /~msa/
Allow /~msweb/
Allow /~muvis/
Allow /~pasr1/
Allow /~sjc/raspberrypi/
Allow /~wpwt/
Allow /campaigns/digital-recruitment

Other Records

Field Value
sitemap https://www.southampton.ac.uk/sitemapxml.page
sitemap https://www.southampton.ac.uk/sitemapindexxml.page
sitemap https://www.southampton.ac.uk/sitemapxml.page
sitemap https://www.southampton.ac.uk/sitemapindexxml.page

Warnings

  • 10 invalid lines.