servicedesk.msstate.edu
robots.txt

Robots Exclusion Standard data for servicedesk.msstate.edu

Resource Scan

Scan Details

Site Domain servicedesk.msstate.edu
Base Domain msstate.edu
Scan Status Ok
Last Scan2025-08-30T19:22:30+00:00
Next Scan 2025-09-29T19:22:30+00:00

Last Scan

Scanned2025-08-30T19:22:30+00:00
URL https://servicedesk.msstate.edu/robots.txt
Redirect https://servicedesk.its.msstate.edu/robots.txt
Redirect Domain servicedesk.its.msstate.edu
Redirect Base msstate.edu
Domain IPs 130.18.80.71
Redirect IPs 40.90.247.53
Response IP 40.90.247.53
Found Yes
Hash 34a4c9549df1f3c495bb9e475b15ffd187010d2b31c8935a165621b75e5db50d
SimHash 253842a6eb73

Groups

*

Rule Path
Allow /TDClient/
Allow /TDClient/*
Allow /tdclient/
Allow /tdclient/*
Allow /TDWebApi/
Allow /TDWebApi/*
Allow /tdwebapi/
Allow /tdwebapi/*
Allow /TDPortal/Content/
Allow /TDPortal/Content/*
Allow /tdportal/content/
Allow /tdportal/content/*
Allow /TDPortal/BE/Logo/
Allow /TDPortal/BE/Logo/*
Allow /tdportal/be/logo/
Allow /tdportal/be/logo/*
Allow /TDPortal/BE/Style/
Allow /TDPortal/BE/Style/*
Allow /tdportal/be/style/
Allow /tdportal/be/style/*
Allow /TDPortal/BE/Icon/
Allow /TDPortal/BE/Icon/*
Allow /tdportal/be/icon/
Allow /tdportal/be/icon/*
Disallow /

Other Records

Field Value
crawl-delay 5