shiftworkingmum.com
robots.txt

Robots Exclusion Standard data for shiftworkingmum.com

Resource Scan

Scan Details

Site Domain shiftworkingmum.com
Base Domain shiftworkingmum.com
Scan Status Ok
Last Scan2025-06-22T16:39:23+00:00
Next Scan 2025-06-29T16:39:23+00:00

Last Scan

Scanned2025-06-22T16:39:23+00:00
URL http://shiftworkingmum.com/robots.txt
Redirect https://www.ionos.co.uk/robots.txt
Redirect Domain www.ionos.co.uk
Redirect Base ionos.co.uk
Domain IPs 2001:8d8:100f:f000::200, 217.160.0.144
Redirect IPs 217.160.86.49, 217.160.86.51
Response IP 217.160.86.51
Found Yes
Hash 1ee1b4206af6aa7a1a3b4ca226beaff1e9f2552081397a71d3acbb582067b6b3
SimHash 600c97128233

Groups

*

Rule Path
Disallow /details-print
Disallow /terms-
Disallow /details-
Disallow /popup
Disallow /Feature
Disallow /*-popup$
Allow /server-configurator
Disallow /domaincheckresult
Disallow /tariffselect

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

dotbot
kinshoo

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ionos.co.uk/sitemap.xml

Comments

  • print
  • terms and conditions
  • Popups etc.
  • Results
  • crawl delay