rse.org.uk
robots.txt

Robots Exclusion Standard data for rse.org.uk

Resource Scan

Scan Details

Site Domain rse.org.uk
Base Domain rse.org.uk
Scan Status Ok
Last Scan2025-10-21T11:15:42+00:00
Next Scan 2025-11-20T11:15:42+00:00

Last Scan

Scanned2025-10-21T11:15:42+00:00
URL https://rse.org.uk/robots.txt
Domain IPs 104.21.93.18, 172.67.202.181, 2606:4700:3032::ac43:cab5, 2606:4700:3037::6815:5d12
Response IP 172.67.202.181
Found Yes
Hash 225ee8bcc7770c62cf4c67603724397a4f4980a65e549e83c39b17a87ccc3516
SimHash fc6998480457

Groups

*

Rule Path
Disallow /wp-content/uploads/wp-import-export/

Comments

  • WP Import Export Plugin Rules Start
  • This directory contains private files that should not be crawled
  • WP Import Export Plugin Rules End