paris-saclay.com
robots.txt

Robots Exclusion Standard data for paris-saclay.com

Resource Scan

Scan Details

Site Domain paris-saclay.com
Base Domain paris-saclay.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-03-31T08:30:06+00:00
Next Scan 2025-06-29T08:30:06+00:00

Last Successful Scan

Scanned2024-08-11T07:42:20+00:00
URL https://paris-saclay.com/robots.txt
Redirect https://www.paris-saclay.com/robots.txt
Redirect Domain www.paris-saclay.com
Redirect Base paris-saclay.com
Domain IPs 91.121.37.244
Redirect IPs 91.121.37.244
Response IP 91.121.37.244
Found Yes
Hash 3ccb270ac40ebf30eb84b4afc9aa3ad6984fd0b54dc4cd399c14397182dc3d4c
SimHash e90912e3f7b1

Groups

*

Rule Path
Allow /
Disallow /t3lib/
Disallow /typo3/
Allow /typo3conf/ext/stratis_site/Resources/Public/
Disallow /typo3conf/
Disallow /*?id=*
Disallow /pdf-*

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.paris-saclay.com/sitemap.xml

Comments

  • COMMENT OR REMOVE AFTER PUTTING ONLINE
  • Allow: /index.html
  • Disallow: /
  • UNCOMMENT AFTER PUTTING ONLINE
  • UNCOMMENT AFTER PUTTING ONLINE
  • NEVER REPLACE https://www.paris-saclay.com
  • DO NOT REMOVE