sncf.com
robots.txt

Robots Exclusion Standard data for sncf.com

Resource Scan

Scan Details

Site Domain sncf.com
Base Domain sncf.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-16T08:33:50+00:00
Next Scan 2024-11-30T08:33:50+00:00

Last Successful Scan

Scanned2022-12-26T02:51:55+00:00
URL https://sncf.com/robots.txt
Redirect https://www.sncf.com:443/robots.txt
Redirect Domain www.sncf.com
Redirect Base sncf.com
Domain IPs 75.2.83.188, 99.83.160.166
Redirect IPs 52.222.144.107, 52.222.144.62, 52.222.144.89, 52.222.144.99
Response IP 52.84.45.55
Found Yes
Hash 173c8567d246a410560841c4f96677bef426f6b73485fb7f97e8cecb291b5565
SimHash 2a1935c575f2

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.sncf.com/sitemap.xml

Comments

  • robots.txt file
  • @see http://www.robotstxt.org/robotstxt.html
  • Sitemaps for search engines
  • deploy.sh nightly