Log In Sign Up

thecarexpo.sg
robots.txt

Robots Exclusion Standard data for thecarexpo.sg

Resource Scan

Scan Details

Site Domain thecarexpo.sg
Base Domain thecarexpo.sg
Scan Status Ok
Last Scan2024-11-11T22:17:00+00:00
Next Scan 2024-11-25T22:17:00+00:00

Last Scan

Scanned2024-11-11T22:17:00+00:00
URL https://thecarexpo.sg/robots.txt
Redirect https://www.thecarexpo.sg/robots.txt
Redirect Domain www.thecarexpo.sg
Redirect Base thecarexpo.sg
Domain IPs 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90
Redirect IPs 108.156.133.118, 108.156.133.28, 108.156.133.3, 108.156.133.6
Response IP 108.156.133.28
Found Yes
Hash 6b555d1b437fa11646aed20ce699867d3ced80a0f36585313c31217b1bf2f669
SimHash e140d960b3f2

Groups

*

Rule Path
Disallow */feed
Disallow */feed/
Disallow */comment/
Disallow */comments/
Disallow */trackback/
Disallow */comment
Disallow */comments
Disallow */trackback
Disallow /feed
Disallow /feed/
Disallow /cgi-bin/
Disallow /comment
Disallow /comment/
Disallow /comments
Disallow /comments/
Disallow /trackback
Disallow /trackback/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.carsatexpo.sg/sitemap_index.xml
Back to top

Comments

  • robots.txt
  • For new training only
  • Not for training, only for user requests
  • Marker to disabling Bard and Vertex AI
  • Multi purpose, commercial uses; including LLMs
Back to top