uweekly.sg
robots.txt

Robots Exclusion Standard data for uweekly.sg

Resource Scan

Scan Details

Site Domain uweekly.sg
Base Domain uweekly.sg
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-12T11:30:22+00:00
Next Scan 2024-11-11T11:30:22+00:00

Last Successful Scan

Scanned2024-06-22T11:28:52+00:00
URL https://uweekly.sg/robots.txt
Redirect https://www.uweekly.sg/robots.txt
Redirect Domain www.uweekly.sg
Redirect Base uweekly.sg
Domain IPs 13.35.18.10, 13.35.18.59, 13.35.18.64, 13.35.18.82
Redirect IPs 13.33.30.112, 13.33.30.126, 13.33.30.78, 13.33.30.9
Response IP 13.33.30.78
Found Yes
Hash 8e3604315045d7da71fa4a1df0fc7679659d2fed0596f8474a747b10a9c8a1cc
SimHash c04899006d33

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.uweekly.sg/wp-sitemap.xml

Comments

  • For new training only
  • Not for training, only for user requests
  • Marker for disabling Bard and Vertex AI
  • Multi-purpose, commercial uses; including LLMs