iconsingapore.com
robots.txt

Robots Exclusion Standard data for iconsingapore.com

Resource Scan

Scan Details

Site Domain iconsingapore.com
Base Domain iconsingapore.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-27T10:07:12+00:00
Next Scan 2025-01-25T10:07:12+00:00

Last Successful Scan

Scanned2024-06-30T10:05:53+00:00
URL https://iconsingapore.com/robots.txt
Redirect https://www.iconsingapore.com/robots.txt
Redirect Domain www.iconsingapore.com
Redirect Base iconsingapore.com
Domain IPs 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90
Redirect IPs 3.165.82.38, 3.165.82.8, 3.165.82.84, 3.165.82.90
Response IP 3.165.82.38
Found Yes
Hash 7a395dce2acb5f4307f04249be576bf8a01397be0b007a7304406d5b40b21b4f
SimHash 1a4ddc20e103

Groups

*

Rule Path
Disallow /*/feed/$
Disallow /advanced-galleries/*
Disallow /search/*
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.iconsingapore.com/sitemap_index.xml