Log In Sign Up

exporters.sg
robots.txt

Robots Exclusion Standard data for exporters.sg

Resource Scan

Scan Details

Site Domain exporters.sg
Base Domain exporters.sg
Scan Status Ok
Last Scan2024-09-16T06:57:17+00:00
Next Scan 2024-09-23T06:57:17+00:00

Last Scan

Scanned2024-09-16T06:57:17+00:00
URL https://exporters.sg/robots.txt
Redirect https://www.exporters.sg/robots.txt
Redirect Domain www.exporters.sg
Redirect Base exporters.sg
Domain IPs 13.93.215.195
Redirect IPs 13.93.215.195
Response IP 13.93.215.195
Found Yes
Hash 8ecbfe93fefea6b5424ce20f43033440ea8608fef6c1273d5ca906cf91ae65ff
SimHash 6e1ddd55c5c1

Groups

mediapartners-google

Rule Path
Disallow

googlebot
bingbot
baiduspider

Rule Path
Disallow /members/
Disallow /members_v2/
Disallow /_adstrack/
Disallow /search/
Disallow /alert/

*

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

yellowbrandprotectionbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.exporters.sg/sitemap.xml
Back to top