fwd.co.id
robots.txt

Robots Exclusion Standard data for fwd.co.id

Resource Scan

Scan Details

Site Domain fwd.co.id
Base Domain fwd.co.id
Scan Status Ok
Last Scan2024-06-23T07:26:59+00:00
Next Scan 2024-07-23T07:26:59+00:00

Last Scan

Scanned2024-06-23T07:26:59+00:00
URL https://fwd.co.id/robots.txt
Redirect https://www.fwd.co.id/robots.txt
Redirect Domain www.fwd.co.id
Redirect Base fwd.co.id
Domain IPs 52.76.46.13
Redirect IPs 108.157.254.14, 108.157.254.62, 108.157.254.82, 108.157.254.92, 2600:9000:2753:1000:15:bd25:f980:93a1, 2600:9000:2753:1c00:15:bd25:f980:93a1, 2600:9000:2753:5e00:15:bd25:f980:93a1, 2600:9000:2753:6800:15:bd25:f980:93a1, 2600:9000:2753:a000:15:bd25:f980:93a1, 2600:9000:2753:ae00:15:bd25:f980:93a1, 2600:9000:2753:e600:15:bd25:f980:93a1, 2600:9000:2753:ec00:15:bd25:f980:93a1
Response IP 108.157.254.82
Found Yes
Hash afdf90e396a6ec8dd36076f51f5c8f357ed6fde661c2610c690dc1ca07be5e6b
SimHash 48011b41e790

Groups

*

Rule Path
Allow

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot mobile web android

Rule Path
Disallow

adsbot mobile web

Rule Path
Disallow

adsbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.fwd.co.id/sitemap.xml