shorouknews.com
robots.txt

Robots Exclusion Standard data for shorouknews.com

Resource Scan

Scan Details

Site Domain shorouknews.com
Base Domain shorouknews.com
Scan Status Ok
Last Scan2024-10-03T10:39:18+00:00
Next Scan 2024-10-10T10:39:18+00:00

Last Scan

Scanned2024-10-03T10:39:18+00:00
URL https://shorouknews.com/robots.txt
Redirect https://www.shorouknews.com/robots.txt
Redirect Domain www.shorouknews.com
Redirect Base shorouknews.com
Domain IPs 62.67.203.100
Redirect IPs 62.67.203.100
Response IP 62.67.203.100
Found Yes
Hash 6c40309a64518dba1fc6738d0533a98d6111e9dcd9dc9ad2c518ecbd59ae2bbf
SimHash 0474d9346713

Groups

googlebot

Rule Path
Disallow /cms

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

Comments

  • Baiduspider
  • User-agent: Baiduspider
  • Disallow: /