cross-border-magazine.com
robots.txt

Robots Exclusion Standard data for cross-border-magazine.com

Resource Scan

Scan Details

Site Domain cross-border-magazine.com
Base Domain cross-border-magazine.com
Scan Status Ok
Last Scan2025-10-02T18:56:44+00:00
Next Scan 2025-11-01T18:56:44+00:00

Last Scan

Scanned2025-10-02T18:56:44+00:00
URL https://cross-border-magazine.com/robots.txt
Domain IPs 104.21.52.187, 172.67.202.219, 2606:4700:3031::6815:34bb, 2606:4700:3036::ac43:cadb
Response IP 172.67.202.219
Found Yes
Hash f6df83d465d061c5c19bce6f7aebbd07e4b60730a27d0064e1d1c4a79bd1e4f0
SimHash 6909eb5ac3b3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow /*?*
Disallow *?replytocom
Disallow /comments/feed/

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Comments

  • disallow all files in these directories