bestnewsmag.com
robots.txt

Robots Exclusion Standard data for bestnewsmag.com

Resource Scan

Scan Details

Site Domain bestnewsmag.com
Base Domain bestnewsmag.com
Scan Status Ok
Last Scan2024-06-11T03:40:09+00:00
Next Scan 2024-06-18T03:40:09+00:00

Last Scan

Scanned2024-06-11T03:40:09+00:00
URL https://bestnewsmag.com/robots.txt
Domain IPs 104.21.87.29, 172.67.140.20, 2606:4700:3030::6815:571d, 2606:4700:3030::ac43:8c14
Response IP 172.67.140.20
Found Yes
Hash 606fc64a80fdcc97e67dfa864d3862ff266e3b6125ef6cbb6b3772ade6cb5d9a
SimHash 6918cbcbc2b1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /readme.html
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /wp-content/plugins/
Disallow /feed/
Disallow */feed/
Disallow */?
Disallow /?
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

googlebot

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /