mysumber.com
robots.txt

Robots Exclusion Standard data for mysumber.com

Resource Scan

Scan Details

Site Domain mysumber.com
Base Domain mysumber.com
Scan Status Ok
Last Scan2024-07-01T05:33:48+00:00
Next Scan 2024-07-08T05:33:48+00:00

Last Scan

Scanned2024-07-01T05:33:48+00:00
URL https://mysumber.com/robots.txt
Redirect https://www.mysumber.com/robots.txt
Redirect Domain www.mysumber.com
Redirect Base mysumber.com
Domain IPs 104.21.14.250, 172.67.160.212, 2606:4700:3034::6815:efa, 2606:4700:3037::ac43:a0d4
Redirect IPs 104.21.14.250, 172.67.160.212, 2606:4700:3034::6815:efa, 2606:4700:3037::ac43:a0d4
Response IP 172.67.160.212
Found Yes
Hash 8e2b3c9d76d4815776641cb13f4682e69e5fbcd470b5e47f8a8b5f23a144d2cd
SimHash 4b4459d620b1

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow *?attachment_id=
Disallow /*~*
Disallow /*~

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /wp-content/uploads/

Other Records

Field Value
sitemap https://www.mysumber.com/sitemap_index.xml