themaverickspirit.com
robots.txt

Robots Exclusion Standard data for themaverickspirit.com

Resource Scan

Scan Details

Site Domain themaverickspirit.com
Base Domain themaverickspirit.com
Scan Status Ok
Last Scan2024-10-02T19:20:30+00:00
Next Scan 2024-10-09T19:20:30+00:00

Last Scan

Scanned2024-10-02T19:20:30+00:00
URL https://themaverickspirit.com/robots.txt
Domain IPs 137.184.68.202
Response IP 137.184.68.202
Found Yes
Hash 059bebbba82a23d2eceb278c7ac7f0c318fb138130f62180511579d673cfd776
SimHash 09514aa6e293

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /goto/
Disallow /recommends/
Disallow /wp-admin/
Disallow /themes/
Disallow /maverick-tools/

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://themaverickspirit.com/sitemap_index.xml