Log In Sign Up

myprosandcons.com
robots.txt

Robots Exclusion Standard data for myprosandcons.com

Resource Scan

Scan Details

Site Domain myprosandcons.com
Base Domain myprosandcons.com
Scan Status Ok
Last Scan2025-05-09T07:45:07+00:00
Next Scan 2025-05-16T07:45:07+00:00

Last Scan

Scanned2025-05-09T07:45:07+00:00
URL https://myprosandcons.com/robots.txt
Redirect https://www.myprosandcons.com/robots.txt
Redirect Domain www.myprosandcons.com
Redirect Base myprosandcons.com
Domain IPs 172.66.41.2, 172.66.42.254, 2606:4700:3108::ac42:2902, 2606:4700:3108::ac42:2afe
Redirect IPs 172.66.41.2, 172.66.42.254, 2606:4700:3108::ac42:2902, 2606:4700:3108::ac42:2afe
Response IP 172.66.42.254
Found Yes
Hash 4f5d9df091f4534ba1b109afc3befdea9a7fef63fd1bd1847f5ec6455dca883a
SimHash ef04d67003b0

Groups

jooblebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

bingpreview
adsbot-google-mobile
bingbot
adidxbot
*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /$
Allow /sitemap/sitemap*.txt$
Allow /ads.txt$
Back to top

Other Records

Field Value
sitemap https://www.myprosandcons.com/sitemap/sitemap.txt
Back to top

Comments

  • AE
Back to top