consumersafetywatch.com
robots.txt

Robots Exclusion Standard data for consumersafetywatch.com

Resource Scan

Scan Details

Site Domain consumersafetywatch.com
Base Domain consumersafetywatch.com
Scan Status Ok
Last Scan2024-11-05T06:57:56+00:00
Next Scan 2024-12-05T06:57:56+00:00

Last Scan

Scanned2024-11-05T06:57:56+00:00
URL https://consumersafetywatch.com/robots.txt
Domain IPs 50.116.74.207
Response IP 50.116.74.207
Found Yes
Hash 153419fb7141c03ba96f1020c6eb21f84f09ca14578fc514f2ecba51900ad012
SimHash 20304df56633

Groups

*

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /xmlrpc.php -
Disallow /wp-content/cache/ -
Disallow /wp-content/themes/ -
Disallow /trackback/ -
Disallow /feed/ -
Disallow /comments/ -
Disallow /category/ -
Disallow /trackback/ -
Disallow /feed/ -
Disallow /comments/ -
Disallow /*? -
Allow /wp-content/uploads/ -
Disallow /backup/ -
Disallow /dev/ -
Disallow /latest/ -
Disallow /demoform/ -
Disallow /beurette-plan-cul-bordeaux/ -
Disallow /index.php separate directive for the main script file of WP
Disallow /*.php$ -
Disallow /*.js$ -
Disallow /*.inc$ -
Disallow /*.css$ -
Disallow /tmp/ -
Disallow /junk/ -

googlebot-image

Rule Path
Allow /wp-content/uploads/

googlebot-mobile

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.consumersafetywatch.com/sitemap_index.xml